-- Logs begin at Wed 2022-08-10 12:32:55 UTC, end at Wed 2022-08-10 13:34:54 UTC. -- Aug 10 13:00:52.795679 dv-cinder-836027-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 10 13:00:52.802984 dv-cinder-836027-5-smb devstack@keystone.service[80287]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 10 13:00:52.805022 dv-cinder-836027-5-smb devstack@keystone.service[80287]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 13:00:52 2022] *** Aug 10 13:00:52.805022 dv-cinder-836027-5-smb devstack@keystone.service[80287]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 13:00:52.805022 dv-cinder-836027-5-smb devstack@keystone.service[80287]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 13:00:52.805022 dv-cinder-836027-5-smb devstack@keystone.service[80287]: nodename: dv-cinder-836027-5-smb Aug 10 13:00:52.805022 dv-cinder-836027-5-smb devstack@keystone.service[80287]: machine: x86_64 Aug 10 13:00:52.805022 dv-cinder-836027-5-smb devstack@keystone.service[80287]: clock source: unix Aug 10 13:00:52.805022 dv-cinder-836027-5-smb devstack@keystone.service[80287]: pcre jit disabled Aug 10 13:00:52.805022 dv-cinder-836027-5-smb devstack@keystone.service[80287]: detected number of CPU cores: 4 Aug 10 13:00:52.805586 dv-cinder-836027-5-smb devstack@keystone.service[80287]: current working directory: / Aug 10 13:00:52.805586 dv-cinder-836027-5-smb devstack@keystone.service[80287]: detected binary path: /usr/bin/uwsgi-core Aug 10 13:00:52.805586 dv-cinder-836027-5-smb devstack@keystone.service[80287]: your processes number limit is 47680 Aug 10 13:00:52.805586 dv-cinder-836027-5-smb devstack@keystone.service[80287]: your memory page size is 4096 bytes Aug 10 13:00:52.805586 dv-cinder-836027-5-smb devstack@keystone.service[80287]: detected max file descriptor number: 2048 Aug 10 13:00:52.805586 dv-cinder-836027-5-smb devstack@keystone.service[80287]: lock engine: pthread robust mutexes Aug 10 13:00:52.805586 dv-cinder-836027-5-smb devstack@keystone.service[80287]: thunder lock: enabled Aug 10 13:00:52.805586 dv-cinder-836027-5-smb devstack@keystone.service[80287]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 10 13:00:52.805586 dv-cinder-836027-5-smb devstack@keystone.service[80287]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 13:00:52.847292 dv-cinder-836027-5-smb devstack@keystone.service[80287]: Python main interpreter initialized at 0x55c83c3ad9c0 Aug 10 13:00:52.847292 dv-cinder-836027-5-smb devstack@keystone.service[80287]: python threads support enabled Aug 10 13:00:52.847292 dv-cinder-836027-5-smb devstack@keystone.service[80287]: your server socket listen backlog is limited to 100 connections Aug 10 13:00:52.847292 dv-cinder-836027-5-smb devstack@keystone.service[80287]: your mercy for graceful operations on workers is 90 seconds Aug 10 13:00:52.847720 dv-cinder-836027-5-smb devstack@keystone.service[80287]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 13:00:52.847798 dv-cinder-836027-5-smb devstack@keystone.service[80287]: *** Operational MODE: preforking *** Aug 10 13:00:52.848049 dv-cinder-836027-5-smb devstack@keystone.service[80287]: *** uWSGI is running in multiple interpreter mode *** Aug 10 13:00:52.848049 dv-cinder-836027-5-smb devstack@keystone.service[80287]: spawned uWSGI master process (pid: 80287) Aug 10 13:00:52.848266 dv-cinder-836027-5-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 10 13:00:52.849359 dv-cinder-836027-5-smb devstack@keystone.service[80287]: spawned uWSGI worker 1 (pid: 80296, cores: 1) Aug 10 13:00:52.849359 dv-cinder-836027-5-smb devstack@keystone.service[80287]: spawned uWSGI worker 2 (pid: 80297, cores: 1) Aug 10 13:00:52.849359 dv-cinder-836027-5-smb devstack@keystone.service[80287]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 13:00:58.399158 dv-cinder-836027-5-smb devstack@keystone.service[80296]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 13:00:58.399158 dv-cinder-836027-5-smb devstack@keystone.service[80296]: from cryptography.utils import int_from_bytes Aug 10 13:00:58.399968 dv-cinder-836027-5-smb devstack@keystone.service[80296]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 13:00:58.399968 dv-cinder-836027-5-smb devstack@keystone.service[80296]: from cryptography.utils import int_from_bytes Aug 10 13:00:58.404885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 13:00:58.404885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: from cryptography.utils import int_from_bytes Aug 10 13:00:58.405436 dv-cinder-836027-5-smb devstack@keystone.service[80297]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 13:00:58.405436 dv-cinder-836027-5-smb devstack@keystone.service[80297]: from cryptography.utils import int_from_bytes Aug 10 13:00:58.452944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 13:00:58.453199 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 13:00:58.453454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] command line args: [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 13:00:58.453821 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 13:00:58.454184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ================================================================================ {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 13:00:58.454628 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] admin_token = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.455066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] config_dir = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.455388 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.455610 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] config_source = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.455802 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] debug = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.456004 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.456270 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 13:00:58.456270 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 13:00:58.456397 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.456463 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] command line args: [] {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 13:00:58.456602 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.456702 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 13:00:58.456852 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.456978 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ================================================================================ {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 13:00:58.457130 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.457267 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.457407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] admin_token = **** {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.457554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] log_config_append = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.457698 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.457836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] config_dir = [] {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.457984 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] log_dir = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.457984 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] log_file = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.458211 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.458350 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.458481 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] config_source = [] {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.458578 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.458670 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] debug = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.458775 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.458947 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.459132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.459287 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.459381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.459510 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.459599 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.459741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.459860 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.459981 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.460056 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.460166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] list_limit = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.460249 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.460360 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] log_config_append = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.460444 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.460557 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.460557 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] log_dir = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.460691 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.460821 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] log_file = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.460950 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.461035 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.461145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.461222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.461281 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.461387 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.461577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.461727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.461727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.461950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.462026 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.462137 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.462216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] publish_errors = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.462333 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.462474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.462605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.462687 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.462821 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.462903 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.463026 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.463107 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.463283 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.463370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.463520 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] standard_threads = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.463664 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.463745 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.463847 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.463986 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.464101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.464201 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.464349 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] use_journal = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.464535 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.464658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] use_json = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.464761 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] publish_errors = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.464869 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] use_stderr = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.464946 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.465132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] use_syslog = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.465216 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.465294 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.465365 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.465539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.465621 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.465787 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.465872 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.466021 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] standard_threads = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.466104 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.466255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.466347 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.466502 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.466586 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.466681 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.466758 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.466873 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] use_journal = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.466981 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.467125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] use_json = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.467208 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] use_stderr = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.467278 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.467378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] use_syslog = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.467467 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.467612 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 13:00:58.467720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.467872 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.467976 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.468112 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.468215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.468376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.468455 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.468617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.468695 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.468869 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.468947 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.469111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.469445 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.469654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.469732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.469907 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.469983 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.470163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.470252 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.470412 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.470547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.470644 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.470876 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.471072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.471151 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.471220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.471408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.471544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.471660 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.471855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.471934 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.472110 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.472186 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.472343 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.472490 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.472585 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.472781 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.472859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.473052 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.473128 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.473284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.473415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.473501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.473752 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.473828 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.474000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.474079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.474239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.474446 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.474523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.474708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.474847 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.474946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.475219 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.475299 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.475452 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.475596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.475682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.475907 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.476034 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.476137 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.476232 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.476373 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.476557 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.476644 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.476944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.477042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.477367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.477449 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.477528 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.477685 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.477760 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.477830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.477899 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.478014 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.478185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.478272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.478470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.478547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.478707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.478791 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.478945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.479056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.479220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.479301 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.479460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.479547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.479692 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.479781 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.479945 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.480024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.480182 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.480263 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.480418 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.480507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.480649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.480729 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.480881 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.480961 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.481120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.481240 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.481371 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.481478 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.481605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.481716 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.481847 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.481959 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.482080 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.482317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.482422 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.482555 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.482805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.482899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.483060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.483278 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.483371 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.483529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.483733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.483811 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.483994 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.484118 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.484233 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.484307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.484451 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.484525 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.484707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.484843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.484968 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.485051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.485162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.485242 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.485390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.485474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.485649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.485735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.485886 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.485973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.486120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.486211 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.486358 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.486436 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.486594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.486675 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.486860 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.486941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.487127 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.487222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.487373 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.487458 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.487616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.487697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.487852 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.487928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.488089 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.488167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.488325 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.488404 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.488562 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.488639 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.488798 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.488887 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.489029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.489116 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.489261 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.489340 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.489496 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.489574 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.489723 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.489799 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.489955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.490032 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.490189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.490270 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.490425 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.490517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.490663 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.490742 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.490920 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.491057 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.491209 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.491336 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.491481 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.491608 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.491731 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.external = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.491852 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.491981 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.492081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.492166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.492240 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.492363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.492445 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.493154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.493254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.password = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.493392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.493472 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.token = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.493625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.493704 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.493863 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.493951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.494096 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.494181 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.494344 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.494423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.494581 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.494692 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.494830 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.494910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.495082 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.495166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.495322 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.495402 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.495571 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.495663 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.495820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.495902 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.496052 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] auth.external = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.496130 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.496286 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.496374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.496538 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.496620 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.496778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.496874 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.497040 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] auth.password = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.497170 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.497261 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] auth.token = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.497370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.497489 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.497614 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.497727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.497855 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.497979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.498049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.498185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.498272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.498433 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.498522 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.498683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.498763 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.498915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.498993 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.499200 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] credential.caching = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.499296 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.499450 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.499531 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.499701 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.499784 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.499948 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.500035 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.500178 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.500269 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.500425 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.500663 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.500740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.500933 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.501014 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.501188 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.501308 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.501425 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.501503 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.501679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.501759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.501918 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.501997 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.502166 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.502245 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.502403 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.502484 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.502653 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.502732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.502901 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.502980 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.503161 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.503246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] federation.caching = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.503399 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.503478 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.503647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.503733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.503879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.503960 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.504118 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.504196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.504365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.504442 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.504603 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.504685 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.504837 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.504915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.505068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.505164 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.505331 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.505411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.505570 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.505648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.505819 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.505905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.506057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] identity.caching = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.506136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.506309 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.506501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.506580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.506784 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.506949 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.507063 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.507283 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.507462 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.507531 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.507743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.507923 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.508003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.508293 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.508880 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.509027 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.509114 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.509261 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.509341 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.509494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.509655 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.509736 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.509977 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.510056 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.510226 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.510441 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.510520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.510718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.510888 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.511015 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.511332 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.511411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.511575 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.511774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.511865 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.512038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.512259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.512339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.512494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.512572 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.512752 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.512836 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.512979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.513057 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.513228 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.513459 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.513658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.513739 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.513812 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.513883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.513962 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.514169 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.514258 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.514424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.514671 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.514750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.514905 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.515155 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.515257 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.515394 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.515473 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.515632 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.515716 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.515871 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.515960 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.516117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.516195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.516357 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.516436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.516597 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.516686 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.516848 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.516920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.517098 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.517166 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.517332 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.517428 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.517572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.517649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.517811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.517879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.518053 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.518143 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.518289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.518369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.518527 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.518606 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.518764 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.518853 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.519022 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.user = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.519104 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.519261 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.519340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.519509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.519591 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.519743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.519821 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.519987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.520074 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.520217 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.520299 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.520453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.520533 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.520689 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.520790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.520921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.521004 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.521158 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.521237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.521394 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.521473 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.521631 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.521713 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.521864 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.521942 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.522111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.522191 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.522360 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.522441 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.522611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.522728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.522855 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.522937 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.523118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.523202 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.523355 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.523485 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.523592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.523710 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.523844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.523922 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.524084 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.524172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.524327 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.524407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.524563 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.524662 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.524811 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.524897 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.525039 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.525118 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.525287 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.525368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.525524 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.525602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.525760 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.525840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.525999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.526081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.526236 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.526314 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.526474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.526552 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.526707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.526788 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.526943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.527079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.527210 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.527289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.527442 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.527523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.527686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.527764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.527921 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.528107 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] resource.caching = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.528196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.528413 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.528562 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.528641 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.528885 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.529045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.529136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.529348 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.529492 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.529571 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] role.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.529818 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] role.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.529968 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.530125 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.530286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.530428 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.530534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.530783 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.530861 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.531051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.531300 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.531379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.531546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.531793 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.531871 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.532052 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.532271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.532351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.532523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.532723 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] role.caching = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.532801 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.533008 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.533176 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] role.driver = sql {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.533256 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.533483 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.533693 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.533787 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.533931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.534012 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.534182 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.534262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.534432 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.534521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.534717 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.534822 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.534970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.535113 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.535251 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.535345 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.535506 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.535586 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.535745 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.535824 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.535997 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.536090 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.536252 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.536339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.536503 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.536584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.536738 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.536826 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.536992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.537169 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.537248 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.537419 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.537499 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.537678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.537766 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.537935 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.538003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.538166 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.538250 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.538403 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] token.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.538484 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.538641 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.538721 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.538889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.538969 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.539150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.539324 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.539461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.539660 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.539739 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.539902 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.539984 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.540143 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.540223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.540384 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.540463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.540631 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.540712 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.540870 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.540949 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.541109 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.541187 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.541344 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.541425 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.541582 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.541660 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.541818 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.541898 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.542046 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.542126 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] token.caching = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.542285 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.542363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.542536 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.542615 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.542777 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.542861 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.connection = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.543059 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.543156 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.543315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.543394 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.543551 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.543676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.543793 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.543875 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.544030 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.544109 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.544268 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.544347 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.544504 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.544575 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.544740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.544821 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.544976 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.545053 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.545210 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.545290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.545453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.545533 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.545684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.545762 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.545931 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.546011 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.546164 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.546242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.546415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.546494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] database.connection = **** {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.546647 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.546741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.546889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.546970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.547148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.547228 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.547319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 13:00:58.547439 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.547678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.547920 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.548159 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.548398 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.548646 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.548887 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.549134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.549371 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.549622 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.549859 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.550106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.550339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.550778 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.550869 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 13:00:58.550981 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 13:00:58.578529 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.578747 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.578973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.582913 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.583174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.583404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.590315 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.595841 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.623589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.623879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.624344 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.624583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.680708 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.680888 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.735691 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.735933 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.738756 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.738987 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.805469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.805701 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.805916 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.806003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.806136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.806353 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.806436 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.806565 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.806767 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.807204 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.807593 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.807982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.831348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.831578 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.831812 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.831987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.832079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.832226 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.832308 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.832452 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.832553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.832667 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.832752 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.832889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.833107 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.833318 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.845622 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.847655 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.858599 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.858738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.858821 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.858920 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.859064 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.859150 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.859283 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.859365 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.859499 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.859574 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.859709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.859789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.859911 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.860014 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 13:00:58.877719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.877929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 13:00:58.878279 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.878481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 13:00:58.878753 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.879124 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.879304 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.879558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.880119 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.880336 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 13:00:58.880686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.880891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 13:00:58.881164 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.881426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.881685 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.881943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.891581 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.891872 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.892139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.892427 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.894006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.894296 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.894569 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.894857 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.900990 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:58.902439 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:58.904135 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:58.904710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.905001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.905287 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.905579 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.905841 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.906115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.906397 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.906676 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.906806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:58.906958 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.907249 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.907332 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.907782 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.908287 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.908810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.909258 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.909618 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.909898 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.910178 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.910457 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.910736 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.931416 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.932876 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:58.933160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.933754 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.935286 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:58.935572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.937762 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:58.938050 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.938334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.940207 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:58.940493 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.940779 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.945056 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:58.945411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.947936 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:58.948229 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.952363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:58.952489 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:58.952658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.952788 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.952945 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.953075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.953239 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.953362 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.953521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.953647 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.953822 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.953989 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.954104 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.954266 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.954382 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.954540 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.971381 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.971507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.971660 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.971742 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.975656 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:58.975767 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:58.978848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.978943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.979169 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.979252 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.983627 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:58.983755 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:58.986796 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:58.986904 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:58.989978 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.990102 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.990279 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.990365 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.990569 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.990652 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.990866 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.990950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.991166 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.991253 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.991456 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:58.991553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.007588 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:59.007802 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:59.007898 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.008612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.008725 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.008894 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.008979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.009157 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.015866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.016061 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.017463 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.017620 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.017758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.017899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.020578 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:59.020726 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:59.020864 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.021012 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.021166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.021304 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.021454 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.021592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.021737 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.021875 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.033822 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:59.033942 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:59.034107 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.034202 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.034385 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.034469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.034668 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.034752 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.034949 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.035054 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.035250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.035346 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.035533 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.035617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.052316 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:59.052446 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:59.055816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:59.055943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:59.058761 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.058885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.060377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.060504 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.061878 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:59.061982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:59.062163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.062249 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.062453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.062547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.068913 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.069038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.070548 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:59.070809 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:59.074125 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.074418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.074702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.074979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.075622 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.076104 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.076556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.077012 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.083488 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:59.083784 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.084079 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.085515 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:59.085799 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.086084 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.091569 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:59.091854 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.092148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.092423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.092698 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.093002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.093274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.093540 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.093642 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 13:00:59.093898 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.093993 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.094446 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.094537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.094731 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.094816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.095026 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.095137 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.095294 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.095427 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.095553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.095634 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.095839 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.096228 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.096518 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.096799 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.097078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.097349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.097615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 13:00:59.129661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55c83c3ad9c0 pid: 80296 (default app) Aug 10 13:00:59.131382 dv-cinder-836027-5-smb devstack@keystone.service[80297]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55c83c3ad9c0 pid: 80297 (default app) Aug 10 13:00:59.133032 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9db5e-8ee7-4ce7-a0b2-73cfdbdb1b2f None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:00:59.133348 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9db5e-8ee7-4ce7-a0b2-73cfdbdb1b2f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:00:59.133621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9db5e-8ee7-4ce7-a0b2-73cfdbdb1b2f None None] PATH_INFO: `/v3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:00:59.137859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 791 bytes} [Wed Aug 10 13:00:59 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:06.874008 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f07ff4-8a58-4627-9649-de6e26e2b749 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:06.874578 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f07ff4-8a58-4627-9649-de6e26e2b749 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:06.874578 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f07ff4-8a58-4627-9649-de6e26e2b749 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:06.878941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:01:06.884290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb9f84-1222-4d73-8cfb-492dd6c106a9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:06.884723 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb9f84-1222-4d73-8cfb-492dd6c106a9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:06.884816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb9f84-1222-4d73-8cfb-492dd6c106a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:06.954622 dv-cinder-836027-5-smb devstack@keystone.service[80296]: INFO dbcounter [None req-82fb9f84-1222-4d73-8cfb-492dd6c106a9 None None] Registered counter for database keystone Aug 10 13:01:06.974336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG oslo_db.sqlalchemy.engines [None req-82fb9f84-1222-4d73-8cfb-492dd6c106a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:01:06.980606 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writer thread running {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:01:07.167856 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG passlib.handlers.bcrypt [None req-82fb9f84-1222-4d73-8cfb-492dd6c106a9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80296) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 10 13:01:07.168187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG passlib.handlers.bcrypt [None req-82fb9f84-1222-4d73-8cfb-492dd6c106a9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80296) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 10 13:01:07.226272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-82fb9f84-1222-4d73-8cfb-492dd6c106a9 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:07.227948 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-82fb9f84-1222-4d73-8cfb-492dd6c106a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:07.359911 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 10 13:01:07.514527 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f07ff4-8a58-4627-9649-de6e26e2b749 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:07.583437 dv-cinder-836027-5-smb devstack@keystone.service[80297]: INFO dbcounter [None req-32f07ff4-8a58-4627-9649-de6e26e2b749 None None] Registered counter for database keystone Aug 10 13:01:07.605344 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG oslo_db.sqlalchemy.engines [None req-32f07ff4-8a58-4627-9649-de6e26e2b749 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80297) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 13:01:07.611581 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writer thread running {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 13:01:07.729670 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f07ff4-8a58-4627-9649-de6e26e2b749 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:07.733882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3be9e8-42c4-4d73-abd8-b92cefaf2b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:07.734510 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3be9e8-42c4-4d73-abd8-b92cefaf2b2e admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:07.734792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3be9e8-42c4-4d73-abd8-b92cefaf2b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:07.735095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3be9e8-42c4-4d73-abd8-b92cefaf2b2e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:07.743197 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3be9e8-42c4-4d73-abd8-b92cefaf2b2e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:07.797260 dv-cinder-836027-5-smb devstack@keystone.service[80297]: WARNING keystone.common.rbac_enforcer.enforcer [None req-be3be9e8-42c4-4d73-abd8-b92cefaf2b2e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 10 13:01:07.797533 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3be9e8-42c4-4d73-abd8-b92cefaf2b2e admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:07.807498 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1324 bytes} [Wed Aug 10 13:01:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 13:01:07.813459 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb9f84-1222-4d73-8cfb-492dd6c106a9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:07.829436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb9f84-1222-4d73-8cfb-492dd6c106a9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:07.833860 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea0784-0bc6-4045-bf73-574cde51c9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:07.834955 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea0784-0bc6-4045-bf73-574cde51c9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:07.835272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea0784-0bc6-4045-bf73-574cde51c9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:07.835549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea0784-0bc6-4045-bf73-574cde51c9c7 admin admin] PATH_INFO: `/v3/projects/3a5ada6b0d15453089d18d03b8cafc46` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:07.837556 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea0784-0bc6-4045-bf73-574cde51c9c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=3a5ada6b0d15453089d18d03b8cafc46)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:07.888401 dv-cinder-836027-5-smb devstack@keystone.service[80296]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3cea0784-0bc6-4045-bf73-574cde51c9c7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 10 13:01:07.889017 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea0784-0bc6-4045-bf73-574cde51c9c7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:07.893393 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 3/5] 10.222.0.46 () {56 vars in 1207 bytes} [Wed Aug 10 13:01:07 2022] GET /identity/v3/projects/3a5ada6b0d15453089d18d03b8cafc46 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:09.892842 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df2fc1-2aac-45c5-953a-7921cddb1842 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:09.893390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df2fc1-2aac-45c5-953a-7921cddb1842 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:09.893390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df2fc1-2aac-45c5-953a-7921cddb1842 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:09.897457 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 3/6] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:09.903386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd4d82-3950-497e-b2d8-eff0672c548e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:09.903854 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd4d82-3950-497e-b2d8-eff0672c548e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:09.903947 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd4d82-3950-497e-b2d8-eff0672c548e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:09.925405 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-12dd4d82-3950-497e-b2d8-eff0672c548e None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:09.927053 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-12dd4d82-3950-497e-b2d8-eff0672c548e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:09.935753 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 10 13:01:09.958434 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df2fc1-2aac-45c5-953a-7921cddb1842 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:09.970975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df2fc1-2aac-45c5-953a-7921cddb1842 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:09.975283 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19a070-cb09-46cb-b9a8-f6bdbdbc01c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:09.975877 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19a070-cb09-46cb-b9a8-f6bdbdbc01c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:09.976153 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19a070-cb09-46cb-b9a8-f6bdbdbc01c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:09.976421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19a070-cb09-46cb-b9a8-f6bdbdbc01c3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:09.985425 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19a070-cb09-46cb-b9a8-f6bdbdbc01c3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:09.987238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19a070-cb09-46cb-b9a8-f6bdbdbc01c3 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:09.997175 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1324 bytes} [Wed Aug 10 13:01:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 13:01:10.003684 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd4d82-3950-497e-b2d8-eff0672c548e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:10.013324 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd4d82-3950-497e-b2d8-eff0672c548e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:10.017759 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41390578-bbb1-424d-b840-7a89a2fc443f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:10.018388 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41390578-bbb1-424d-b840-7a89a2fc443f admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:10.018671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41390578-bbb1-424d-b840-7a89a2fc443f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:10.018947 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41390578-bbb1-424d-b840-7a89a2fc443f admin admin] PATH_INFO: `/v3/users/1ade4cba44f6449e9916b370e369e98e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:10.020332 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41390578-bbb1-424d-b840-7a89a2fc443f admin admin] RBAC: Authorizing `identity:get_user(user_id=1ade4cba44f6449e9916b370e369e98e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:10.022164 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41390578-bbb1-424d-b840-7a89a2fc443f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:10.023746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 5/9] 10.222.0.46 () {56 vars in 1198 bytes} [Wed Aug 10 13:01:10 2022] GET /identity/v3/users/1ade4cba44f6449e9916b370e369e98e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:12.115842 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceae1e4-8f88-4095-84cb-ad3387b969f4 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:12.116348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceae1e4-8f88-4095-84cb-ad3387b969f4 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:12.116440 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceae1e4-8f88-4095-84cb-ad3387b969f4 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:12.118388 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:01:12.123888 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389aa5a-c0ab-41a4-9784-86baf88823fa None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:12.124366 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389aa5a-c0ab-41a4-9784-86baf88823fa None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:12.124459 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389aa5a-c0ab-41a4-9784-86baf88823fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:12.143283 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3389aa5a-c0ab-41a4-9784-86baf88823fa None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:12.144480 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3389aa5a-c0ab-41a4-9784-86baf88823fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:12.146543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c38e08-4348-4a5e-8e44-cbfe57345bce None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:12.146900 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c38e08-4348-4a5e-8e44-cbfe57345bce None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:12.147274 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c38e08-4348-4a5e-8e44-cbfe57345bce None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:12.148633 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 6/11] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:01:12.154054 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa94d8-edff-4d69-887d-b85537a1ac5b None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:12.154338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa94d8-edff-4d69-887d-b85537a1ac5b None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:12.154617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa94d8-edff-4d69-887d-b85537a1ac5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:12.199218 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG passlib.handlers.bcrypt [None req-c7aa94d8-edff-4d69-887d-b85537a1ac5b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80297) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 10 13:01:12.199660 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG passlib.handlers.bcrypt [None req-c7aa94d8-edff-4d69-887d-b85537a1ac5b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80297) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 10 13:01:12.226021 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 6/12] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:01:12.246058 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-c7aa94d8-edff-4d69-887d-b85537a1ac5b None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:12.247643 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c7aa94d8-edff-4d69-887d-b85537a1ac5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:12.249303 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389aa5a-c0ab-41a4-9784-86baf88823fa None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:12.275163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:12.351528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:01:12.360005 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389aa5a-c0ab-41a4-9784-86baf88823fa None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:12.373380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa94d8-edff-4d69-887d-b85537a1ac5b None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:12.394116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c2b47-2be8-452a-9804-2de4ec3f8bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:12.394750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c2b47-2be8-452a-9804-2de4ec3f8bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:12.395051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c2b47-2be8-452a-9804-2de4ec3f8bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:12.395329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c2b47-2be8-452a-9804-2de4ec3f8bb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:12.407282 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c2b47-2be8-452a-9804-2de4ec3f8bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:12.417941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-451c2b47-2be8-452a-9804-2de4ec3f8bb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:01:12.417941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:12.417941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:12.417941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:12.417941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:12.417941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:12.417941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:12.417941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:12.417941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:12.417941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:12.417941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:12.417941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:12.417941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:12.417941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:12.417941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:12.417941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:12.418904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:12.418904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:12.418904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:12.418904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:12.418904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:12.418904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:12.418904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:12.418904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:12.418904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:12.418904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:12.418904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:12.418904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:12.418904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:12.418904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:12.418904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:12.418904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:12.419804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:12.419804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:12.419804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:12.419804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:12.419804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:12.419804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:12.419804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:12.419804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:12.419804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:12.419804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:12.419804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:01:12.419804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:01:12.419804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 7/14] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:01:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:01:12.426380 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c2b47-2be8-452a-9804-2de4ec3f8bb6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:12.476155 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa94d8-edff-4d69-887d-b85537a1ac5b None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:12.478505 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:12.510967 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:12.519218 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d6b25-1c82-40bc-9fad-27a4923df9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:12.520184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d6b25-1c82-40bc-9fad-27a4923df9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:12.520526 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d6b25-1c82-40bc-9fad-27a4923df9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:12.520862 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d6b25-1c82-40bc-9fad-27a4923df9e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:12.530987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c2b47-2be8-452a-9804-2de4ec3f8bb6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:12.567038 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532b2e1-1d99-47d6-83ec-bea6af7d9651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:12.567914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532b2e1-1d99-47d6-83ec-bea6af7d9651 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:12.568193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532b2e1-1d99-47d6-83ec-bea6af7d9651 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:12.568466 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532b2e1-1d99-47d6-83ec-bea6af7d9651 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:12.569162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532b2e1-1d99-47d6-83ec-bea6af7d9651 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:12.569676 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532b2e1-1d99-47d6-83ec-bea6af7d9651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:12.571402 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532b2e1-1d99-47d6-83ec-bea6af7d9651 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:12.583494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 8/15] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:01:12.590142 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532b2e1-1d99-47d6-83ec-bea6af7d9651 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:12.596648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d6b25-1c82-40bc-9fad-27a4923df9e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:12.597419 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d6b25-1c82-40bc-9fad-27a4923df9e5 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:12.703859 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 8/16] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:01:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:12.709877 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d6b25-1c82-40bc-9fad-27a4923df9e5 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:12.713676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:12.804785 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532b2e1-1d99-47d6-83ec-bea6af7d9651 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:12.821223 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d6b25-1c82-40bc-9fad-27a4923df9e5 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:12.841531 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5a47a-45eb-4a0d-b1bb-7f7c4da0cc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:12.842328 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5a47a-45eb-4a0d-b1bb-7f7c4da0cc8a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:12.842617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5a47a-45eb-4a0d-b1bb-7f7c4da0cc8a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:12.842894 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5a47a-45eb-4a0d-b1bb-7f7c4da0cc8a None admin] PATH_INFO: `/v3/users/1ade4cba44f6449e9916b370e369e98e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:12.844085 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5a47a-45eb-4a0d-b1bb-7f7c4da0cc8a None admin] RBAC: Authorizing `identity:get_user(user_id=1ade4cba44f6449e9916b370e369e98e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:12.845808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5a47a-45eb-4a0d-b1bb-7f7c4da0cc8a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:12.847479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 9/17] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:12 2022] GET /identity/v3/users/1ade4cba44f6449e9916b370e369e98e => generated 247 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:01:12.853549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5a47a-45eb-4a0d-b1bb-7f7c4da0cc8a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:12.857198 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab1d5e-a4f1-4e12-97dd-52d3e7562214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:12.858060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab1d5e-a4f1-4e12-97dd-52d3e7562214 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:12.858343 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab1d5e-a4f1-4e12-97dd-52d3e7562214 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:12.858606 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab1d5e-a4f1-4e12-97dd-52d3e7562214 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:12.868647 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:12.877410 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab1d5e-a4f1-4e12-97dd-52d3e7562214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:12.878868 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab1d5e-a4f1-4e12-97dd-52d3e7562214 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:12.897220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-f9ab1d5e-a4f1-4e12-97dd-52d3e7562214 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:01:12.897220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:12.897220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:12.897220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:12.897220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:12.897220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:12.897220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:12.897220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:12.897220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:12.897220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:12.897220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:12.897220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:12.897220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:01:12.897220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:01:12.897220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:01:12.897220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:01:12.898884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:12.898884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:12.898884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:12.898884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:12.898884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:12.898884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:12.898884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:12.898884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:12.898884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:12.898884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:12.898884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:12.898884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:12.898884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:12.898884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:12.898884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:12.898884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:12.898884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:01:12.899770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:01:12.899770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:01:12.899770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:01:12.899770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 9/18] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:01:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:01:12.904710 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab1d5e-a4f1-4e12-97dd-52d3e7562214 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:12.954394 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5a47a-45eb-4a0d-b1bb-7f7c4da0cc8a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:12.969506 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:12.993718 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4116b-f542-4431-a5d2-55a46829b1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:12.994370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4116b-f542-4431-a5d2-55a46829b1ee None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:12.994653 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4116b-f542-4431-a5d2-55a46829b1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:12.994929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4116b-f542-4431-a5d2-55a46829b1ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:12.996111 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4116b-f542-4431-a5d2-55a46829b1ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:12.997592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4116b-f542-4431-a5d2-55a46829b1ee None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:12.999245 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 10/19] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:01:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:13.005474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4116b-f542-4431-a5d2-55a46829b1ee None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:13.020362 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab1d5e-a4f1-4e12-97dd-52d3e7562214 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:13.058869 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440d3a2-9aa0-4f42-948d-8cc2efefbc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:13.059504 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440d3a2-9aa0-4f42-948d-8cc2efefbc88 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:13.059785 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440d3a2-9aa0-4f42-948d-8cc2efefbc88 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:13.060129 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440d3a2-9aa0-4f42-948d-8cc2efefbc88 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:13.060787 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440d3a2-9aa0-4f42-948d-8cc2efefbc88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:13.061156 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440d3a2-9aa0-4f42-948d-8cc2efefbc88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:13.062601 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440d3a2-9aa0-4f42-948d-8cc2efefbc88 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:13.080776 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 10/20] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:01:13.099832 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:13.123020 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4116b-f542-4431-a5d2-55a46829b1ee None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:13.161789 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdfffe-a163-4767-95ad-890a1f974c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:13.162474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdfffe-a163-4767-95ad-890a1f974c66 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:13.162678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdfffe-a163-4767-95ad-890a1f974c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:13.162955 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdfffe-a163-4767-95ad-890a1f974c66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:13.163738 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fdfffe-a163-4767-95ad-890a1f974c66 None admin] RBAC: Adding query filter params (role.id=d9c9200468cb4f7ab6a23882bfb1f062, scope.domain.id=default, user.id=1ade4cba44f6449e9916b370e369e98e) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:13.164640 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fdfffe-a163-4767-95ad-890a1f974c66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:13.166149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fdfffe-a163-4767-95ad-890a1f974c66 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:13.174093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 11/21] 10.222.0.46 () {56 vars in 1322 bytes} [Wed Aug 10 13:01:13 2022] GET /identity/v3/role_assignments?user.id=1ade4cba44f6449e9916b370e369e98e&scope.domain.id=default&role.id=d9c9200468cb4f7ab6a23882bfb1f062 => generated 233 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:01:15.527989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8d4f4-ec3e-4789-a9ce-63df689f7541 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:15.529035 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8d4f4-ec3e-4789-a9ce-63df689f7541 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:15.529533 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8d4f4-ec3e-4789-a9ce-63df689f7541 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:15.531372 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 11/22] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:15.537129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e32df-d6c8-4679-9504-f208feece3dc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:15.538046 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e32df-d6c8-4679-9504-f208feece3dc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:15.538528 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e32df-d6c8-4679-9504-f208feece3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:15.564235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-091e32df-d6c8-4679-9504-f208feece3dc None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:15.565938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-091e32df-d6c8-4679-9504-f208feece3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:15.657942 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 12/23] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:01:15.691844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8d4f4-ec3e-4789-a9ce-63df689f7541 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:15.820009 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e7868-1b77-48ce-b069-019888eaff15 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:15.820817 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e7868-1b77-48ce-b069-019888eaff15 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:15.821324 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e7868-1b77-48ce-b069-019888eaff15 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:15.826824 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:15.828440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216ae58-a389-4e43-a889-359734f19041 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:15.828922 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216ae58-a389-4e43-a889-359734f19041 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:15.829468 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216ae58-a389-4e43-a889-359734f19041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:15.835571 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8d4f4-ec3e-4789-a9ce-63df689f7541 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:15.870977 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:15.876195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e216ae58-a389-4e43-a889-359734f19041 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:15.877680 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e216ae58-a389-4e43-a889-359734f19041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:15.935083 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c4900-519d-4f22-b141-de547313e0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:15.935083 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c4900-519d-4f22-b141-de547313e0b1 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:15.935083 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c4900-519d-4f22-b141-de547313e0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:15.935083 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c4900-519d-4f22-b141-de547313e0b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:15.999150 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c4900-519d-4f22-b141-de547313e0b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:16.000768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 14/25] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:01:16.002367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-5f4c4900-519d-4f22-b141-de547313e0b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:01:16.002367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:16.002367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:16.002367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:16.002367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:16.002367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:16.002367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:16.002367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:16.002367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:16.002367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:16.002367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:16.002367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:16.002367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:16.002367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:16.002367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:16.002367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:16.003237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:16.003237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:16.003237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:16.003237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:16.003237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:16.003237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:16.003237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:16.003237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:16.003237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:16.003237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:16.003237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:16.003237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:16.003237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:16.003237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:16.003237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:16.003237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:16.004008 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:16.004008 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:16.004008 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:16.004008 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:16.004008 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:16.004008 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:16.004008 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:16.004008 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:16.004008 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:16.004008 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:16.004008 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:01:16.004008 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:01:16.004008 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 12/26] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:01:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:16.016121 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216ae58-a389-4e43-a889-359734f19041 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:16.031779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:16.062509 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c4900-519d-4f22-b141-de547313e0b1 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:16.147898 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216ae58-a389-4e43-a889-359734f19041 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:16.195329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771fc1e-ae9a-4c2f-9699-ff1db093c1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:16.195955 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771fc1e-ae9a-4c2f-9699-ff1db093c1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:16.196236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771fc1e-ae9a-4c2f-9699-ff1db093c1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:16.196516 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771fc1e-ae9a-4c2f-9699-ff1db093c1d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:16.197196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771fc1e-ae9a-4c2f-9699-ff1db093c1d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:16.197501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771fc1e-ae9a-4c2f-9699-ff1db093c1d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:16.198898 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771fc1e-ae9a-4c2f-9699-ff1db093c1d2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:16.216921 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 15/27] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:16.221232 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5e368-63fc-4add-a3e3-d75e68e1b9c8 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:16.221573 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5e368-63fc-4add-a3e3-d75e68e1b9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:16.221923 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5e368-63fc-4add-a3e3-d75e68e1b9c8 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:16.224068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 16/28] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:16.224962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5e368-63fc-4add-a3e3-d75e68e1b9c8 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:16.275976 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c4900-519d-4f22-b141-de547313e0b1 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:16.299472 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:16.342282 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5e368-63fc-4add-a3e3-d75e68e1b9c8 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:16.383192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7305a5e-9411-45ad-815a-9bbf6e77c500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:16.384109 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7305a5e-9411-45ad-815a-9bbf6e77c500 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:16.384575 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7305a5e-9411-45ad-815a-9bbf6e77c500 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:16.384997 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7305a5e-9411-45ad-815a-9bbf6e77c500 None admin] PATH_INFO: `/v3/users/1ade4cba44f6449e9916b370e369e98e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:16.386474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7305a5e-9411-45ad-815a-9bbf6e77c500 None admin] RBAC: Authorizing `identity:get_user(user_id=1ade4cba44f6449e9916b370e369e98e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:16.388359 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7305a5e-9411-45ad-815a-9bbf6e77c500 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:16.390297 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 17/29] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:16 2022] GET /identity/v3/users/1ade4cba44f6449e9916b370e369e98e => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:16.391720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b6456-39bc-49c9-b6e9-0dafddc224d7 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:16.392198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b6456-39bc-49c9-b6e9-0dafddc224d7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:16.392610 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b6456-39bc-49c9-b6e9-0dafddc224d7 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:16.393997 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 18/30] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:16.399831 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332214c-e699-4b81-81e2-dc8f9b5f731e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:16.400365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332214c-e699-4b81-81e2-dc8f9b5f731e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:16.400804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332214c-e699-4b81-81e2-dc8f9b5f731e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:16.424052 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e332214c-e699-4b81-81e2-dc8f9b5f731e None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:16.425573 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e332214c-e699-4b81-81e2-dc8f9b5f731e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:16.439169 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fcd5c-3825-488d-a9c7-6cc0c6bfc46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:16.439791 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fcd5c-3825-488d-a9c7-6cc0c6bfc46f None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:16.440073 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fcd5c-3825-488d-a9c7-6cc0c6bfc46f None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:16.440348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fcd5c-3825-488d-a9c7-6cc0c6bfc46f None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:16.441022 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fcd5c-3825-488d-a9c7-6cc0c6bfc46f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:16.442709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fcd5c-3825-488d-a9c7-6cc0c6bfc46f None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:16.506416 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 19/31] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:16.507682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332214c-e699-4b81-81e2-dc8f9b5f731e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:16.579574 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:16.587166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 13/32] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Aug 10 13:01:16 2022] POST /identity/v3/roles => generated 219 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:01:16.595087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70045bd-3fa5-469c-a68d-c16d4f49ba16 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:16.595087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70045bd-3fa5-469c-a68d-c16d4f49ba16 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:16.595087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70045bd-3fa5-469c-a68d-c16d4f49ba16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:16.612555 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-d70045bd-3fa5-469c-a68d-c16d4f49ba16 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:16.614005 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d70045bd-3fa5-469c-a68d-c16d4f49ba16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:16.647832 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332214c-e699-4b81-81e2-dc8f9b5f731e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:16.655183 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:16.701728 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 14/33] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:16.702835 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70045bd-3fa5-469c-a68d-c16d4f49ba16 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:16.703872 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18d20b-3df9-4c4b-9530-f128264a1556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:16.704541 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18d20b-3df9-4c4b-9530-f128264a1556 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:16.704829 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18d20b-3df9-4c4b-9530-f128264a1556 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:16.705105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18d20b-3df9-4c4b-9530-f128264a1556 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:16.706395 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18d20b-3df9-4c4b-9530-f128264a1556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:16.707895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18d20b-3df9-4c4b-9530-f128264a1556 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:16.714602 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 20/34] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:01:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:16.716270 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d69ef1-76da-40af-bebe-0cb9bebf9eab None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:16.716575 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d69ef1-76da-40af-bebe-0cb9bebf9eab None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:16.716890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d69ef1-76da-40af-bebe-0cb9bebf9eab None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:16.723514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 21/35] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:16.724496 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d69ef1-76da-40af-bebe-0cb9bebf9eab None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:16.832900 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70045bd-3fa5-469c-a68d-c16d4f49ba16 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:16.842117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d69ef1-76da-40af-bebe-0cb9bebf9eab None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:16.876796 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:16.882356 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7bbf9-3f98-4513-9f58-6b92cc2c4474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:16.883594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7bbf9-3f98-4513-9f58-6b92cc2c4474 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:16.883870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7bbf9-3f98-4513-9f58-6b92cc2c4474 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:16.884143 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7bbf9-3f98-4513-9f58-6b92cc2c4474 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:16.885571 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7ff1c-70d0-4b3c-bb1c-7b93924bc566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:16.886253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7ff1c-70d0-4b3c-bb1c-7b93924bc566 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:16.886534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7ff1c-70d0-4b3c-bb1c-7b93924bc566 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:16.886808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7ff1c-70d0-4b3c-bb1c-7b93924bc566 None admin] PATH_INFO: `/v3/domains/default/users/1ade4cba44f6449e9916b370e369e98e/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:16.888869 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7ff1c-70d0-4b3c-bb1c-7b93924bc566 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1ade4cba44f6449e9916b370e369e98e, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:16.890325 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7ff1c-70d0-4b3c-bb1c-7b93924bc566 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:16.900038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7bbf9-3f98-4513-9f58-6b92cc2c4474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:16.901310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7bbf9-3f98-4513-9f58-6b92cc2c4474 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:16.922718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-2bf7bbf9-3f98-4513-9f58-6b92cc2c4474 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:01:16.922718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:16.922718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:16.922718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:16.922718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:16.922718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:16.922718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:16.922718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:16.922718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:16.922718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:16.922718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:16.922718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:16.922718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:01:16.922718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:01:16.922718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:01:16.922718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:01:16.923966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:16.923966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:16.923966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:16.923966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:16.923966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:16.923966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:16.923966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:16.923966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:16.923966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:16.923966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:16.923966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:16.923966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:16.923966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:16.923966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:16.923966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:16.923966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:16.923966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:01:16.924851 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:01:16.924851 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:01:16.924851 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:01:16.924851 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 15/36] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:16.926689 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540500a5-063d-404c-be30-d27dbaed58d9 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:16.926689 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540500a5-063d-404c-be30-d27dbaed58d9 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:16.926689 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540500a5-063d-404c-be30-d27dbaed58d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:16.948461 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-540500a5-063d-404c-be30-d27dbaed58d9 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:16.949648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-540500a5-063d-404c-be30-d27dbaed58d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:16.965380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:17.034273 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 22/37] 10.222.0.46 () {58 vars in 1361 bytes} [Wed Aug 10 13:01:16 2022] PUT /identity/v3/domains/default/users/1ade4cba44f6449e9916b370e369e98e/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:01:17.034273 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7ff1c-70d0-4b3c-bb1c-7b93924bc566 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:17.045134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 16/38] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:17.046042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540500a5-063d-404c-be30-d27dbaed58d9 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:17.154839 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7ff1c-70d0-4b3c-bb1c-7b93924bc566 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:17.175096 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540500a5-063d-404c-be30-d27dbaed58d9 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:17.200494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09337f-54d8-462b-9179-b6706d93a633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:17.201129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09337f-54d8-462b-9179-b6706d93a633 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:17.201416 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09337f-54d8-462b-9179-b6706d93a633 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:17.201811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09337f-54d8-462b-9179-b6706d93a633 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:17.202499 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09337f-54d8-462b-9179-b6706d93a633 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:17.204204 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09337f-54d8-462b-9179-b6706d93a633 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:17.214566 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0551c2-4e2d-438a-a5cb-cf17fc462646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:17.215176 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0551c2-4e2d-438a-a5cb-cf17fc462646 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:17.215459 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0551c2-4e2d-438a-a5cb-cf17fc462646 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:17.215733 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0551c2-4e2d-438a-a5cb-cf17fc462646 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:17.216390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0551c2-4e2d-438a-a5cb-cf17fc462646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:17.216695 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0551c2-4e2d-438a-a5cb-cf17fc462646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:17.218079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0551c2-4e2d-438a-a5cb-cf17fc462646 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:17.226016 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 23/39] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Aug 10 13:01:17 2022] POST /identity/v3/roles => generated 225 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:01:17.227508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ceafe-401a-4a65-8159-b8439107c534 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:17.227805 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ceafe-401a-4a65-8159-b8439107c534 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:17.228085 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ceafe-401a-4a65-8159-b8439107c534 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:17.230238 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 24/40] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:17.231458 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ceafe-401a-4a65-8159-b8439107c534 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:17.233210 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 17/41] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:17.236988 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b0fb5-51ba-4760-8328-04bdf30532bf None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:17.237642 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b0fb5-51ba-4760-8328-04bdf30532bf None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:17.238161 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b0fb5-51ba-4760-8328-04bdf30532bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:17.265431 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-f72b0fb5-51ba-4760-8328-04bdf30532bf None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:17.267139 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-f72b0fb5-51ba-4760-8328-04bdf30532bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:17.270925 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:17.329335 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:17.369714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 18/42] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:01:17.371473 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b0fb5-51ba-4760-8328-04bdf30532bf None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:17.400529 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ceafe-401a-4a65-8159-b8439107c534 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:17.438353 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6612037-8b67-43fc-9e65-422a3075f61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:17.439458 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6612037-8b67-43fc-9e65-422a3075f61f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:17.439932 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6612037-8b67-43fc-9e65-422a3075f61f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:17.440407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6612037-8b67-43fc-9e65-422a3075f61f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:17.441880 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6612037-8b67-43fc-9e65-422a3075f61f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:17.443611 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6612037-8b67-43fc-9e65-422a3075f61f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:17.446355 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 25/43] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:01:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:17.447885 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6612037-8b67-43fc-9e65-422a3075f61f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:17.494391 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b0fb5-51ba-4760-8328-04bdf30532bf None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:17.531020 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cbbc1-2987-4224-ae00-9a0dc6437c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:17.531677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cbbc1-2987-4224-ae00-9a0dc6437c42 None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:17.531960 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cbbc1-2987-4224-ae00-9a0dc6437c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:17.532237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cbbc1-2987-4224-ae00-9a0dc6437c42 None admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:17.533144 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cbbc1-2987-4224-ae00-9a0dc6437c42 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:17.534602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cbbc1-2987-4224-ae00-9a0dc6437c42 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:17.545961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:17.568141 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 19/44] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 10 13:01:17 2022] POST /identity/v3/projects => generated 301 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:01:17.569471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cbbc1-2987-4224-ae00-9a0dc6437c42 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:17.602644 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6612037-8b67-43fc-9e65-422a3075f61f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:17.647479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:17.670950 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68fb09-59f7-4a35-b70e-c265c0d56d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:17.671924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68fb09-59f7-4a35-b70e-c265c0d56d55 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:17.672684 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68fb09-59f7-4a35-b70e-c265c0d56d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:17.673117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68fb09-59f7-4a35-b70e-c265c0d56d55 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:17.674580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68fb09-59f7-4a35-b70e-c265c0d56d55 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:17.676532 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68fb09-59f7-4a35-b70e-c265c0d56d55 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:17.705646 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 26/45] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Aug 10 13:01:17 2022] POST /identity/v3/roles => generated 223 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:01:17.733250 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cbbc1-2987-4224-ae00-9a0dc6437c42 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:17.783130 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983a6c6-8d91-43f7-a866-dab42ad9925c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:17.783763 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983a6c6-8d91-43f7-a866-dab42ad9925c None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:17.784042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983a6c6-8d91-43f7-a866-dab42ad9925c None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:17.784312 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983a6c6-8d91-43f7-a866-dab42ad9925c None admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:17.785048 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983a6c6-8d91-43f7-a866-dab42ad9925c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:17.786620 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983a6c6-8d91-43f7-a866-dab42ad9925c None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:17.823589 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 20/46] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 10 13:01:17 2022] POST /identity/v3/projects => generated 312 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:01:19.169025 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2a422-a3f0-461b-8c11-46e7734eda8a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:19.169539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2a422-a3f0-461b-8c11-46e7734eda8a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:19.169707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2a422-a3f0-461b-8c11-46e7734eda8a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:19.171101 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 27/47] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:19.176610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a3608-8137-4c46-b939-4638d45fbe76 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:19.177108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a3608-8137-4c46-b939-4638d45fbe76 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:19.177195 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a3608-8137-4c46-b939-4638d45fbe76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:19.197218 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-a06a3608-8137-4c46-b939-4638d45fbe76 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:19.198441 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-a06a3608-8137-4c46-b939-4638d45fbe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:19.236687 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:19.272599 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 21/48] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:19.296151 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2a422-a3f0-461b-8c11-46e7734eda8a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:19.410631 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2a422-a3f0-461b-8c11-46e7734eda8a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:19.444024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd852c-77df-4378-8ca2-0318e79cda68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:19.444645 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd852c-77df-4378-8ca2-0318e79cda68 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:19.444924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd852c-77df-4378-8ca2-0318e79cda68 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:19.445792 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd852c-77df-4378-8ca2-0318e79cda68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:19.456537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd852c-77df-4378-8ca2-0318e79cda68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:19.461365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-0cdd852c-77df-4378-8ca2-0318e79cda68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:01:19.461365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:19.461365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:19.461365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:19.461365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:19.461365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:19.461365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:19.461365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:19.461365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:19.461365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:19.461365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:19.461365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:19.461365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:19.461365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:19.461365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:19.461365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:19.462250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:19.462250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:19.462250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:19.462250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:19.462250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:19.462250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:19.462250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:19.462250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:19.462250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:19.462250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:19.462250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:19.462250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:19.462250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:19.462250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:19.462250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:19.462250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:19.463312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:19.463312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:19.463312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:19.463312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:19.463312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:19.463312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:19.463312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:19.463312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:19.463312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:19.463312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:19.463312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:01:19.463312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:01:19.463312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 28/49] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:01:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:19.468473 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a3608-8137-4c46-b939-4638d45fbe76 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:19.569760 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a3608-8137-4c46-b939-4638d45fbe76 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:19.605135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f694d5-7cc1-446d-a9ef-b6f53b6db2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:19.605749 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f694d5-7cc1-446d-a9ef-b6f53b6db2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:19.606031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f694d5-7cc1-446d-a9ef-b6f53b6db2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:19.606301 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f694d5-7cc1-446d-a9ef-b6f53b6db2b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:19.606971 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f694d5-7cc1-446d-a9ef-b6f53b6db2b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:19.607304 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f694d5-7cc1-446d-a9ef-b6f53b6db2b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:19.608682 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f694d5-7cc1-446d-a9ef-b6f53b6db2b2 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:19.621231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 22/50] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:19.628554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd852c-77df-4378-8ca2-0318e79cda68 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:19.675617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:19.737255 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd852c-77df-4378-8ca2-0318e79cda68 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:19.771109 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865e47b-71ff-430e-8b04-66503b097739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:19.771753 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865e47b-71ff-430e-8b04-66503b097739 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:19.772030 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865e47b-71ff-430e-8b04-66503b097739 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:19.772303 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865e47b-71ff-430e-8b04-66503b097739 None admin] PATH_INFO: `/v3/users/1ade4cba44f6449e9916b370e369e98e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:19.773498 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865e47b-71ff-430e-8b04-66503b097739 None admin] RBAC: Authorizing `identity:get_user(user_id=1ade4cba44f6449e9916b370e369e98e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:19.774952 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865e47b-71ff-430e-8b04-66503b097739 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:19.776567 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 29/51] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:19 2022] GET /identity/v3/users/1ade4cba44f6449e9916b370e369e98e => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:19.782013 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f694d5-7cc1-446d-a9ef-b6f53b6db2b2 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:19.816585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:19.880284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c751cb7-d8ca-4e40-ae18-851412165d5d None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:19.880583 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c751cb7-d8ca-4e40-ae18-851412165d5d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:19.880790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c751cb7-d8ca-4e40-ae18-851412165d5d None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:19.882235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 30/52] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:19.888417 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3634e-e6d3-4b29-9820-0e50c051988e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:19.888699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3634e-e6d3-4b29-9820-0e50c051988e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:19.888979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3634e-e6d3-4b29-9820-0e50c051988e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:19.889992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f694d5-7cc1-446d-a9ef-b6f53b6db2b2 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:19.907352 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-cea3634e-e6d3-4b29-9820-0e50c051988e None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:19.908902 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cea3634e-e6d3-4b29-9820-0e50c051988e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:19.925054 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0362ae6-a706-4dac-8ba5-e9777ff635cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:19.925719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0362ae6-a706-4dac-8ba5-e9777ff635cd None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:19.925999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0362ae6-a706-4dac-8ba5-e9777ff635cd None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:19.926273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0362ae6-a706-4dac-8ba5-e9777ff635cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:19.927426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0362ae6-a706-4dac-8ba5-e9777ff635cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:19.928876 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0362ae6-a706-4dac-8ba5-e9777ff635cd None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:19.930460 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 23/53] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:01:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:19.936459 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0362ae6-a706-4dac-8ba5-e9777ff635cd None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:19.980766 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 31/54] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:01:20.003833 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3634e-e6d3-4b29-9820-0e50c051988e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:20.041000 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0362ae6-a706-4dac-8ba5-e9777ff635cd None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:20.042705 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:20.043594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:20.076067 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2352da-bc64-46b4-a919-71497f350882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:20.076672 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2352da-bc64-46b4-a919-71497f350882 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:20.076978 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2352da-bc64-46b4-a919-71497f350882 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:20.077252 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2352da-bc64-46b4-a919-71497f350882 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:20.077973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2352da-bc64-46b4-a919-71497f350882 None admin] RBAC: Adding query filter params (role.id=d9c9200468cb4f7ab6a23882bfb1f062, scope.domain.id=default, user.id=1ade4cba44f6449e9916b370e369e98e) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:20.078278 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2352da-bc64-46b4-a919-71497f350882 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:20.079757 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2352da-bc64-46b4-a919-71497f350882 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:20.089543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 24/55] 10.222.0.46 () {56 vars in 1322 bytes} [Wed Aug 10 13:01:19 2022] GET /identity/v3/role_assignments?user.id=1ade4cba44f6449e9916b370e369e98e&scope.domain.id=default&role.id=d9c9200468cb4f7ab6a23882bfb1f062 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:01:20.105722 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3634e-e6d3-4b29-9820-0e50c051988e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:20.144040 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66a225-9a42-49fc-8945-0b9f1b16050d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:20.144604 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66a225-9a42-49fc-8945-0b9f1b16050d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:20.144884 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66a225-9a42-49fc-8945-0b9f1b16050d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:20.145154 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66a225-9a42-49fc-8945-0b9f1b16050d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:20.146384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66a225-9a42-49fc-8945-0b9f1b16050d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:20.147908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66a225-9a42-49fc-8945-0b9f1b16050d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:20.149668 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 32/56] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:01:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:01:20.155699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2352da-bc64-46b4-a919-71497f350882 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:20.262168 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2352da-bc64-46b4-a919-71497f350882 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:20.296242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410a87c-99ea-46f5-8395-c5b607b68655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:20.296856 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410a87c-99ea-46f5-8395-c5b607b68655 None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:20.297139 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410a87c-99ea-46f5-8395-c5b607b68655 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:20.297413 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410a87c-99ea-46f5-8395-c5b607b68655 None admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:20.298074 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410a87c-99ea-46f5-8395-c5b607b68655 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:20.299562 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410a87c-99ea-46f5-8395-c5b607b68655 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:20.327493 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 25/57] 10.222.0.46 () {60 vars in 1140 bytes} [Wed Aug 10 13:01:20 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:01:22.348858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e52c5c-1c84-4e27-9b86-a7b198a33772 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:22.349396 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e52c5c-1c84-4e27-9b86-a7b198a33772 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:22.349396 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e52c5c-1c84-4e27-9b86-a7b198a33772 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:22.350811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 33/58] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:22.356734 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dabd2e-e5f3-4607-a1bb-8e892556ee04 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:22.357264 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dabd2e-e5f3-4607-a1bb-8e892556ee04 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:22.357347 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dabd2e-e5f3-4607-a1bb-8e892556ee04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:22.377767 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-b7dabd2e-e5f3-4607-a1bb-8e892556ee04 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:22.379708 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-b7dabd2e-e5f3-4607-a1bb-8e892556ee04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:22.397487 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:22.454717 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 26/59] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:22.479184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e52c5c-1c84-4e27-9b86-a7b198a33772 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:22.580312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e52c5c-1c84-4e27-9b86-a7b198a33772 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:22.588551 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:22.617971 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ec5de-ac27-456a-bc6a-bc30b2c62cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:22.618518 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ec5de-ac27-456a-bc6a-bc30b2c62cfc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:22.618802 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ec5de-ac27-456a-bc6a-bc30b2c62cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:22.619118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ec5de-ac27-456a-bc6a-bc30b2c62cfc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:22.620230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ec5de-ac27-456a-bc6a-bc30b2c62cfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:22.621673 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ec5de-ac27-456a-bc6a-bc30b2c62cfc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:22.623264 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 34/60] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:01:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:22.628888 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dabd2e-e5f3-4607-a1bb-8e892556ee04 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:22.735250 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dabd2e-e5f3-4607-a1bb-8e892556ee04 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:22.767892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b828c-f4c4-480b-b041-e4f5d339e0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:22.768500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b828c-f4c4-480b-b041-e4f5d339e0c8 None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:22.768778 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b828c-f4c4-480b-b041-e4f5d339e0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:22.769048 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b828c-f4c4-480b-b041-e4f5d339e0c8 None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:22.769692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b828c-f4c4-480b-b041-e4f5d339e0c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:22.771148 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b828c-f4c4-480b-b041-e4f5d339e0c8 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:22.797322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 27/61] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 10 13:01:22 2022] POST /identity/v3/users => generated 275 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:01:26.065154 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd5f6d-9329-4097-99a4-fb1ce4806e47 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:26.065697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd5f6d-9329-4097-99a4-fb1ce4806e47 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:26.065697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd5f6d-9329-4097-99a4-fb1ce4806e47 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:26.067507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 35/62] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:26.072800 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566e36f-15df-4162-9ac4-5822bf2abb07 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:26.073232 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566e36f-15df-4162-9ac4-5822bf2abb07 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:26.073360 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566e36f-15df-4162-9ac4-5822bf2abb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:26.087624 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:26.102881 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-8566e36f-15df-4162-9ac4-5822bf2abb07 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:26.104376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-8566e36f-15df-4162-9ac4-5822bf2abb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:26.191751 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 28/63] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:26.200595 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77df0e-7467-4396-b39a-202d1ac2d249 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:26.201203 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77df0e-7467-4396-b39a-202d1ac2d249 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:26.201684 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77df0e-7467-4396-b39a-202d1ac2d249 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:26.203271 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 36/64] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:26.215784 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566e36f-15df-4162-9ac4-5822bf2abb07 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:26.216380 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bb062-e3a2-4981-ad7b-670690c429aa None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:26.216666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bb062-e3a2-4981-ad7b-670690c429aa None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:26.216946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bb062-e3a2-4981-ad7b-670690c429aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:26.253767 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-513bb062-e3a2-4981-ad7b-670690c429aa None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:26.255451 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-513bb062-e3a2-4981-ad7b-670690c429aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:26.323475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566e36f-15df-4162-9ac4-5822bf2abb07 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:26.358216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 37/65] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:01:26.381165 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bb062-e3a2-4981-ad7b-670690c429aa None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:26.432317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666d8c2-78d4-4bff-9c32-7879a7d6fdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:26.432966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666d8c2-78d4-4bff-9c32-7879a7d6fdf6 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:26.433244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666d8c2-78d4-4bff-9c32-7879a7d6fdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:26.433512 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666d8c2-78d4-4bff-9c32-7879a7d6fdf6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:26.440969 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:26.472036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5666d8c2-78d4-4bff-9c32-7879a7d6fdf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:26.477747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-5666d8c2-78d4-4bff-9c32-7879a7d6fdf6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:26.477747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:26.477747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:26.477747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:26.477747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:26.477747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:26.477747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:26.477747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:26.477747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:26.477747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:26.477747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:26.477747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:26.477747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:26.477747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:26.477747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:26.477747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:26.478801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:26.478801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:26.478801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:26.478801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:26.478801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:26.478801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:26.478801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:26.478801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:26.478801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:26.478801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:26.478801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:26.478801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:26.478801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:26.478801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:26.478801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:26.478801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:26.479700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:26.479700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:26.479700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:26.479700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:26.479700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:26.479700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:26.479700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:26.479700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:26.479700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:26.479700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:26.479700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:26.479700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:01:26.479700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 29/66] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:26.488506 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666d8c2-78d4-4bff-9c32-7879a7d6fdf6 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:26.499466 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bb062-e3a2-4981-ad7b-670690c429aa None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:26.511436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:26.543896 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dd71d-4363-496b-a139-01d866a8032e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:26.545155 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dd71d-4363-496b-a139-01d866a8032e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:26.545892 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dd71d-4363-496b-a139-01d866a8032e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:26.546812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dd71d-4363-496b-a139-01d866a8032e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:26.562936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51dd71d-4363-496b-a139-01d866a8032e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:26.570908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b51dd71d-4363-496b-a139-01d866a8032e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:01:26.570908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:26.570908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:26.570908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:26.570908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:26.570908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:26.570908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:26.570908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:26.570908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:26.570908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:26.570908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:26.570908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:26.570908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:26.570908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:26.570908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:26.570908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:26.571943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:26.571943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:26.571943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:26.571943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:26.571943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:26.571943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:26.571943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:26.571943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:26.571943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:26.571943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:26.571943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:26.571943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:26.571943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:26.571943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:26.571943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:26.571943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:26.572727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:26.572727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:26.572727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:26.572727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:26.572727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:26.572727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:26.572727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:26.572727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:26.572727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:26.572727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:26.572727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:01:26.572727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:01:26.575928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 38/67] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:01:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:01:26.578143 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f7ac9-a961-4eb8-bb3b-3b4c3e0376f9 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:26.578798 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f7ac9-a961-4eb8-bb3b-3b4c3e0376f9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:26.579374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f7ac9-a961-4eb8-bb3b-3b4c3e0376f9 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:26.581520 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 39/68] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:26.588628 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29ab5b-4deb-4d48-9418-5b464ee4f6bd None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:26.589780 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29ab5b-4deb-4d48-9418-5b464ee4f6bd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:26.589780 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29ab5b-4deb-4d48-9418-5b464ee4f6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:26.609080 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fe29ab5b-4deb-4d48-9418-5b464ee4f6bd None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:26.610370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fe29ab5b-4deb-4d48-9418-5b464ee4f6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:26.631398 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666d8c2-78d4-4bff-9c32-7879a7d6fdf6 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:26.670696 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ca469-26ad-4607-bce0-c84c3457081a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:26.671711 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ca469-26ad-4607-bce0-c84c3457081a None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:26.672125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ca469-26ad-4607-bce0-c84c3457081a None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:26.672528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ca469-26ad-4607-bce0-c84c3457081a None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:26.673660 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ca469-26ad-4607-bce0-c84c3457081a None admin] RBAC: Adding query filter params (name=member) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:26.674110 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ca469-26ad-4607-bce0-c84c3457081a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:26.675939 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ca469-26ad-4607-bce0-c84c3457081a None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:26.687522 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 30/69] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:01:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:01:26.689837 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 40/70] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:26.693930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ca469-26ad-4607-bce0-c84c3457081a None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:26.695633 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8576b27-d174-43f2-a24e-de1dd7433cfa None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:26.696463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8576b27-d174-43f2-a24e-de1dd7433cfa None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:26.697162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8576b27-d174-43f2-a24e-de1dd7433cfa None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:26.704941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 41/71] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:26.704941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8576b27-d174-43f2-a24e-de1dd7433cfa None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:26.758631 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:26.803207 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:26.805444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ca469-26ad-4607-bce0-c84c3457081a None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:26.811791 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8576b27-d174-43f2-a24e-de1dd7433cfa None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:26.839637 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affe725-3ae5-4260-bdd5-08f32b47276a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:26.840256 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affe725-3ae5-4260-bdd5-08f32b47276a None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:26.840577 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affe725-3ae5-4260-bdd5-08f32b47276a None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:26.840888 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affe725-3ae5-4260-bdd5-08f32b47276a None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:26.841453 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affe725-3ae5-4260-bdd5-08f32b47276a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:26.841787 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affe725-3ae5-4260-bdd5-08f32b47276a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:26.843219 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affe725-3ae5-4260-bdd5-08f32b47276a None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:26.845549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef571ef-07f7-456f-bd64-afc68b5448fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:26.846187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef571ef-07f7-456f-bd64-afc68b5448fe None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:26.846470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef571ef-07f7-456f-bd64-afc68b5448fe None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:26.846749 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef571ef-07f7-456f-bd64-afc68b5448fe None admin] PATH_INFO: `/v3/users/3e999bbc5d4a4abe863d44cfcf3acf0d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:26.853128 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 31/72] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:26.855097 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26687e-43dd-4b1f-a414-71b19087d33d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:26.855397 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26687e-43dd-4b1f-a414-71b19087d33d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:26.855680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26687e-43dd-4b1f-a414-71b19087d33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:26.861651 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef571ef-07f7-456f-bd64-afc68b5448fe None admin] RBAC: Authorizing `identity:get_user(user_id=3e999bbc5d4a4abe863d44cfcf3acf0d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:26.863702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef571ef-07f7-456f-bd64-afc68b5448fe None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:26.865730 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 42/73] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:26 2022] GET /identity/v3/users/3e999bbc5d4a4abe863d44cfcf3acf0d => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:26.866568 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef571ef-07f7-456f-bd64-afc68b5448fe None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:26.877500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-4e26687e-43dd-4b1f-a414-71b19087d33d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:26.878732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-4e26687e-43dd-4b1f-a414-71b19087d33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:26.947706 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 32/74] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:26.948966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ada3a8-7ce0-4214-85b7-b0aa6277319a None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:26.949243 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ada3a8-7ce0-4214-85b7-b0aa6277319a None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:26.949513 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ada3a8-7ce0-4214-85b7-b0aa6277319a None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:26.950739 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 33/75] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:26.951447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ada3a8-7ce0-4214-85b7-b0aa6277319a None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:26.975479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef571ef-07f7-456f-bd64-afc68b5448fe None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:27.013661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508972e0-9b66-4705-8616-f422f05cd13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:27.014286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508972e0-9b66-4705-8616-f422f05cd13a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:27.014568 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508972e0-9b66-4705-8616-f422f05cd13a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:27.014843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508972e0-9b66-4705-8616-f422f05cd13a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:27.025685 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508972e0-9b66-4705-8616-f422f05cd13a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:27.026503 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:27.030559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-508972e0-9b66-4705-8616-f422f05cd13a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:01:27.030559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:27.030559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:27.030559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:27.030559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:27.030559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:27.030559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:27.030559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:27.030559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:27.030559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:27.030559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:27.030559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:27.030559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:27.030559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:27.030559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:27.030559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:27.031626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:27.031626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:27.031626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:27.031626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:27.031626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:27.031626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:27.031626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:27.031626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:27.031626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:27.031626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:27.031626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:27.031626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:27.031626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:27.031626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:27.031626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:27.031626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:27.037625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:27.037625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:27.037625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:27.037625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:27.037625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:27.037625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:27.037625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:27.037625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:27.037625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:27.037625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:27.037625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:01:27.037625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:01:27.037625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 43/76] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 10 13:01:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:27.037625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508972e0-9b66-4705-8616-f422f05cd13a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:27.052324 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:27.083422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ada3a8-7ce0-4214-85b7-b0aa6277319a None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:27.119384 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2847962-ab8b-4820-9ca7-605b077cb952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:27.120013 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2847962-ab8b-4820-9ca7-605b077cb952 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:27.120290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2847962-ab8b-4820-9ca7-605b077cb952 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:27.120561 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2847962-ab8b-4820-9ca7-605b077cb952 None admin] PATH_INFO: `/v3/users/1ade4cba44f6449e9916b370e369e98e` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:27.121916 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2847962-ab8b-4820-9ca7-605b077cb952 None admin] RBAC: Authorizing `identity:get_user(user_id=1ade4cba44f6449e9916b370e369e98e)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:27.123370 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2847962-ab8b-4820-9ca7-605b077cb952 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:27.125175 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 34/77] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:26 2022] GET /identity/v3/users/1ade4cba44f6449e9916b370e369e98e => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:27.126113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989fd34-d54a-4163-8007-e46693aea4ab None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:27.126392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989fd34-d54a-4163-8007-e46693aea4ab None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:27.126656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989fd34-d54a-4163-8007-e46693aea4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:27.144115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-4989fd34-d54a-4163-8007-e46693aea4ab None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:27.145332 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-4989fd34-d54a-4163-8007-e46693aea4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:27.151323 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508972e0-9b66-4705-8616-f422f05cd13a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:27.186007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c1124-2ae8-4143-b32a-5f35537a5fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:27.186618 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c1124-2ae8-4143-b32a-5f35537a5fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:27.186899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c1124-2ae8-4143-b32a-5f35537a5fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:27.187310 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c1124-2ae8-4143-b32a-5f35537a5fe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:27.213267 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 35/78] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:27.214212 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989fd34-d54a-4163-8007-e46693aea4ab None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:27.261013 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:27.276982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c1124-2ae8-4143-b32a-5f35537a5fe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:27.278486 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c1124-2ae8-4143-b32a-5f35537a5fe8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:27.293578 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:27.322436 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989fd34-d54a-4163-8007-e46693aea4ab None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:27.357416 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36f88f-708b-4063-9969-41c882f9f770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:27.357970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36f88f-708b-4063-9969-41c882f9f770 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:27.358251 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36f88f-708b-4063-9969-41c882f9f770 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:27.358525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36f88f-708b-4063-9969-41c882f9f770 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:27.368749 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36f88f-708b-4063-9969-41c882f9f770 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:27.373546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-5e36f88f-708b-4063-9969-41c882f9f770 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:27.373546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:27.373546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:27.373546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:27.373546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:27.373546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:27.373546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:27.373546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:27.373546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:27.373546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:27.373546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:27.373546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:27.373546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:27.373546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:27.373546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:27.373546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:27.374611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:27.374611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:27.374611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:27.374611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:27.374611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:27.374611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:27.374611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:27.374611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:27.374611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:27.374611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:27.374611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:27.374611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:27.374611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:27.374611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:27.374611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:27.374611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:27.375422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:27.375422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:27.375422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:27.375422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:27.375422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:27.375422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:27.375422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:27.375422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:27.375422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:27.375422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:27.375422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:27.375422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:01:27.375422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 36/79] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:27.376080 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36f88f-708b-4063-9969-41c882f9f770 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:27.382024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 44/80] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:01:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:27.383438 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c1124-2ae8-4143-b32a-5f35537a5fe8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:27.477874 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36f88f-708b-4063-9969-41c882f9f770 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:27.481876 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c1124-2ae8-4143-b32a-5f35537a5fe8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:27.485203 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:27.495631 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:27.514165 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917e610-bf6c-4a16-9f09-2fd6a7ff45e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:27.514775 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917e610-bf6c-4a16-9f09-2fd6a7ff45e0 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:27.515082 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917e610-bf6c-4a16-9f09-2fd6a7ff45e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:27.515361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917e610-bf6c-4a16-9f09-2fd6a7ff45e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:27.516024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917e610-bf6c-4a16-9f09-2fd6a7ff45e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:27.516327 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917e610-bf6c-4a16-9f09-2fd6a7ff45e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:27.516657 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee6acd-e99f-4048-859b-f02df4e0111e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:27.517269 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee6acd-e99f-4048-859b-f02df4e0111e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:27.517574 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee6acd-e99f-4048-859b-f02df4e0111e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:27.517717 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917e610-bf6c-4a16-9f09-2fd6a7ff45e0 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:27.517812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee6acd-e99f-4048-859b-f02df4e0111e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:27.525834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 37/81] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:01:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:27.526680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917e610-bf6c-4a16-9f09-2fd6a7ff45e0 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:27.586510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee6acd-e99f-4048-859b-f02df4e0111e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:27.588019 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee6acd-e99f-4048-859b-f02df4e0111e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:27.632923 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917e610-bf6c-4a16-9f09-2fd6a7ff45e0 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:27.672333 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af229ea9-cba0-4d38-887e-9a748bce454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:27.672996 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af229ea9-cba0-4d38-887e-9a748bce454b None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:27.673275 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af229ea9-cba0-4d38-887e-9a748bce454b None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:27.673543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af229ea9-cba0-4d38-887e-9a748bce454b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:27.674689 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af229ea9-cba0-4d38-887e-9a748bce454b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:27.676162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af229ea9-cba0-4d38-887e-9a748bce454b None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:27.677762 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 38/82] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:01:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:27.679046 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af229ea9-cba0-4d38-887e-9a748bce454b None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:27.689198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 45/83] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:01:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:27.690387 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee6acd-e99f-4048-859b-f02df4e0111e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:27.712503 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:27.733272 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:27.808799 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af229ea9-cba0-4d38-887e-9a748bce454b None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:27.816704 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee6acd-e99f-4048-859b-f02df4e0111e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:27.842109 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b5822-5f8d-4dcb-bc34-6e2d94538f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:27.842746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b5822-5f8d-4dcb-bc34-6e2d94538f94 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:27.843040 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b5822-5f8d-4dcb-bc34-6e2d94538f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:27.843313 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b5822-5f8d-4dcb-bc34-6e2d94538f94 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:27.843969 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b5822-5f8d-4dcb-bc34-6e2d94538f94 None admin] RBAC: Adding query filter params (name=member) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:27.844532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b5822-5f8d-4dcb-bc34-6e2d94538f94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:27.845898 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b5822-5f8d-4dcb-bc34-6e2d94538f94 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:27.852978 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d428e3-9c26-4807-b13d-9ad7cf842940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:27.853594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d428e3-9c26-4807-b13d-9ad7cf842940 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:27.853871 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d428e3-9c26-4807-b13d-9ad7cf842940 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:27.854139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d428e3-9c26-4807-b13d-9ad7cf842940 None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:27.854685 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 39/84] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:01:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:27.855300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b5822-5f8d-4dcb-bc34-6e2d94538f94 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:27.859661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d428e3-9c26-4807-b13d-9ad7cf842940 None admin] RBAC: Authorizing `identity:get_project(project_id=66166393e3e0490ea30d39e178525784)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:27.861145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d428e3-9c26-4807-b13d-9ad7cf842940 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:27.862961 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 46/85] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:27 2022] GET /identity/v3/projects/66166393e3e0490ea30d39e178525784 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:27.863661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d428e3-9c26-4807-b13d-9ad7cf842940 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:27.942565 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:27.954344 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:27.957861 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b5822-5f8d-4dcb-bc34-6e2d94538f94 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:27.963128 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d428e3-9c26-4807-b13d-9ad7cf842940 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:27.993787 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b476599-c0fb-46f4-afed-35a980be8478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:27.994424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b476599-c0fb-46f4-afed-35a980be8478 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:27.994711 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b476599-c0fb-46f4-afed-35a980be8478 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:27.994987 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b476599-c0fb-46f4-afed-35a980be8478 None admin] PATH_INFO: `/v3/users/3e999bbc5d4a4abe863d44cfcf3acf0d` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:27.996177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b476599-c0fb-46f4-afed-35a980be8478 None admin] RBAC: Authorizing `identity:get_user(user_id=3e999bbc5d4a4abe863d44cfcf3acf0d)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:27.997616 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b476599-c0fb-46f4-afed-35a980be8478 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:27.999236 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 40/86] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:27 2022] GET /identity/v3/users/3e999bbc5d4a4abe863d44cfcf3acf0d => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:28.002356 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b476599-c0fb-46f4-afed-35a980be8478 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:28.004326 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9fd9d-de72-4831-9598-07c4a36cf60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:28.004944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9fd9d-de72-4831-9598-07c4a36cf60e None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:28.005219 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9fd9d-de72-4831-9598-07c4a36cf60e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:28.005489 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9fd9d-de72-4831-9598-07c4a36cf60e None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:28.006140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9fd9d-de72-4831-9598-07c4a36cf60e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:28.008117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9fd9d-de72-4831-9598-07c4a36cf60e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:28.035658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 47/87] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 10 13:01:27 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:01:28.036744 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9fd9d-de72-4831-9598-07c4a36cf60e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:28.110464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b476599-c0fb-46f4-afed-35a980be8478 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:28.153523 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440db2ab-cd76-4965-8727-e7f8b42fb880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:28.154178 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440db2ab-cd76-4965-8727-e7f8b42fb880 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:28.154463 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440db2ab-cd76-4965-8727-e7f8b42fb880 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:28.154743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440db2ab-cd76-4965-8727-e7f8b42fb880 None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:28.155978 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440db2ab-cd76-4965-8727-e7f8b42fb880 None admin] RBAC: Authorizing `identity:get_project(project_id=66166393e3e0490ea30d39e178525784)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:28.157508 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440db2ab-cd76-4965-8727-e7f8b42fb880 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:28.159296 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 41/88] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:27 2022] GET /identity/v3/projects/66166393e3e0490ea30d39e178525784 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:28.160204 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440db2ab-cd76-4965-8727-e7f8b42fb880 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:28.177303 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9fd9d-de72-4831-9598-07c4a36cf60e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:28.198052 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:28.225067 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4066b5-2845-464b-9988-c35c85c9a8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:28.225806 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4066b5-2845-464b-9988-c35c85c9a8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:28.226662 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4066b5-2845-464b-9988-c35c85c9a8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:28.226939 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4066b5-2845-464b-9988-c35c85c9a8f7 None admin] PATH_INFO: `/v3/users/3e999bbc5d4a4abe863d44cfcf3acf0d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:28.228691 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4066b5-2845-464b-9988-c35c85c9a8f7 None admin] RBAC: Authorizing `identity:get_user(user_id=3e999bbc5d4a4abe863d44cfcf3acf0d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:28.230153 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4066b5-2845-464b-9988-c35c85c9a8f7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:28.232972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 48/89] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:28 2022] GET /identity/v3/users/3e999bbc5d4a4abe863d44cfcf3acf0d => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:28.233790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4066b5-2845-464b-9988-c35c85c9a8f7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:28.237499 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:28.286452 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440db2ab-cd76-4965-8727-e7f8b42fb880 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:28.330178 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc489a36-4757-4b64-a100-ab8fbd70eaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:28.330807 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc489a36-4757-4b64-a100-ab8fbd70eaee None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:28.331252 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc489a36-4757-4b64-a100-ab8fbd70eaee None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:28.331529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc489a36-4757-4b64-a100-ab8fbd70eaee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:28.332265 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc489a36-4757-4b64-a100-ab8fbd70eaee None admin] RBAC: Adding query filter params (role.id=2223c0caa0c948abbe85384d16a465a2, scope.project.id=66166393e3e0490ea30d39e178525784, user.id=3e999bbc5d4a4abe863d44cfcf3acf0d) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:28.332579 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc489a36-4757-4b64-a100-ab8fbd70eaee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:28.334044 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc489a36-4757-4b64-a100-ab8fbd70eaee None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:28.341330 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 42/90] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:01:28 2022] GET /identity/v3/role_assignments?user.id=3e999bbc5d4a4abe863d44cfcf3acf0d&scope.project.id=66166393e3e0490ea30d39e178525784&role.id=2223c0caa0c948abbe85384d16a465a2 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:28.341694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc489a36-4757-4b64-a100-ab8fbd70eaee None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:28.376156 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4066b5-2845-464b-9988-c35c85c9a8f7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:28.419573 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02778b8-dd39-4d38-95f2-23f7af9e3cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:28.420401 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02778b8-dd39-4d38-95f2-23f7af9e3cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:28.420750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02778b8-dd39-4d38-95f2-23f7af9e3cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:28.421096 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02778b8-dd39-4d38-95f2-23f7af9e3cb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:28.527144 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc489a36-4757-4b64-a100-ab8fbd70eaee None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:28.535396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:28.537980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02778b8-dd39-4d38-95f2-23f7af9e3cb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:28.539637 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02778b8-dd39-4d38-95f2-23f7af9e3cb3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:28.542924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:28.567295 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c0360-d5e2-4a7a-b3cc-2deda1786362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:28.568018 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c0360-d5e2-4a7a-b3cc-2deda1786362 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:28.569198 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c0360-d5e2-4a7a-b3cc-2deda1786362 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:28.569198 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c0360-d5e2-4a7a-b3cc-2deda1786362 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:28.569502 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c0360-d5e2-4a7a-b3cc-2deda1786362 None admin] RBAC: Adding query filter params (role.id=d9c9200468cb4f7ab6a23882bfb1f062, scope.project.id=66166393e3e0490ea30d39e178525784, user.id=1ade4cba44f6449e9916b370e369e98e) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:28.570448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c0360-d5e2-4a7a-b3cc-2deda1786362 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:28.572191 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c0360-d5e2-4a7a-b3cc-2deda1786362 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:28.578402 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 43/91] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:01:28 2022] GET /identity/v3/role_assignments?user.id=1ade4cba44f6449e9916b370e369e98e&scope.project.id=66166393e3e0490ea30d39e178525784&role.id=d9c9200468cb4f7ab6a23882bfb1f062 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:28.583191 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c0360-d5e2-4a7a-b3cc-2deda1786362 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:28.706800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 49/92] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:01:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:28.712695 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02778b8-dd39-4d38-95f2-23f7af9e3cb3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:28.758954 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c0360-d5e2-4a7a-b3cc-2deda1786362 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:28.831909 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ddfe7-fe87-4adf-9652-f2eb6a14b53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:28.832466 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ddfe7-fe87-4adf-9652-f2eb6a14b53a None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:28.832747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ddfe7-fe87-4adf-9652-f2eb6a14b53a None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:28.833021 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ddfe7-fe87-4adf-9652-f2eb6a14b53a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:28.895460 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:28.913281 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02778b8-dd39-4d38-95f2-23f7af9e3cb3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:28.917584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:28.980635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ddfe7-fe87-4adf-9652-f2eb6a14b53a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:28.980824 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc70b4-e987-45f6-a28c-e6f61e83bb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:28.984477 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc70b4-e987-45f6-a28c-e6f61e83bb14 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:28.984477 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc70b4-e987-45f6-a28c-e6f61e83bb14 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:28.984477 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc70b4-e987-45f6-a28c-e6f61e83bb14 None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:28.984751 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ddfe7-fe87-4adf-9652-f2eb6a14b53a None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:28.988366 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc70b4-e987-45f6-a28c-e6f61e83bb14 None admin] RBAC: Authorizing `identity:get_project(project_id=66166393e3e0490ea30d39e178525784)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:28.989367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc70b4-e987-45f6-a28c-e6f61e83bb14 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:28.993951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 50/93] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:28 2022] GET /identity/v3/projects/66166393e3e0490ea30d39e178525784 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:01:28.998860 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc70b4-e987-45f6-a28c-e6f61e83bb14 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:29.165618 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 44/94] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:01:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:29.176067 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ddfe7-fe87-4adf-9652-f2eb6a14b53a None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:29.200535 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc70b4-e987-45f6-a28c-e6f61e83bb14 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:29.279425 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:29.282666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4b9e5-b2fe-4ed2-a1c7-ece735255947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:29.283317 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4b9e5-b2fe-4ed2-a1c7-ece735255947 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:29.283596 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4b9e5-b2fe-4ed2-a1c7-ece735255947 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:29.283875 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4b9e5-b2fe-4ed2-a1c7-ece735255947 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:29.285075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4b9e5-b2fe-4ed2-a1c7-ece735255947 None admin] RBAC: Adding query filter params (role.id=0a020d67ea4d4d62b1305fd0cd952779, scope.project.id=66166393e3e0490ea30d39e178525784, user.id=3e999bbc5d4a4abe863d44cfcf3acf0d) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:29.285075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4b9e5-b2fe-4ed2-a1c7-ece735255947 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:29.286647 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4b9e5-b2fe-4ed2-a1c7-ece735255947 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:29.306002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 51/95] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:01:28 2022] GET /identity/v3/role_assignments?user.id=3e999bbc5d4a4abe863d44cfcf3acf0d&scope.project.id=66166393e3e0490ea30d39e178525784&role.id=0a020d67ea4d4d62b1305fd0cd952779 => generated 259 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:29.340280 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ddfe7-fe87-4adf-9652-f2eb6a14b53a None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:29.390681 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b9692-4a39-4c17-a9cf-f69b1fede895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:29.391676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b9692-4a39-4c17-a9cf-f69b1fede895 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:29.392133 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b9692-4a39-4c17-a9cf-f69b1fede895 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:29.392608 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b9692-4a39-4c17-a9cf-f69b1fede895 None admin] PATH_INFO: `/v3/projects/d8c9d9f0198e42e3b6f246fbc1d41e7c` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:29.393962 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b9692-4a39-4c17-a9cf-f69b1fede895 None admin] RBAC: Authorizing `identity:get_project(project_id=d8c9d9f0198e42e3b6f246fbc1d41e7c)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:29.395608 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b9692-4a39-4c17-a9cf-f69b1fede895 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:29.397437 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 45/96] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:29 2022] GET /identity/v3/projects/d8c9d9f0198e42e3b6f246fbc1d41e7c => generated 312 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:29.407047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4b9e5-b2fe-4ed2-a1c7-ece735255947 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:29.447529 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:29.531619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4b9e5-b2fe-4ed2-a1c7-ece735255947 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:29.580293 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97657ac7-1446-4952-915b-fc50b5a7c491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:29.581088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97657ac7-1446-4952-915b-fc50b5a7c491 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:29.581369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97657ac7-1446-4952-915b-fc50b5a7c491 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:29.581644 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97657ac7-1446-4952-915b-fc50b5a7c491 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:29.582372 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97657ac7-1446-4952-915b-fc50b5a7c491 None admin] RBAC: Adding query filter params (role.id=2223c0caa0c948abbe85384d16a465a2, scope.project.id=d8c9d9f0198e42e3b6f246fbc1d41e7c, user.id=3e999bbc5d4a4abe863d44cfcf3acf0d) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:29.582684 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97657ac7-1446-4952-915b-fc50b5a7c491 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:29.584152 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97657ac7-1446-4952-915b-fc50b5a7c491 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:29.594777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 52/97] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:01:29 2022] GET /identity/v3/role_assignments?user.id=3e999bbc5d4a4abe863d44cfcf3acf0d&scope.project.id=d8c9d9f0198e42e3b6f246fbc1d41e7c&role.id=2223c0caa0c948abbe85384d16a465a2 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:30.819150 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8853c0-eec0-4c90-a57c-1c8fc1cb40f4 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:30.819705 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8853c0-eec0-4c90-a57c-1c8fc1cb40f4 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:30.819782 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8853c0-eec0-4c90-a57c-1c8fc1cb40f4 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:30.821260 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 46/98] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:30.826153 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94373941-8b98-4aa5-a8a4-1656105c2afb None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:30.826613 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94373941-8b98-4aa5-a8a4-1656105c2afb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:30.826790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94373941-8b98-4aa5-a8a4-1656105c2afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:30.848026 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-94373941-8b98-4aa5-a8a4-1656105c2afb None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:30.849219 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-94373941-8b98-4aa5-a8a4-1656105c2afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:30.937192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 53/99] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:30.971434 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8853c0-eec0-4c90-a57c-1c8fc1cb40f4 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:31.112370 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8853c0-eec0-4c90-a57c-1c8fc1cb40f4 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:31.153591 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:31.161111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34114af7-c0a5-40e0-b95e-13ea5bfb2d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:31.161952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34114af7-c0a5-40e0-b95e-13ea5bfb2d22 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:31.162236 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34114af7-c0a5-40e0-b95e-13ea5bfb2d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:31.162513 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34114af7-c0a5-40e0-b95e-13ea5bfb2d22 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:31.184130 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34114af7-c0a5-40e0-b95e-13ea5bfb2d22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:31.189115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-34114af7-c0a5-40e0-b95e-13ea5bfb2d22 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 13:01:31.189115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:31.189115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:31.189115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:31.189115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:31.189115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:31.189115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:31.189115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:31.189115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:31.189115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:31.189115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:31.189115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:31.189115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:31.189115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:31.189115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:31.189115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:31.190036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:31.190036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:31.190036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:31.190036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:31.190036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:31.190036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:31.190036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:31.190036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:31.190036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:31.190036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:31.190036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:31.190036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:31.190036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:31.190036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:31.190036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:31.190036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:31.192300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:31.192300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:31.192300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:31.192300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:31.192300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:31.192300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:31.192300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:31.192300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:31.192300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:31.192300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:31.192300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 13:01:31.192300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:01:31.192300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 47/100] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:31.200436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94373941-8b98-4aa5-a8a4-1656105c2afb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:31.229424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ee09b-c654-4130-8ffa-921a8e95b794 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:31.229733 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ee09b-c654-4130-8ffa-921a8e95b794 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:31.229978 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ee09b-c654-4130-8ffa-921a8e95b794 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:31.231524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 48/101] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:01:31.237852 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9925c42-6d20-47f6-aee3-860a54f64cb4 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:31.238140 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9925c42-6d20-47f6-aee3-860a54f64cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:31.238426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9925c42-6d20-47f6-aee3-860a54f64cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:31.260368 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-c9925c42-6d20-47f6-aee3-860a54f64cb4 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:31.260688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:31.262090 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c9925c42-6d20-47f6-aee3-860a54f64cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:31.368720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94373941-8b98-4aa5-a8a4-1656105c2afb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:31.381040 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 49/102] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:01:31.425999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9925c42-6d20-47f6-aee3-860a54f64cb4 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:31.427721 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5cd5a-f2b4-4748-910a-c6347220a79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:31.428355 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5cd5a-f2b4-4748-910a-c6347220a79c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:31.428639 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5cd5a-f2b4-4748-910a-c6347220a79c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:31.428917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5cd5a-f2b4-4748-910a-c6347220a79c None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:31.430147 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5cd5a-f2b4-4748-910a-c6347220a79c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:31.430456 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5cd5a-f2b4-4748-910a-c6347220a79c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:31.431985 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5cd5a-f2b4-4748-910a-c6347220a79c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:31.441318 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 54/103] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:01:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:31.447592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5cd5a-f2b4-4748-910a-c6347220a79c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:31.545631 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:31.552550 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5cd5a-f2b4-4748-910a-c6347220a79c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:31.594484 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c9a20-f783-4e0e-96aa-f1295446c243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:31.595303 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c9a20-f783-4e0e-96aa-f1295446c243 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:31.595590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c9a20-f783-4e0e-96aa-f1295446c243 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:31.595962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c9a20-f783-4e0e-96aa-f1295446c243 None admin] PATH_INFO: `/v3/users/cdf37649a32840a2a68be3a46014c762` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:31.606394 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9925c42-6d20-47f6-aee3-860a54f64cb4 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:31.611747 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c9a20-f783-4e0e-96aa-f1295446c243 None admin] RBAC: Authorizing `identity:get_user(user_id=cdf37649a32840a2a68be3a46014c762)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:31.613297 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c9a20-f783-4e0e-96aa-f1295446c243 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:31.619481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 55/104] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:31 2022] GET /identity/v3/users/cdf37649a32840a2a68be3a46014c762 => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:31.620764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c9684-1577-4875-82d1-3c1a3e18603a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:31.621059 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c9684-1577-4875-82d1-3c1a3e18603a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:31.621341 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c9684-1577-4875-82d1-3c1a3e18603a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:31.622905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 56/105] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:31.624917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c9684-1577-4875-82d1-3c1a3e18603a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:31.652793 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:31.689179 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8a9a4-73ab-4948-b0ff-30e4459a7c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:31.689836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8a9a4-73ab-4948-b0ff-30e4459a7c3c None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:31.690120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8a9a4-73ab-4948-b0ff-30e4459a7c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:31.690394 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8a9a4-73ab-4948-b0ff-30e4459a7c3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:31.713078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8a9a4-73ab-4948-b0ff-30e4459a7c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:31.730843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-3dd8a9a4-73ab-4948-b0ff-30e4459a7c3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:31.730843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:31.730843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:31.730843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:31.730843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:31.730843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:31.730843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:31.730843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:31.730843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:31.730843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:31.730843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:31.730843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:31.730843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:31.730843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:31.730843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:31.730843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:31.733003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:31.733003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:31.733003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:31.733003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:31.733003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:31.733003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:31.733003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:31.733003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:31.733003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:31.733003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:31.733003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:31.733003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:31.733003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:31.733003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:31.733003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:31.733003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:31.735079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:31.735079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:31.735079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:31.735079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:31.735079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:31.735079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:31.735079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:31.735079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:31.735079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:31.735079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:31.735079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:31.735079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:01:31.735079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 50/106] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:31.735079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267be72-5ea0-465d-809f-057a92d8a515 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:31.736726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267be72-5ea0-465d-809f-057a92d8a515 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:31.736726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267be72-5ea0-465d-809f-057a92d8a515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:31.746804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c9684-1577-4875-82d1-3c1a3e18603a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:31.780066 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-f267be72-5ea0-465d-809f-057a92d8a515 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:31.781272 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-f267be72-5ea0-465d-809f-057a92d8a515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:31.784968 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc7637-760c-48ce-88fc-2a4ed701afa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:31.785680 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc7637-760c-48ce-88fc-2a4ed701afa5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:31.785997 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc7637-760c-48ce-88fc-2a4ed701afa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:31.786275 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc7637-760c-48ce-88fc-2a4ed701afa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:31.814544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:31.858837 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc7637-760c-48ce-88fc-2a4ed701afa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:31.860535 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc7637-760c-48ce-88fc-2a4ed701afa5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:31.916457 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 51/107] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:31.917883 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267be72-5ea0-465d-809f-057a92d8a515 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:31.984932 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 57/108] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:01:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:31.986323 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc7637-760c-48ce-88fc-2a4ed701afa5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:32.051611 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:32.110527 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc7637-760c-48ce-88fc-2a4ed701afa5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:32.150115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8da7c1-64be-4d3a-8243-9aef84c259d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:32.150996 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8da7c1-64be-4d3a-8243-9aef84c259d7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:32.151445 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8da7c1-64be-4d3a-8243-9aef84c259d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:32.151858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8da7c1-64be-4d3a-8243-9aef84c259d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:32.153229 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8da7c1-64be-4d3a-8243-9aef84c259d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:32.154858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8da7c1-64be-4d3a-8243-9aef84c259d7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:32.157282 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 58/109] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:01:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:32.158364 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8da7c1-64be-4d3a-8243-9aef84c259d7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:32.183744 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267be72-5ea0-465d-809f-057a92d8a515 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:32.200442 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:32.224823 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e700e1f-6e0a-40a5-9aef-3ac7db74a328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:32.225696 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e700e1f-6e0a-40a5-9aef-3ac7db74a328 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:32.226179 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e700e1f-6e0a-40a5-9aef-3ac7db74a328 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:32.226595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e700e1f-6e0a-40a5-9aef-3ac7db74a328 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:32.227592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e700e1f-6e0a-40a5-9aef-3ac7db74a328 None admin] RBAC: Adding query filter params (name=member) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:32.228094 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e700e1f-6e0a-40a5-9aef-3ac7db74a328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:32.229693 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e700e1f-6e0a-40a5-9aef-3ac7db74a328 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:32.238937 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 52/110] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:01:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:32.240037 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e700e1f-6e0a-40a5-9aef-3ac7db74a328 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:32.297946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8da7c1-64be-4d3a-8243-9aef84c259d7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:32.317475 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:32.338610 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8673d95-db99-4d63-98e2-4ebce7187b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:32.339287 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8673d95-db99-4d63-98e2-4ebce7187b55 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:32.339568 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8673d95-db99-4d63-98e2-4ebce7187b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:32.339841 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8673d95-db99-4d63-98e2-4ebce7187b55 None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:32.340980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8673d95-db99-4d63-98e2-4ebce7187b55 None admin] RBAC: Authorizing `identity:get_project(project_id=66166393e3e0490ea30d39e178525784)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:32.342414 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8673d95-db99-4d63-98e2-4ebce7187b55 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:32.348807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 59/111] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:32 2022] GET /identity/v3/projects/66166393e3e0490ea30d39e178525784 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:32.348807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6bd51-d546-4bb9-b807-a2d01f2d29b5 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:32.348807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6bd51-d546-4bb9-b807-a2d01f2d29b5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:32.348807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6bd51-d546-4bb9-b807-a2d01f2d29b5 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:32.348807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 60/112] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:32.348807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6bd51-d546-4bb9-b807-a2d01f2d29b5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:32.360329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e700e1f-6e0a-40a5-9aef-3ac7db74a328 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:32.402018 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb5079-f9ed-42d5-bc6b-31771805536c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:32.403274 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb5079-f9ed-42d5-bc6b-31771805536c None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:32.403568 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb5079-f9ed-42d5-bc6b-31771805536c None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:32.403872 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb5079-f9ed-42d5-bc6b-31771805536c None admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:32.404743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb5079-f9ed-42d5-bc6b-31771805536c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:32.406344 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb5079-f9ed-42d5-bc6b-31771805536c None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:32.444296 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 53/113] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 10 13:01:32 2022] POST /identity/v3/projects => generated 302 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:01:32.444296 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6a653-a173-4c7d-9e7f-e5fb90bc3f10 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:32.444296 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6a653-a173-4c7d-9e7f-e5fb90bc3f10 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:32.444296 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6a653-a173-4c7d-9e7f-e5fb90bc3f10 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:32.444296 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 54/114] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:32.444296 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6a653-a173-4c7d-9e7f-e5fb90bc3f10 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:32.480597 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:32.489677 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6bd51-d546-4bb9-b807-a2d01f2d29b5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:32.538270 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7ee70-f847-4e7a-a179-885845c0f83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:32.539507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7ee70-f847-4e7a-a179-885845c0f83e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:32.539790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7ee70-f847-4e7a-a179-885845c0f83e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:32.540064 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7ee70-f847-4e7a-a179-885845c0f83e None admin] PATH_INFO: `/v3/users/3e999bbc5d4a4abe863d44cfcf3acf0d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:32.541299 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7ee70-f847-4e7a-a179-885845c0f83e None admin] RBAC: Authorizing `identity:get_user(user_id=3e999bbc5d4a4abe863d44cfcf3acf0d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:32.542818 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7ee70-f847-4e7a-a179-885845c0f83e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:32.544783 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 61/115] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:32 2022] GET /identity/v3/users/3e999bbc5d4a4abe863d44cfcf3acf0d => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:32.548429 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e55ac2-227d-4d57-b7b3-746bb4052f3d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:32.548713 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e55ac2-227d-4d57-b7b3-746bb4052f3d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:32.548949 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e55ac2-227d-4d57-b7b3-746bb4052f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:32.569474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-78e55ac2-227d-4d57-b7b3-746bb4052f3d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:32.570741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-78e55ac2-227d-4d57-b7b3-746bb4052f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:32.584293 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6a653-a173-4c7d-9e7f-e5fb90bc3f10 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:32.629390 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:32.641888 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e212c-794f-47b1-bc90-b783fa179ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:32.642744 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e212c-794f-47b1-bc90-b783fa179ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:32.643196 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e212c-794f-47b1-bc90-b783fa179ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:32.643621 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e212c-794f-47b1-bc90-b783fa179ec2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:32.644366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e212c-794f-47b1-bc90-b783fa179ec2 None admin] RBAC: Adding query filter params (role.id=78d0cc90d2f2496b9c3e75bb0ddf0c6d, scope.project.id=66166393e3e0490ea30d39e178525784, user.id=cdf37649a32840a2a68be3a46014c762) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:32.644681 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e212c-794f-47b1-bc90-b783fa179ec2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:32.646151 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e212c-794f-47b1-bc90-b783fa179ec2 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:32.650468 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 62/116] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:32.655120 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe626bda-89bc-4f27-a26b-0e9329544683 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:32.655120 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe626bda-89bc-4f27-a26b-0e9329544683 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:32.655120 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe626bda-89bc-4f27-a26b-0e9329544683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:32.655869 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 55/117] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:01:32 2022] GET /identity/v3/role_assignments?user.id=cdf37649a32840a2a68be3a46014c762&scope.project.id=66166393e3e0490ea30d39e178525784&role.id=78d0cc90d2f2496b9c3e75bb0ddf0c6d => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:32.657444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49374af1-27f9-4705-9f9c-84c8b36c4193 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:32.657938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49374af1-27f9-4705-9f9c-84c8b36c4193 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:32.658217 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49374af1-27f9-4705-9f9c-84c8b36c4193 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:32.659742 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 56/118] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:32.660645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49374af1-27f9-4705-9f9c-84c8b36c4193 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:32.692459 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fe626bda-89bc-4f27-a26b-0e9329544683 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:32.693984 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fe626bda-89bc-4f27-a26b-0e9329544683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:32.769100 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:32.781800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 63/119] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:32.783492 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c3c49-20ae-40f0-aa7d-93e59d942872 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:32.784019 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c3c49-20ae-40f0-aa7d-93e59d942872 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:32.784390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49374af1-27f9-4705-9f9c-84c8b36c4193 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:32.784727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c3c49-20ae-40f0-aa7d-93e59d942872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:32.809591 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-1e7c3c49-20ae-40f0-aa7d-93e59d942872 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:32.811281 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1e7c3c49-20ae-40f0-aa7d-93e59d942872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:32.843723 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617d9f9-fd13-488e-b39a-6a077381efd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:32.845724 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617d9f9-fd13-488e-b39a-6a077381efd4 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:32.845859 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617d9f9-fd13-488e-b39a-6a077381efd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:32.846056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617d9f9-fd13-488e-b39a-6a077381efd4 None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:32.847344 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617d9f9-fd13-488e-b39a-6a077381efd4 None admin] RBAC: Authorizing `identity:get_project(project_id=66166393e3e0490ea30d39e178525784)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:32.848880 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617d9f9-fd13-488e-b39a-6a077381efd4 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:32.850647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 57/120] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:32 2022] GET /identity/v3/projects/66166393e3e0490ea30d39e178525784 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:32.855879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617d9f9-fd13-488e-b39a-6a077381efd4 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:32.903365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 64/121] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:32.904887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c3c49-20ae-40f0-aa7d-93e59d942872 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:32.964296 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:33.002615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617d9f9-fd13-488e-b39a-6a077381efd4 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:33.029054 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c3c49-20ae-40f0-aa7d-93e59d942872 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:33.040514 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02dad0-a67f-4bd6-bf93-1efd5fedf6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:33.041548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02dad0-a67f-4bd6-bf93-1efd5fedf6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:33.041999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02dad0-a67f-4bd6-bf93-1efd5fedf6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:33.042555 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02dad0-a67f-4bd6-bf93-1efd5fedf6d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:33.055691 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02dad0-a67f-4bd6-bf93-1efd5fedf6d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:33.062036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-cb02dad0-a67f-4bd6-bf93-1efd5fedf6d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:01:33.062036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:33.062036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:33.062036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:33.062036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:33.062036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:33.062036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:33.062036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:33.062036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:33.062036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:33.062036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:33.062036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:33.062036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:33.062036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:33.062036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:33.062036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:33.062929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:33.062929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:33.062929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:33.062929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:33.062929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:33.062929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:33.062929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:33.062929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:33.062929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:33.062929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:33.062929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:33.062929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:33.062929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:33.062929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:33.062929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:33.062929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:33.063746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:33.063746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:33.063746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:33.063746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:33.063746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:33.063746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:33.063746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:33.063746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:33.063746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:33.063746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:33.063746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:01:33.063746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:01:33.070725 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b57116-3694-41b4-b64d-059530aa5ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:33.070980 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 58/122] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:01:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:33.071150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b57116-3694-41b4-b64d-059530aa5ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:33.071438 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b57116-3694-41b4-b64d-059530aa5ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:33.071794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b57116-3694-41b4-b64d-059530aa5ca7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:33.072493 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02dad0-a67f-4bd6-bf93-1efd5fedf6d3 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:33.083971 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b57116-3694-41b4-b64d-059530aa5ca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:33.089666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-76b57116-3694-41b4-b64d-059530aa5ca7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:01:33.089666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:33.089666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:33.089666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:33.089666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:33.089666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:33.089666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:33.089666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:33.089666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:33.089666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:33.089666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:33.089666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:33.089666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:33.089666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:33.089666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:33.089666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:33.090549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:33.090549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:33.090549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:33.090549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:33.090549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:33.090549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:33.090549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:33.090549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:33.090549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:33.090549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:33.090549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:33.090549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:33.090549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:33.090549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:33.090549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:33.090549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:33.091461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:33.091461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:33.091461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:33.091461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:33.091461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:33.091461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:33.091461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:33.091461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:33.091461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:33.091461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:33.091461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:01:33.091461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:01:33.095189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 65/123] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 10 13:01:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:33.096185 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b57116-3694-41b4-b64d-059530aa5ca7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:33.098065 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:33.219536 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02dad0-a67f-4bd6-bf93-1efd5fedf6d3 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:33.252818 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b57116-3694-41b4-b64d-059530aa5ca7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:33.256936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:33.270545 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ae18d-4c2a-4239-b7c9-ee26cf7d5ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:33.271604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ae18d-4c2a-4239-b7c9-ee26cf7d5ca5 None admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:33.272093 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ae18d-4c2a-4239-b7c9-ee26cf7d5ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:33.272601 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ae18d-4c2a-4239-b7c9-ee26cf7d5ca5 None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784/users/3e999bbc5d4a4abe863d44cfcf3acf0d/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:33.274865 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ae18d-4c2a-4239-b7c9-ee26cf7d5ca5 None admin] RBAC: Authorizing `identity:create_grant(project_id=66166393e3e0490ea30d39e178525784, user_id=3e999bbc5d4a4abe863d44cfcf3acf0d, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:33.277456 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ae18d-4c2a-4239-b7c9-ee26cf7d5ca5 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:33.297744 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 59/124] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:01:33 2022] PUT /identity/v3/projects/66166393e3e0490ea30d39e178525784/users/3e999bbc5d4a4abe863d44cfcf3acf0d/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:01:33.298945 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ae18d-4c2a-4239-b7c9-ee26cf7d5ca5 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:33.310490 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa089422-06f8-4198-b09b-d573ffa7dffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:33.312135 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa089422-06f8-4198-b09b-d573ffa7dffc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:33.316343 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa089422-06f8-4198-b09b-d573ffa7dffc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:33.316961 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa089422-06f8-4198-b09b-d573ffa7dffc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:33.344874 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa089422-06f8-4198-b09b-d573ffa7dffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:33.358115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-fa089422-06f8-4198-b09b-d573ffa7dffc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:33.358115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:33.358115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:33.358115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:33.358115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:33.358115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:33.358115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:33.358115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:33.358115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:33.358115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:33.358115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:33.358115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:33.358115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:33.358115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:33.358115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:33.358115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:33.359408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:33.359408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:33.359408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:33.359408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:33.359408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:33.359408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:33.359408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:33.359408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:33.359408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:33.359408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:33.359408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:33.359408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:33.359408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:33.359408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:33.359408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:33.359408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:33.360192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:33.360192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:33.360192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:33.360192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:33.360192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:33.360192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:33.360192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:33.360192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:33.360192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:33.360192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:33.360192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:33.360192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:01:33.360192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 66/125] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:33.367636 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa089422-06f8-4198-b09b-d573ffa7dffc None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:33.442207 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:33.484027 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ae18d-4c2a-4239-b7c9-ee26cf7d5ca5 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:33.508671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa089422-06f8-4198-b09b-d573ffa7dffc None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:33.555335 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c6a08-78ba-4c27-95b6-14b65ffda72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:33.555995 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c6a08-78ba-4c27-95b6-14b65ffda72f None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:33.556282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c6a08-78ba-4c27-95b6-14b65ffda72f None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:33.556556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c6a08-78ba-4c27-95b6-14b65ffda72f None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:33.557350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c6a08-78ba-4c27-95b6-14b65ffda72f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:33.557657 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c6a08-78ba-4c27-95b6-14b65ffda72f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:33.559246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c6a08-78ba-4c27-95b6-14b65ffda72f None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:33.565632 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab40bf4-fc1b-4da7-a73f-edd722c1cd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:33.566857 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab40bf4-fc1b-4da7-a73f-edd722c1cd84 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:33.567171 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab40bf4-fc1b-4da7-a73f-edd722c1cd84 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:33.567443 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab40bf4-fc1b-4da7-a73f-edd722c1cd84 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:33.568302 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab40bf4-fc1b-4da7-a73f-edd722c1cd84 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:33.568737 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab40bf4-fc1b-4da7-a73f-edd722c1cd84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:33.570857 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab40bf4-fc1b-4da7-a73f-edd722c1cd84 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:33.571236 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 60/126] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:33.572182 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c6a08-78ba-4c27-95b6-14b65ffda72f None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:33.581657 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 67/127] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:01:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:33.583890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab40bf4-fc1b-4da7-a73f-edd722c1cd84 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:33.637170 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:33.699374 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c6a08-78ba-4c27-95b6-14b65ffda72f None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:33.743646 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33923c9e-afc6-4d6f-82c1-7f8d890e489e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:33.744546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33923c9e-afc6-4d6f-82c1-7f8d890e489e None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:33.744827 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33923c9e-afc6-4d6f-82c1-7f8d890e489e None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:33.745103 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33923c9e-afc6-4d6f-82c1-7f8d890e489e None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:33.745798 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33923c9e-afc6-4d6f-82c1-7f8d890e489e None admin] RBAC: Adding query filter params (name=member) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:33.746111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33923c9e-afc6-4d6f-82c1-7f8d890e489e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:33.747726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33923c9e-afc6-4d6f-82c1-7f8d890e489e None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:33.755399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:33.762951 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 61/128] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:01:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:33.763916 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33923c9e-afc6-4d6f-82c1-7f8d890e489e None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:33.885903 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33923c9e-afc6-4d6f-82c1-7f8d890e489e None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:33.894495 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab40bf4-fc1b-4da7-a73f-edd722c1cd84 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:33.925591 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a925f-5c2b-4c2a-afd2-e49073c97cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:33.926625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a925f-5c2b-4c2a-afd2-e49073c97cef None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:33.926930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a925f-5c2b-4c2a-afd2-e49073c97cef None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:33.927241 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a925f-5c2b-4c2a-afd2-e49073c97cef None admin] PATH_INFO: `/v3/users/3e999bbc5d4a4abe863d44cfcf3acf0d` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:33.928403 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a925f-5c2b-4c2a-afd2-e49073c97cef None admin] RBAC: Authorizing `identity:get_user(user_id=3e999bbc5d4a4abe863d44cfcf3acf0d)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:33.929961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a925f-5c2b-4c2a-afd2-e49073c97cef None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:33.931752 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 62/129] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:33 2022] GET /identity/v3/users/3e999bbc5d4a4abe863d44cfcf3acf0d => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:33.936297 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a925f-5c2b-4c2a-afd2-e49073c97cef None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:34.013536 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce06ec-a3d1-4b97-b4ae-75003a18f729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:34.014195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce06ec-a3d1-4b97-b4ae-75003a18f729 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:34.014464 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce06ec-a3d1-4b97-b4ae-75003a18f729 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:34.014745 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce06ec-a3d1-4b97-b4ae-75003a18f729 None admin] PATH_INFO: `/v3/users/1ade4cba44f6449e9916b370e369e98e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:34.015931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce06ec-a3d1-4b97-b4ae-75003a18f729 None admin] RBAC: Authorizing `identity:get_user(user_id=1ade4cba44f6449e9916b370e369e98e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:34.017396 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce06ec-a3d1-4b97-b4ae-75003a18f729 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:34.018967 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 68/130] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:33 2022] GET /identity/v3/users/1ade4cba44f6449e9916b370e369e98e => generated 247 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:34.019760 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce06ec-a3d1-4b97-b4ae-75003a18f729 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:34.055483 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:34.059543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a925f-5c2b-4c2a-afd2-e49073c97cef None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:34.107121 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c86cf-f9f4-4f46-b70f-a91f06f82151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:34.107775 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c86cf-f9f4-4f46-b70f-a91f06f82151 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:34.108058 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c86cf-f9f4-4f46-b70f-a91f06f82151 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:34.108338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c86cf-f9f4-4f46-b70f-a91f06f82151 None admin] PATH_INFO: `/v3/users/3e999bbc5d4a4abe863d44cfcf3acf0d` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:34.109824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c86cf-f9f4-4f46-b70f-a91f06f82151 None admin] RBAC: Authorizing `identity:get_user(user_id=3e999bbc5d4a4abe863d44cfcf3acf0d)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:34.112188 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c86cf-f9f4-4f46-b70f-a91f06f82151 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:34.114264 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 63/131] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:33 2022] GET /identity/v3/users/3e999bbc5d4a4abe863d44cfcf3acf0d => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:34.115835 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c86cf-f9f4-4f46-b70f-a91f06f82151 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:34.131825 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:34.142490 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce06ec-a3d1-4b97-b4ae-75003a18f729 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:34.188073 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7792c51-13b8-40b9-94b7-a1b35fed5220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:34.188733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7792c51-13b8-40b9-94b7-a1b35fed5220 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:34.189021 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7792c51-13b8-40b9-94b7-a1b35fed5220 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:34.189293 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7792c51-13b8-40b9-94b7-a1b35fed5220 None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:34.190866 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7792c51-13b8-40b9-94b7-a1b35fed5220 None admin] RBAC: Authorizing `identity:get_project(project_id=66166393e3e0490ea30d39e178525784)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:34.192634 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7792c51-13b8-40b9-94b7-a1b35fed5220 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:34.195495 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 69/132] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:34 2022] GET /identity/v3/projects/66166393e3e0490ea30d39e178525784 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:34.199856 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7792c51-13b8-40b9-94b7-a1b35fed5220 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:34.298083 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c86cf-f9f4-4f46-b70f-a91f06f82151 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:34.334609 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7792c51-13b8-40b9-94b7-a1b35fed5220 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:34.380973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8a61d-374d-4136-a12c-b1dce09a9e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:34.381671 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8a61d-374d-4136-a12c-b1dce09a9e7b None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:34.381960 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8a61d-374d-4136-a12c-b1dce09a9e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:34.382300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8a61d-374d-4136-a12c-b1dce09a9e7b None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:34.385967 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8a61d-374d-4136-a12c-b1dce09a9e7b None admin] RBAC: Authorizing `identity:get_project(project_id=66166393e3e0490ea30d39e178525784)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:34.389192 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8a61d-374d-4136-a12c-b1dce09a9e7b None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:34.391124 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 64/133] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:34 2022] GET /identity/v3/projects/66166393e3e0490ea30d39e178525784 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:34.395480 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8a61d-374d-4136-a12c-b1dce09a9e7b None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:34.409503 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f53e8b-5f16-4444-9fba-16ead34a1211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:34.410154 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f53e8b-5f16-4444-9fba-16ead34a1211 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:34.410481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f53e8b-5f16-4444-9fba-16ead34a1211 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:34.410763 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f53e8b-5f16-4444-9fba-16ead34a1211 None admin] PATH_INFO: `/v3/projects/d8c9d9f0198e42e3b6f246fbc1d41e7c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:34.413167 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f53e8b-5f16-4444-9fba-16ead34a1211 None admin] RBAC: Authorizing `identity:get_project(project_id=d8c9d9f0198e42e3b6f246fbc1d41e7c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:34.415376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:34.416236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f53e8b-5f16-4444-9fba-16ead34a1211 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:34.424572 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 70/134] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:34 2022] GET /identity/v3/projects/d8c9d9f0198e42e3b6f246fbc1d41e7c => generated 312 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:34.425510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f53e8b-5f16-4444-9fba-16ead34a1211 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:34.511442 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:34.604989 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f53e8b-5f16-4444-9fba-16ead34a1211 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:34.647245 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53211f6b-6573-494c-90a9-414aeae93dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:34.648485 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53211f6b-6573-494c-90a9-414aeae93dda None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:34.648784 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53211f6b-6573-494c-90a9-414aeae93dda None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:34.649067 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53211f6b-6573-494c-90a9-414aeae93dda None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784/users/1ade4cba44f6449e9916b370e369e98e/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:34.651194 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53211f6b-6573-494c-90a9-414aeae93dda None admin] RBAC: Authorizing `identity:create_grant(project_id=66166393e3e0490ea30d39e178525784, user_id=1ade4cba44f6449e9916b370e369e98e, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:34.652883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53211f6b-6573-494c-90a9-414aeae93dda None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:34.671792 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 71/135] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:01:34 2022] PUT /identity/v3/projects/66166393e3e0490ea30d39e178525784/users/1ade4cba44f6449e9916b370e369e98e/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:01:34.672912 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53211f6b-6573-494c-90a9-414aeae93dda None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:34.785244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8a61d-374d-4136-a12c-b1dce09a9e7b None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:34.799409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:34.802851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53211f6b-6573-494c-90a9-414aeae93dda None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:34.845299 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f28fcf-53ff-4c18-bca2-26b0ce486275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:34.846078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f28fcf-53ff-4c18-bca2-26b0ce486275 None admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:34.846367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f28fcf-53ff-4c18-bca2-26b0ce486275 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:34.846634 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f28fcf-53ff-4c18-bca2-26b0ce486275 None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784/users/3e999bbc5d4a4abe863d44cfcf3acf0d/roles/0a020d67ea4d4d62b1305fd0cd952779` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:34.849141 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f28fcf-53ff-4c18-bca2-26b0ce486275 None admin] RBAC: Authorizing `identity:create_grant(project_id=66166393e3e0490ea30d39e178525784, user_id=3e999bbc5d4a4abe863d44cfcf3acf0d, role_id=0a020d67ea4d4d62b1305fd0cd952779)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:34.849499 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896f912-0038-49ee-8dd1-d338b35afaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:34.850448 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896f912-0038-49ee-8dd1-d338b35afaa7 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:34.851410 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f28fcf-53ff-4c18-bca2-26b0ce486275 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:34.859272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896f912-0038-49ee-8dd1-d338b35afaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:34.859272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896f912-0038-49ee-8dd1-d338b35afaa7 None admin] PATH_INFO: `/v3/projects/d8c9d9f0198e42e3b6f246fbc1d41e7c/users/3e999bbc5d4a4abe863d44cfcf3acf0d/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:34.859272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896f912-0038-49ee-8dd1-d338b35afaa7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8c9d9f0198e42e3b6f246fbc1d41e7c, user_id=3e999bbc5d4a4abe863d44cfcf3acf0d, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:34.860621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896f912-0038-49ee-8dd1-d338b35afaa7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:34.882565 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 65/136] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:01:34 2022] PUT /identity/v3/projects/66166393e3e0490ea30d39e178525784/users/3e999bbc5d4a4abe863d44cfcf3acf0d/roles/0a020d67ea4d4d62b1305fd0cd952779 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:01:34.884044 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e78ed-3671-4ae4-9d34-5e6409ae5b24 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:34.886318 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e78ed-3671-4ae4-9d34-5e6409ae5b24 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:34.886594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e78ed-3671-4ae4-9d34-5e6409ae5b24 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:34.888107 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 66/137] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:34.894955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f976a27-847e-4fb9-8d6e-7f3a5c9edda1 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:34.895344 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f976a27-847e-4fb9-8d6e-7f3a5c9edda1 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:34.895623 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f976a27-847e-4fb9-8d6e-7f3a5c9edda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:34.897335 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 72/138] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:01:34 2022] PUT /identity/v3/projects/d8c9d9f0198e42e3b6f246fbc1d41e7c/users/3e999bbc5d4a4abe863d44cfcf3acf0d/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:01:34.917418 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-6f976a27-847e-4fb9-8d6e-7f3a5c9edda1 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:34.918795 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-6f976a27-847e-4fb9-8d6e-7f3a5c9edda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:35.021701 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:35.032645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 67/139] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:01:35.069033 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896f912-0038-49ee-8dd1-d338b35afaa7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:35.071569 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02e0c0-b38a-4006-85ce-4d303875c0f9 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:35.072068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02e0c0-b38a-4006-85ce-4d303875c0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:35.072167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02e0c0-b38a-4006-85ce-4d303875c0f9 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:35.073753 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 68/140] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:35.088626 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd315964-97a5-4feb-8e1c-c1b8ac862770 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:35.088956 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd315964-97a5-4feb-8e1c-c1b8ac862770 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:35.089189 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd315964-97a5-4feb-8e1c-c1b8ac862770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:35.115913 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-cd315964-97a5-4feb-8e1c-c1b8ac862770 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:35.117983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-cd315964-97a5-4feb-8e1c-c1b8ac862770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:35.235147 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896f912-0038-49ee-8dd1-d338b35afaa7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:35.248469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 69/141] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:35.270897 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd315964-97a5-4feb-8e1c-c1b8ac862770 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:35.276528 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438f695-4fb4-42a1-9e95-d9f7cff35235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:35.277535 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438f695-4fb4-42a1-9e95-d9f7cff35235 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:35.278047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438f695-4fb4-42a1-9e95-d9f7cff35235 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:35.278525 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438f695-4fb4-42a1-9e95-d9f7cff35235 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:35.280168 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438f695-4fb4-42a1-9e95-d9f7cff35235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:35.282022 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438f695-4fb4-42a1-9e95-d9f7cff35235 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:35.284008 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 73/142] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:01:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:35.293713 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438f695-4fb4-42a1-9e95-d9f7cff35235 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:35.341964 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:35.411540 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438f695-4fb4-42a1-9e95-d9f7cff35235 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:35.452278 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce64ec7-9db4-4d0b-8117-13e9a6cff629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:35.453998 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce64ec7-9db4-4d0b-8117-13e9a6cff629 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:35.454534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce64ec7-9db4-4d0b-8117-13e9a6cff629 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:35.455214 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce64ec7-9db4-4d0b-8117-13e9a6cff629 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:35.456593 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce64ec7-9db4-4d0b-8117-13e9a6cff629 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:35.458364 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce64ec7-9db4-4d0b-8117-13e9a6cff629 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:35.488617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 74/143] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 10 13:01:35 2022] POST /identity/v3/users => generated 283 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:01:35.544998 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd315964-97a5-4feb-8e1c-c1b8ac862770 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:35.583398 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:35.591423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab980666-50c3-4b78-b30d-a1226afa5444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:35.592376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab980666-50c3-4b78-b30d-a1226afa5444 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:35.593036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab980666-50c3-4b78-b30d-a1226afa5444 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:35.593429 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab980666-50c3-4b78-b30d-a1226afa5444 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:35.613689 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab980666-50c3-4b78-b30d-a1226afa5444 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:35.619390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-ab980666-50c3-4b78-b30d-a1226afa5444 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 13:01:35.619390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:35.619390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:35.619390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:35.619390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:35.619390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:35.619390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:35.619390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:35.619390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:35.619390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:35.619390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:35.619390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:35.619390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:35.619390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:35.619390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:35.619390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:35.620310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:35.620310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:35.620310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:35.620310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:35.620310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:35.620310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:35.620310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:35.620310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:35.620310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:35.620310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:35.620310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:35.620310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:35.620310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:35.620310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:35.620310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:35.620310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:35.621111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:35.621111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:35.621111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:35.621111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:35.621111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:35.621111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:35.621111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:35.621111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:35.621111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:35.621111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:35.621111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 13:01:35.621111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:01:35.621111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 70/144] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:35.628505 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce64ec7-9db4-4d0b-8117-13e9a6cff629 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:35.724323 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:35.756097 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce64ec7-9db4-4d0b-8117-13e9a6cff629 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:35.801844 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575266d-eee0-4cf5-88fa-cde82bceac66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:35.802488 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575266d-eee0-4cf5-88fa-cde82bceac66 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:35.802776 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575266d-eee0-4cf5-88fa-cde82bceac66 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:35.803082 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575266d-eee0-4cf5-88fa-cde82bceac66 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:35.803846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575266d-eee0-4cf5-88fa-cde82bceac66 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:35.804717 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575266d-eee0-4cf5-88fa-cde82bceac66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:35.806159 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575266d-eee0-4cf5-88fa-cde82bceac66 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:35.816142 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 75/145] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:01:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:35.821924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab980666-50c3-4b78-b30d-a1226afa5444 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:35.936905 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab980666-50c3-4b78-b30d-a1226afa5444 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:35.976300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27af1ba-c64c-41c8-be18-4b857a860262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:35.976968 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27af1ba-c64c-41c8-be18-4b857a860262 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:35.977246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27af1ba-c64c-41c8-be18-4b857a860262 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:35.977532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27af1ba-c64c-41c8-be18-4b857a860262 None admin] PATH_INFO: `/v3/users/cdf37649a32840a2a68be3a46014c762` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:35.978808 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27af1ba-c64c-41c8-be18-4b857a860262 None admin] RBAC: Authorizing `identity:get_user(user_id=cdf37649a32840a2a68be3a46014c762)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:35.980372 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27af1ba-c64c-41c8-be18-4b857a860262 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:35.982167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 71/146] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:35 2022] GET /identity/v3/users/cdf37649a32840a2a68be3a46014c762 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:35.988539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575266d-eee0-4cf5-88fa-cde82bceac66 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:36.106528 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575266d-eee0-4cf5-88fa-cde82bceac66 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:36.144693 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bbccf-5e6c-4574-b218-fa7b3f22cef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:36.145348 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bbccf-5e6c-4574-b218-fa7b3f22cef1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:36.145627 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bbccf-5e6c-4574-b218-fa7b3f22cef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:36.145903 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bbccf-5e6c-4574-b218-fa7b3f22cef1 None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:36.147208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bbccf-5e6c-4574-b218-fa7b3f22cef1 None admin] RBAC: Authorizing `identity:get_project(project_id=66166393e3e0490ea30d39e178525784)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:36.149273 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bbccf-5e6c-4574-b218-fa7b3f22cef1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:36.150960 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 76/147] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:35 2022] GET /identity/v3/projects/66166393e3e0490ea30d39e178525784 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:36.157332 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27af1ba-c64c-41c8-be18-4b857a860262 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:36.215788 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:36.267302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27af1ba-c64c-41c8-be18-4b857a860262 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:36.304722 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583e201-6e42-458c-856c-7871a2472426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:36.305400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583e201-6e42-458c-856c-7871a2472426 None admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:36.305683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583e201-6e42-458c-856c-7871a2472426 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:36.305957 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583e201-6e42-458c-856c-7871a2472426 None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784/users/cdf37649a32840a2a68be3a46014c762/roles/78d0cc90d2f2496b9c3e75bb0ddf0c6d` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:36.308048 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583e201-6e42-458c-856c-7871a2472426 None admin] RBAC: Authorizing `identity:create_grant(project_id=66166393e3e0490ea30d39e178525784, user_id=cdf37649a32840a2a68be3a46014c762, role_id=78d0cc90d2f2496b9c3e75bb0ddf0c6d)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:36.309495 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583e201-6e42-458c-856c-7871a2472426 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:36.332210 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 72/148] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:01:36 2022] PUT /identity/v3/projects/66166393e3e0490ea30d39e178525784/users/cdf37649a32840a2a68be3a46014c762/roles/78d0cc90d2f2496b9c3e75bb0ddf0c6d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:01:36.551380 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f8d25-d650-429c-ab6c-5e50958296fa None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:36.551765 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f8d25-d650-429c-ab6c-5e50958296fa None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:36.551966 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f8d25-d650-429c-ab6c-5e50958296fa None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:36.553733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 77/149] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:36.559886 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61625fe-6921-4d1e-aa3d-f2dfd34876ce None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:36.560232 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61625fe-6921-4d1e-aa3d-f2dfd34876ce None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:36.560514 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61625fe-6921-4d1e-aa3d-f2dfd34876ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:36.584090 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-b61625fe-6921-4d1e-aa3d-f2dfd34876ce None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:36.585905 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-b61625fe-6921-4d1e-aa3d-f2dfd34876ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:36.668124 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 73/150] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:36.699396 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f8d25-d650-429c-ab6c-5e50958296fa None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:36.703577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:36.840136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f8d25-d650-429c-ab6c-5e50958296fa None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:36.886621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cc9cd-bb47-4c53-a37e-234f1b5ee534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:36.887288 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cc9cd-bb47-4c53-a37e-234f1b5ee534 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:36.887572 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cc9cd-bb47-4c53-a37e-234f1b5ee534 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:36.887846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cc9cd-bb47-4c53-a37e-234f1b5ee534 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:36.903988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8cc9cd-bb47-4c53-a37e-234f1b5ee534 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:36.909250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-ae8cc9cd-bb47-4c53-a37e-234f1b5ee534 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:36.909250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:36.909250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:36.909250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:36.909250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:36.909250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:36.909250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:36.909250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:36.909250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:36.909250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:36.909250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:36.909250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:36.909250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:36.909250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:36.909250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:36.909250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:36.910146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:36.910146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:36.910146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:36.910146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:36.910146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:36.910146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:36.910146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:36.910146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:36.910146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:36.910146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:36.910146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:36.910146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:36.910146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:36.910146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:36.910146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:36.910146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:36.910935 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:36.910935 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:36.910935 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:36.910935 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:36.910935 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:36.910935 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:36.910935 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:36.910935 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:36.910935 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:36.910935 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:36.910935 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:36.910935 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:01:36.910935 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 78/151] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:36.918266 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61625fe-6921-4d1e-aa3d-f2dfd34876ce None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:36.991472 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:37.077761 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61625fe-6921-4d1e-aa3d-f2dfd34876ce None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:37.128189 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de529e69-da2a-488d-ac5e-3e4e0c8750fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:37.128724 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de529e69-da2a-488d-ac5e-3e4e0c8750fc None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:37.129001 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de529e69-da2a-488d-ac5e-3e4e0c8750fc None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:37.129266 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de529e69-da2a-488d-ac5e-3e4e0c8750fc None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:37.129931 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de529e69-da2a-488d-ac5e-3e4e0c8750fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:37.130225 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de529e69-da2a-488d-ac5e-3e4e0c8750fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:37.131629 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de529e69-da2a-488d-ac5e-3e4e0c8750fc None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:37.146801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 74/152] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:01:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:37.153028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cc9cd-bb47-4c53-a37e-234f1b5ee534 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:37.238176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:37.287657 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cc9cd-bb47-4c53-a37e-234f1b5ee534 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:37.339592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc0a66-78b2-4022-b0bd-fb8fc5a0f3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:37.340269 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc0a66-78b2-4022-b0bd-fb8fc5a0f3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:37.340552 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc0a66-78b2-4022-b0bd-fb8fc5a0f3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:37.340830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc0a66-78b2-4022-b0bd-fb8fc5a0f3a0 None admin] PATH_INFO: `/v3/users/3e999bbc5d4a4abe863d44cfcf3acf0d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:37.342154 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc0a66-78b2-4022-b0bd-fb8fc5a0f3a0 None admin] RBAC: Authorizing `identity:get_user(user_id=3e999bbc5d4a4abe863d44cfcf3acf0d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:37.343701 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc0a66-78b2-4022-b0bd-fb8fc5a0f3a0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:37.346199 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 79/153] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:37 2022] GET /identity/v3/users/3e999bbc5d4a4abe863d44cfcf3acf0d => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:37.351886 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de529e69-da2a-488d-ac5e-3e4e0c8750fc None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:37.509146 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de529e69-da2a-488d-ac5e-3e4e0c8750fc None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:37.512011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:37.552038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cee39-a9e0-447c-9186-33aab00350dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:37.553035 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cee39-a9e0-447c-9186-33aab00350dc None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:37.553511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cee39-a9e0-447c-9186-33aab00350dc None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:37.554023 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cee39-a9e0-447c-9186-33aab00350dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:37.634412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cee39-a9e0-447c-9186-33aab00350dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:37.636243 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cee39-a9e0-447c-9186-33aab00350dc None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:37.767912 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 75/154] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:01:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:37.776341 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc0a66-78b2-4022-b0bd-fb8fc5a0f3a0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:37.914053 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc0a66-78b2-4022-b0bd-fb8fc5a0f3a0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:37.965266 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:37.971078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cf314-1fb0-489e-9901-b6b4ad224ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:37.972176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cf314-1fb0-489e-9901-b6b4ad224ffa None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:37.972461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cf314-1fb0-489e-9901-b6b4ad224ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:37.972738 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cf314-1fb0-489e-9901-b6b4ad224ffa None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:37.973898 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96cf314-1fb0-489e-9901-b6b4ad224ffa None admin] RBAC: Authorizing `identity:get_project(project_id=66166393e3e0490ea30d39e178525784)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:37.975363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96cf314-1fb0-489e-9901-b6b4ad224ffa None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:37.977208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 80/155] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:37 2022] GET /identity/v3/projects/66166393e3e0490ea30d39e178525784 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:37.983423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cee39-a9e0-447c-9186-33aab00350dc None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:37.991753 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:38.153271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cee39-a9e0-447c-9186-33aab00350dc None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:38.203861 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86568f58-99da-4471-8a81-126d4a168777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:38.204849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86568f58-99da-4471-8a81-126d4a168777 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:38.205320 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86568f58-99da-4471-8a81-126d4a168777 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:38.205797 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86568f58-99da-4471-8a81-126d4a168777 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:38.206728 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86568f58-99da-4471-8a81-126d4a168777 None admin] RBAC: Adding query filter params (role.id=2223c0caa0c948abbe85384d16a465a2, scope.project.id=66166393e3e0490ea30d39e178525784, user.id=3e999bbc5d4a4abe863d44cfcf3acf0d) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:38.207292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86568f58-99da-4471-8a81-126d4a168777 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:38.208934 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86568f58-99da-4471-8a81-126d4a168777 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:38.220220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 76/156] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:01:37 2022] GET /identity/v3/role_assignments?user.id=3e999bbc5d4a4abe863d44cfcf3acf0d&scope.project.id=66166393e3e0490ea30d39e178525784&role.id=2223c0caa0c948abbe85384d16a465a2 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:38.340438 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccd1ee-12c1-49f3-93ad-d8e40b0bbd97 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:38.340944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccd1ee-12c1-49f3-93ad-d8e40b0bbd97 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:38.341037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccd1ee-12c1-49f3-93ad-d8e40b0bbd97 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:38.342724 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 81/157] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:38.356820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d9b3f-727c-4e2e-a3a3-a4a466601dcc None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:38.357836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d9b3f-727c-4e2e-a3a3-a4a466601dcc None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:38.358311 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d9b3f-727c-4e2e-a3a3-a4a466601dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:38.388186 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-310d9b3f-727c-4e2e-a3a3-a4a466601dcc None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:38.389738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-310d9b3f-727c-4e2e-a3a3-a4a466601dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:38.484057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:38.491634 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 77/158] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:38.519657 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83009c6-1bff-4a68-b846-e992e9e821a5 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:38.519936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83009c6-1bff-4a68-b846-e992e9e821a5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:38.520374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83009c6-1bff-4a68-b846-e992e9e821a5 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:38.521878 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 82/159] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:38.532828 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae742a-90e2-44f3-9e54-b9f5ccc404c9 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:38.533147 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae742a-90e2-44f3-9e54-b9f5ccc404c9 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:38.533374 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae742a-90e2-44f3-9e54-b9f5ccc404c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:38.539889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83009c6-1bff-4a68-b846-e992e9e821a5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:38.560478 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-06ae742a-90e2-44f3-9e54-b9f5ccc404c9 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:38.561924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-06ae742a-90e2-44f3-9e54-b9f5ccc404c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:38.687412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 78/160] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:38.736800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83009c6-1bff-4a68-b846-e992e9e821a5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:38.756822 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae742a-90e2-44f3-9e54-b9f5ccc404c9 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:38.781267 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3dc4b-1a8e-4414-91e3-cbe714679665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:38.782128 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3dc4b-1a8e-4414-91e3-cbe714679665 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:38.782255 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3dc4b-1a8e-4414-91e3-cbe714679665 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:38.782449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3dc4b-1a8e-4414-91e3-cbe714679665 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:38.801205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3dc4b-1a8e-4414-91e3-cbe714679665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:38.806532 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-49b3dc4b-1a8e-4414-91e3-cbe714679665 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:01:38.806532 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:38.806532 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:38.806532 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:38.806532 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:38.806532 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:38.806532 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:38.806532 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:38.806532 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:38.806532 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:38.806532 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:38.806532 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:38.806532 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:38.806532 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:38.806532 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:38.806532 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:38.807501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:38.807501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:38.807501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:38.807501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:38.807501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:38.807501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:38.807501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:38.807501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:38.807501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:38.807501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:38.807501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:38.807501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:38.807501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:38.807501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:38.807501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:38.807501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:38.808906 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:38.808906 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:38.808906 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:38.808906 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:38.808906 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:38.808906 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:38.808906 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:38.808906 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:38.808906 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:38.808906 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:38.808906 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:01:38.808906 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:01:38.808906 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 83/161] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:01:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:01:38.813618 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3dc4b-1a8e-4414-91e3-cbe714679665 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:38.903878 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:38.920116 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae742a-90e2-44f3-9e54-b9f5ccc404c9 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:38.959399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:38.969457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3dc4b-1a8e-4414-91e3-cbe714679665 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:38.973861 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b448ef-adc2-448f-8f9b-4be4c499dbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:38.974529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b448ef-adc2-448f-8f9b-4be4c499dbb7 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:38.974836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b448ef-adc2-448f-8f9b-4be4c499dbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:38.975161 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b448ef-adc2-448f-8f9b-4be4c499dbb7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:38.989763 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b448ef-adc2-448f-8f9b-4be4c499dbb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:39.001524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-c3b448ef-adc2-448f-8f9b-4be4c499dbb7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:01:39.001524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:39.001524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:39.001524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:39.001524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:39.001524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:39.001524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:39.001524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:39.001524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:39.001524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:39.001524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:39.001524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:39.001524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:39.001524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:39.001524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:39.001524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:39.002532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:39.002532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:39.002532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:39.002532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:39.002532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:39.002532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:39.002532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:39.002532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:39.002532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:39.002532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:39.002532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:39.002532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:39.002532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:39.002532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:39.002532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:39.002532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:39.003363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:39.003363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:39.003363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:39.003363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:39.003363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:39.003363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:39.003363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:39.003363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:39.003363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:39.003363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:39.003363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:01:39.003363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:01:39.003363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 79/162] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 10 13:01:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:39.010609 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b448ef-adc2-448f-8f9b-4be4c499dbb7 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:39.032279 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa5504-976b-444c-85ab-9d635f43a1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:39.032907 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa5504-976b-444c-85ab-9d635f43a1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:39.033182 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa5504-976b-444c-85ab-9d635f43a1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:39.033449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa5504-976b-444c-85ab-9d635f43a1f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:39.034123 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa5504-976b-444c-85ab-9d635f43a1f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:39.034419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa5504-976b-444c-85ab-9d635f43a1f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:39.035833 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa5504-976b-444c-85ab-9d635f43a1f8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:39.050391 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 84/163] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:39.060061 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa5504-976b-444c-85ab-9d635f43a1f8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:39.149684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b448ef-adc2-448f-8f9b-4be4c499dbb7 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:39.198669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7dfe9-0744-4013-9ca9-7c533f97d595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:39.199355 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7dfe9-0744-4013-9ca9-7c533f97d595 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:39.199635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7dfe9-0744-4013-9ca9-7c533f97d595 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:39.199906 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7dfe9-0744-4013-9ca9-7c533f97d595 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:39.200623 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7dfe9-0744-4013-9ca9-7c533f97d595 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:39.200930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7dfe9-0744-4013-9ca9-7c533f97d595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:39.202296 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7dfe9-0744-4013-9ca9-7c533f97d595 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:39.215506 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 80/164] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:01:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:39.216858 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5cbd2-f7db-4c30-9461-705aa7851248 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:39.217155 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5cbd2-f7db-4c30-9461-705aa7851248 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:39.217408 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5cbd2-f7db-4c30-9461-705aa7851248 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:39.218652 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 81/165] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:39.231496 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5cbd2-f7db-4c30-9461-705aa7851248 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:39.261338 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa5504-976b-444c-85ab-9d635f43a1f8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:39.315315 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:39.320837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:39.346482 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91a7e1-f368-4b72-a3ac-2892acec926c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:39.347826 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91a7e1-f368-4b72-a3ac-2892acec926c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:39.348301 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91a7e1-f368-4b72-a3ac-2892acec926c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:39.348801 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91a7e1-f368-4b72-a3ac-2892acec926c None admin] PATH_INFO: `/v3/users/1ade4cba44f6449e9916b370e369e98e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:39.350307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91a7e1-f368-4b72-a3ac-2892acec926c None admin] RBAC: Authorizing `identity:get_user(user_id=1ade4cba44f6449e9916b370e369e98e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:39.352069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91a7e1-f368-4b72-a3ac-2892acec926c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:39.353994 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 85/166] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:39 2022] GET /identity/v3/users/1ade4cba44f6449e9916b370e369e98e => generated 247 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:39.355354 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e043aa3-6590-4fd5-b211-eb18c660817c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:39.355854 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e043aa3-6590-4fd5-b211-eb18c660817c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:39.356385 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e043aa3-6590-4fd5-b211-eb18c660817c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:39.388442 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2e043aa3-6590-4fd5-b211-eb18c660817c None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:39.395802 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2e043aa3-6590-4fd5-b211-eb18c660817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:39.411424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5cbd2-f7db-4c30-9461-705aa7851248 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:39.466321 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced8e3c-fe0a-410d-a5b2-ff53eac65df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:39.466970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced8e3c-fe0a-410d-a5b2-ff53eac65df4 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:39.467319 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced8e3c-fe0a-410d-a5b2-ff53eac65df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:39.467608 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced8e3c-fe0a-410d-a5b2-ff53eac65df4 None admin] PATH_INFO: `/v3/users/3e999bbc5d4a4abe863d44cfcf3acf0d` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:39.471709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced8e3c-fe0a-410d-a5b2-ff53eac65df4 None admin] RBAC: Authorizing `identity:get_user(user_id=3e999bbc5d4a4abe863d44cfcf3acf0d)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:39.473309 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced8e3c-fe0a-410d-a5b2-ff53eac65df4 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:39.475101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 82/167] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:39 2022] GET /identity/v3/users/3e999bbc5d4a4abe863d44cfcf3acf0d => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:01:39.476060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced8e3c-fe0a-410d-a5b2-ff53eac65df4 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:39.540741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 86/168] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:39.541540 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e043aa3-6590-4fd5-b211-eb18c660817c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:39.676178 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e043aa3-6590-4fd5-b211-eb18c660817c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:39.682296 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced8e3c-fe0a-410d-a5b2-ff53eac65df4 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:39.717324 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:39.718592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:39.743526 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040365a6-105c-4e94-bbf1-b39cfd1a87ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:39.744148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040365a6-105c-4e94-bbf1-b39cfd1a87ef None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:39.744434 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040365a6-105c-4e94-bbf1-b39cfd1a87ef None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:39.744679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040365a6-105c-4e94-bbf1-b39cfd1a87ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:39.757971 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e6b40-ecdb-4851-9233-b682a16c3547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:39.758597 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e6b40-ecdb-4851-9233-b682a16c3547 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:39.758880 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e6b40-ecdb-4851-9233-b682a16c3547 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:39.759197 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e6b40-ecdb-4851-9233-b682a16c3547 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:39.836344 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e6b40-ecdb-4851-9233-b682a16c3547 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:39.837728 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e6b40-ecdb-4851-9233-b682a16c3547 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:39.852133 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040365a6-105c-4e94-bbf1-b39cfd1a87ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:39.853871 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040365a6-105c-4e94-bbf1-b39cfd1a87ef None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:39.962202 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 87/169] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:01:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:39.963232 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040365a6-105c-4e94-bbf1-b39cfd1a87ef None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:39.997054 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:40.081619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040365a6-105c-4e94-bbf1-b39cfd1a87ef None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:40.101520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 83/170] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:01:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:40.102391 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e6b40-ecdb-4851-9233-b682a16c3547 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:40.125056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:40.130846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18686dc-9d4e-47b8-afa2-5a199c0118cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:40.131522 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18686dc-9d4e-47b8-afa2-5a199c0118cd None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:40.131797 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18686dc-9d4e-47b8-afa2-5a199c0118cd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:40.132094 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18686dc-9d4e-47b8-afa2-5a199c0118cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:40.142991 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18686dc-9d4e-47b8-afa2-5a199c0118cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:40.147914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-e18686dc-9d4e-47b8-afa2-5a199c0118cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:40.147914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:40.147914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:40.147914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:40.147914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:40.147914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:40.147914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:40.147914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:40.147914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:40.147914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:40.147914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:40.147914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:40.147914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:40.147914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:40.147914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:40.147914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:40.148807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:40.148807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:40.148807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:40.148807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:40.148807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:40.148807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:40.148807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:40.148807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:40.148807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:40.148807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:40.148807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:40.148807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:40.148807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:40.148807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:40.148807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:40.148807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:40.149582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:40.149582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:40.149582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:40.149582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:40.149582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:40.149582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:40.149582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:40.149582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:40.149582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:40.149582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:40.149582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:40.149582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:01:40.149582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 88/171] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:40.150318 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4019045-bccd-4f33-8644-0d337c1737f6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:40.150883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4019045-bccd-4f33-8644-0d337c1737f6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:40.150982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4019045-bccd-4f33-8644-0d337c1737f6 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:40.152367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 89/172] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:40.152989 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4019045-bccd-4f33-8644-0d337c1737f6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:40.282433 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e6b40-ecdb-4851-9233-b682a16c3547 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:40.314916 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:40.327700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5516ca-c24f-491e-aeae-3c250613400d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:40.328670 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5516ca-c24f-491e-aeae-3c250613400d None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:40.330364 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5516ca-c24f-491e-aeae-3c250613400d None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:40.330834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5516ca-c24f-491e-aeae-3c250613400d None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:40.333104 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5516ca-c24f-491e-aeae-3c250613400d None admin] RBAC: Authorizing `identity:get_project(project_id=66166393e3e0490ea30d39e178525784)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:40.333879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4019045-bccd-4f33-8644-0d337c1737f6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:40.338143 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5516ca-c24f-491e-aeae-3c250613400d None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:40.343921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 84/173] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:40 2022] GET /identity/v3/projects/66166393e3e0490ea30d39e178525784 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:40.345403 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6868e99-34c7-441e-a6a3-e6ea422f4e23 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:40.345683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6868e99-34c7-441e-a6a3-e6ea422f4e23 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:40.345954 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6868e99-34c7-441e-a6a3-e6ea422f4e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:40.369955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-d6868e99-34c7-441e-a6a3-e6ea422f4e23 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:40.371668 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d6868e99-34c7-441e-a6a3-e6ea422f4e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:40.375636 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5069e8-ad91-42d9-8878-d0e60a692770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:40.376874 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5069e8-ad91-42d9-8878-d0e60a692770 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:40.377365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5069e8-ad91-42d9-8878-d0e60a692770 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:40.377845 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5069e8-ad91-42d9-8878-d0e60a692770 None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:40.379245 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5069e8-ad91-42d9-8878-d0e60a692770 None admin] RBAC: Authorizing `identity:get_project(project_id=66166393e3e0490ea30d39e178525784)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:40.380941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5069e8-ad91-42d9-8878-d0e60a692770 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:40.383363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 90/174] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:40 2022] GET /identity/v3/projects/66166393e3e0490ea30d39e178525784 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:40.384411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5069e8-ad91-42d9-8878-d0e60a692770 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:40.467024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 85/175] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:40.467024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595cf07-c40c-4914-a723-e74ec05f8227 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:40.467024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595cf07-c40c-4914-a723-e74ec05f8227 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:40.467024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595cf07-c40c-4914-a723-e74ec05f8227 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:40.467024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 86/176] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:40.467024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595cf07-c40c-4914-a723-e74ec05f8227 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:40.485779 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:40.518513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5069e8-ad91-42d9-8878-d0e60a692770 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:40.559986 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee5998-4591-4f47-87aa-9758faaa75e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:40.560973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee5998-4591-4f47-87aa-9758faaa75e1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:40.561881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee5998-4591-4f47-87aa-9758faaa75e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:40.562373 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee5998-4591-4f47-87aa-9758faaa75e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:40.563527 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee5998-4591-4f47-87aa-9758faaa75e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:40.564204 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee5998-4591-4f47-87aa-9758faaa75e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:40.566000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee5998-4591-4f47-87aa-9758faaa75e1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:40.574693 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 91/177] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:01:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:40.575894 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee5998-4591-4f47-87aa-9758faaa75e1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:40.579916 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595cf07-c40c-4914-a723-e74ec05f8227 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:40.593493 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:40.620667 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb844c-9220-4956-b7c7-1f80bb566442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:40.621513 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb844c-9220-4956-b7c7-1f80bb566442 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:40.621789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb844c-9220-4956-b7c7-1f80bb566442 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:40.622116 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb844c-9220-4956-b7c7-1f80bb566442 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:40.622847 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb844c-9220-4956-b7c7-1f80bb566442 None admin] RBAC: Adding query filter params (role.id=0a020d67ea4d4d62b1305fd0cd952779, scope.project.id=66166393e3e0490ea30d39e178525784, user.id=3e999bbc5d4a4abe863d44cfcf3acf0d) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:40.623246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb844c-9220-4956-b7c7-1f80bb566442 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:40.624677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb844c-9220-4956-b7c7-1f80bb566442 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:40.631103 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 87/178] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:01:40 2022] GET /identity/v3/role_assignments?user.id=3e999bbc5d4a4abe863d44cfcf3acf0d&scope.project.id=66166393e3e0490ea30d39e178525784&role.id=0a020d67ea4d4d62b1305fd0cd952779 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:40.632175 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46ae90-ea9e-4a97-b253-7c95aa2b66f3 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:40.632456 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46ae90-ea9e-4a97-b253-7c95aa2b66f3 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:40.632725 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46ae90-ea9e-4a97-b253-7c95aa2b66f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:40.653085 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-be46ae90-ea9e-4a97-b253-7c95aa2b66f3 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:40.653836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-be46ae90-ea9e-4a97-b253-7c95aa2b66f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:40.730593 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee5998-4591-4f47-87aa-9758faaa75e1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:40.736921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 88/179] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:40.738153 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46ae90-ea9e-4a97-b253-7c95aa2b66f3 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:40.754308 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:40.791853 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1525f0c-422e-4692-a271-d6aa44c760fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:40.792218 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1525f0c-422e-4692-a271-d6aa44c760fe None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:40.792422 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1525f0c-422e-4692-a271-d6aa44c760fe None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:40.792695 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1525f0c-422e-4692-a271-d6aa44c760fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:40.793427 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1525f0c-422e-4692-a271-d6aa44c760fe None admin] RBAC: Adding query filter params (role.id=d9c9200468cb4f7ab6a23882bfb1f062, scope.project.id=66166393e3e0490ea30d39e178525784, user.id=1ade4cba44f6449e9916b370e369e98e) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:40.793731 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1525f0c-422e-4692-a271-d6aa44c760fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:40.796492 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1525f0c-422e-4692-a271-d6aa44c760fe None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:40.802796 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 92/180] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:01:40 2022] GET /identity/v3/role_assignments?user.id=1ade4cba44f6449e9916b370e369e98e&scope.project.id=66166393e3e0490ea30d39e178525784&role.id=d9c9200468cb4f7ab6a23882bfb1f062 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:40.804102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ca6a8-3d0e-4346-895d-7659f2fe4f03 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:40.804475 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ca6a8-3d0e-4346-895d-7659f2fe4f03 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:40.804645 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ca6a8-3d0e-4346-895d-7659f2fe4f03 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:40.806109 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 93/181] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:40.806828 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ca6a8-3d0e-4346-895d-7659f2fe4f03 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:40.877513 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46ae90-ea9e-4a97-b253-7c95aa2b66f3 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:40.925264 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:40.932089 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa7ad6-5425-43fe-8ffc-8b301de31724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:40.933104 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa7ad6-5425-43fe-8ffc-8b301de31724 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:40.933583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa7ad6-5425-43fe-8ffc-8b301de31724 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:40.934006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa7ad6-5425-43fe-8ffc-8b301de31724 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:40.948788 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa7ad6-5425-43fe-8ffc-8b301de31724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:40.954882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-f8fa7ad6-5425-43fe-8ffc-8b301de31724 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:01:40.954882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:40.954882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:40.954882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:40.954882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:40.954882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:40.954882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:40.954882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:40.954882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:40.954882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:40.954882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:40.954882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:40.954882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:40.954882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:40.954882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:40.954882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:40.956061 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:40.956061 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:40.956061 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:40.956061 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:40.956061 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:40.956061 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:40.956061 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:40.956061 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:40.956061 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:40.956061 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:40.956061 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:40.956061 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:40.956061 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:40.956061 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:40.956061 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:40.956061 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:40.956867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:40.956867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:40.956867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:40.956867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:40.956867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:40.956867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:40.956867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:40.956867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:40.956867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:40.956867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:40.956867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:01:40.956867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:01:40.956867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 89/182] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:01:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:40.957541 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa7ad6-5425-43fe-8ffc-8b301de31724 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:40.966117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ca6a8-3d0e-4346-895d-7659f2fe4f03 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:41.012292 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3b702-de57-415d-9921-b043eb08ab34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:41.012937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3b702-de57-415d-9921-b043eb08ab34 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:41.013214 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3b702-de57-415d-9921-b043eb08ab34 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:41.013488 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3b702-de57-415d-9921-b043eb08ab34 None admin] PATH_INFO: `/v3/users/3e999bbc5d4a4abe863d44cfcf3acf0d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:41.014627 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3b702-de57-415d-9921-b043eb08ab34 None admin] RBAC: Authorizing `identity:get_user(user_id=3e999bbc5d4a4abe863d44cfcf3acf0d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:41.016147 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3b702-de57-415d-9921-b043eb08ab34 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:41.017775 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 94/183] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:40 2022] GET /identity/v3/users/3e999bbc5d4a4abe863d44cfcf3acf0d => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:41.018897 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910bb5d-227d-4405-acee-b3c7cfe8e37b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:41.019212 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910bb5d-227d-4405-acee-b3c7cfe8e37b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:41.019469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910bb5d-227d-4405-acee-b3c7cfe8e37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:41.039394 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8910bb5d-227d-4405-acee-b3c7cfe8e37b None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:41.041023 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8910bb5d-227d-4405-acee-b3c7cfe8e37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:41.058272 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:41.083197 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa7ad6-5425-43fe-8ffc-8b301de31724 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:41.108981 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 95/184] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:41.110048 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb401d8-948e-4dac-9cb6-867da0aa2476 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:41.110336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb401d8-948e-4dac-9cb6-867da0aa2476 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:41.110613 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb401d8-948e-4dac-9cb6-867da0aa2476 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:41.111898 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 96/185] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:41.116612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb401d8-948e-4dac-9cb6-867da0aa2476 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:41.118298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63437d-faa3-4b84-9a24-4baa4a2f00ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:41.119223 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63437d-faa3-4b84-9a24-4baa4a2f00ff None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:41.119708 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63437d-faa3-4b84-9a24-4baa4a2f00ff None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:41.120189 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63437d-faa3-4b84-9a24-4baa4a2f00ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:41.130525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63437d-faa3-4b84-9a24-4baa4a2f00ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:41.135298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-7d63437d-faa3-4b84-9a24-4baa4a2f00ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 13:01:41.135298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:41.135298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:41.135298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:41.135298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:41.135298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:41.135298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:41.135298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:41.135298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:41.135298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:41.135298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:41.135298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:41.135298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:41.135298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:41.135298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:41.135298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:41.136350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:41.136350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:41.136350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:41.136350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:41.136350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:41.136350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:41.136350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:41.136350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:41.136350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:41.136350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:41.136350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:41.136350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:41.136350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:41.136350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:41.136350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:41.136350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:41.142106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:41.142106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:41.142106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:41.142106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:41.142106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:41.142106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:41.142106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:41.142106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:41.142106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:41.142106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:41.142106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 13:01:41.142106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:01:41.142106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 90/186] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:41.142106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63437d-faa3-4b84-9a24-4baa4a2f00ff None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:41.196917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:41.232982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb401d8-948e-4dac-9cb6-867da0aa2476 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:41.243115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63437d-faa3-4b84-9a24-4baa4a2f00ff None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:41.267733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe24fa-1310-48bc-98d1-18c21cf3544d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:41.268335 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe24fa-1310-48bc-98d1-18c21cf3544d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:41.268615 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe24fa-1310-48bc-98d1-18c21cf3544d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:41.268887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe24fa-1310-48bc-98d1-18c21cf3544d None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:41.269547 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe24fa-1310-48bc-98d1-18c21cf3544d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:41.269849 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe24fa-1310-48bc-98d1-18c21cf3544d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:41.271167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:41.271274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe24fa-1310-48bc-98d1-18c21cf3544d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:41.278012 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6256dd6-fdb9-45d7-9056-58e318df0d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:41.278610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6256dd6-fdb9-45d7-9056-58e318df0d5a None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:41.278888 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6256dd6-fdb9-45d7-9056-58e318df0d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:41.279182 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6256dd6-fdb9-45d7-9056-58e318df0d5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:41.280168 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 97/187] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:41.281458 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3269544-c427-4cb0-8da1-7df594d56548 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:41.281810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3269544-c427-4cb0-8da1-7df594d56548 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:41.282179 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3269544-c427-4cb0-8da1-7df594d56548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:41.300846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e3269544-c427-4cb0-8da1-7df594d56548 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:41.301982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e3269544-c427-4cb0-8da1-7df594d56548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:41.347410 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6256dd6-fdb9-45d7-9056-58e318df0d5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:41.348857 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6256dd6-fdb9-45d7-9056-58e318df0d5a None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:41.368633 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 98/188] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:41.369471 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3269544-c427-4cb0-8da1-7df594d56548 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:41.428313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:41.449167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 91/189] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:01:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:41.450235 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6256dd6-fdb9-45d7-9056-58e318df0d5a None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:41.472099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3269544-c427-4cb0-8da1-7df594d56548 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:41.480358 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:41.507622 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9fd22-93c0-443d-b121-97e0e72e4604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:41.508360 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9fd22-93c0-443d-b121-97e0e72e4604 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:41.508640 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9fd22-93c0-443d-b121-97e0e72e4604 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:41.508913 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9fd22-93c0-443d-b121-97e0e72e4604 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:41.520095 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9fd22-93c0-443d-b121-97e0e72e4604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:41.526612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-03e9fd22-93c0-443d-b121-97e0e72e4604 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:01:41.526612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:41.526612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:41.526612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:41.526612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:41.526612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:41.526612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:41.526612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:41.526612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:41.526612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:41.526612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:41.526612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:41.526612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:41.526612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:41.526612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:41.526612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:41.527554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:41.527554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:41.527554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:41.527554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:41.527554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:41.527554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:41.527554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:41.527554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:41.527554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:41.527554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:41.527554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:41.527554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:41.527554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:41.527554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:41.527554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:41.527554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:41.528378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:41.528378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:41.528378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:41.528378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:41.528378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:41.528378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:41.528378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:41.528378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:41.528378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:41.528378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:41.528378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:01:41.528378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:01:41.528378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 99/190] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 10 13:01:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:41.529140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9fd22-93c0-443d-b121-97e0e72e4604 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:41.560845 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6256dd6-fdb9-45d7-9056-58e318df0d5a None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:41.595444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb98862-f901-440b-ac36-b19ff3b04f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:41.596054 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb98862-f901-440b-ac36-b19ff3b04f93 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:41.596329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb98862-f901-440b-ac36-b19ff3b04f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:41.596630 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb98862-f901-440b-ac36-b19ff3b04f93 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:41.597300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb98862-f901-440b-ac36-b19ff3b04f93 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:41.597593 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb98862-f901-440b-ac36-b19ff3b04f93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:41.598981 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb98862-f901-440b-ac36-b19ff3b04f93 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:41.607526 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 92/191] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:01:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:41.608326 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb98862-f901-440b-ac36-b19ff3b04f93 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:41.636140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9fd22-93c0-443d-b121-97e0e72e4604 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:41.659422 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:41.671813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70c0ab-010e-404e-aac4-836fb29c73c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:41.672441 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70c0ab-010e-404e-aac4-836fb29c73c6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:41.672718 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70c0ab-010e-404e-aac4-836fb29c73c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:41.672994 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70c0ab-010e-404e-aac4-836fb29c73c6 None admin] PATH_INFO: `/v3/users/886b53f516ec477abff1f988eff16281` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:41.686865 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70c0ab-010e-404e-aac4-836fb29c73c6 None admin] RBAC: Authorizing `identity:get_user(user_id=886b53f516ec477abff1f988eff16281)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:41.688283 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70c0ab-010e-404e-aac4-836fb29c73c6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:41.689912 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 100/192] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:41 2022] GET /identity/v3/users/886b53f516ec477abff1f988eff16281 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:41.690678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70c0ab-010e-404e-aac4-836fb29c73c6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:41.700929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:41.710053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb98862-f901-440b-ac36-b19ff3b04f93 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:41.744697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30577282-3d34-4910-8cdf-69e67824ae2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:41.745333 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30577282-3d34-4910-8cdf-69e67824ae2c None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:41.745610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30577282-3d34-4910-8cdf-69e67824ae2c None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:41.745881 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30577282-3d34-4910-8cdf-69e67824ae2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:41.747042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30577282-3d34-4910-8cdf-69e67824ae2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:41.748497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30577282-3d34-4910-8cdf-69e67824ae2c None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:41.750085 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 93/193] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:01:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:41.750823 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30577282-3d34-4910-8cdf-69e67824ae2c None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:41.793842 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70c0ab-010e-404e-aac4-836fb29c73c6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:41.829444 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68fe8a-1ec2-47e2-ab24-d91904b0830a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:41.830076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68fe8a-1ec2-47e2-ab24-d91904b0830a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:41.830355 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68fe8a-1ec2-47e2-ab24-d91904b0830a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:41.830630 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68fe8a-1ec2-47e2-ab24-d91904b0830a None admin] PATH_INFO: `/v3/projects/d8c9d9f0198e42e3b6f246fbc1d41e7c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:41.831785 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68fe8a-1ec2-47e2-ab24-d91904b0830a None admin] RBAC: Authorizing `identity:get_project(project_id=d8c9d9f0198e42e3b6f246fbc1d41e7c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:41.833333 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68fe8a-1ec2-47e2-ab24-d91904b0830a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:41.834844 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 101/194] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:41 2022] GET /identity/v3/projects/d8c9d9f0198e42e3b6f246fbc1d41e7c => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:41.836123 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68fe8a-1ec2-47e2-ab24-d91904b0830a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:41.857906 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30577282-3d34-4910-8cdf-69e67824ae2c None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:41.885076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:41.893031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdb112-56fb-4c3e-be08-a5bf63d24f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:41.893645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdb112-56fb-4c3e-be08-a5bf63d24f42 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:41.893928 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdb112-56fb-4c3e-be08-a5bf63d24f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:41.894199 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdb112-56fb-4c3e-be08-a5bf63d24f42 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:41.894855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdb112-56fb-4c3e-be08-a5bf63d24f42 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:41.895183 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdb112-56fb-4c3e-be08-a5bf63d24f42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:41.896557 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdb112-56fb-4c3e-be08-a5bf63d24f42 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:41.905480 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 94/195] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:01:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:41.905480 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdb112-56fb-4c3e-be08-a5bf63d24f42 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:41.930579 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:41.936997 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68fe8a-1ec2-47e2-ab24-d91904b0830a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:41.970563 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd43fc-1283-4c8a-9b0f-cca0261021ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:41.971211 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd43fc-1283-4c8a-9b0f-cca0261021ba None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:41.971491 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd43fc-1283-4c8a-9b0f-cca0261021ba None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:41.971761 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd43fc-1283-4c8a-9b0f-cca0261021ba None admin] PATH_INFO: `/v3/users/cdf37649a32840a2a68be3a46014c762` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:41.972889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd43fc-1283-4c8a-9b0f-cca0261021ba None admin] RBAC: Authorizing `identity:get_user(user_id=cdf37649a32840a2a68be3a46014c762)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:41.974349 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd43fc-1283-4c8a-9b0f-cca0261021ba None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:41.976568 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 102/196] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:41 2022] GET /identity/v3/users/cdf37649a32840a2a68be3a46014c762 => generated 289 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:41.977351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd43fc-1283-4c8a-9b0f-cca0261021ba None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:42.011212 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdb112-56fb-4c3e-be08-a5bf63d24f42 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:42.046838 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3039668-58f9-4075-8736-552937440391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:42.047500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3039668-58f9-4075-8736-552937440391 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:42.047779 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3039668-58f9-4075-8736-552937440391 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:42.048046 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3039668-58f9-4075-8736-552937440391 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:42.079637 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd43fc-1283-4c8a-9b0f-cca0261021ba None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:42.099039 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:42.117131 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5248ffc-1dea-41e6-a290-56df1799f3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:42.117411 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3039668-58f9-4075-8736-552937440391 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:42.117727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5248ffc-1dea-41e6-a290-56df1799f3ad None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:42.118003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5248ffc-1dea-41e6-a290-56df1799f3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:42.118267 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5248ffc-1dea-41e6-a290-56df1799f3ad None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:42.118874 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3039668-58f9-4075-8736-552937440391 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:42.118970 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5248ffc-1dea-41e6-a290-56df1799f3ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:42.120356 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5248ffc-1dea-41e6-a290-56df1799f3ad None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:42.141714 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 103/197] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 10 13:01:41 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:01:42.144379 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5248ffc-1dea-41e6-a290-56df1799f3ad None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:42.155410 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:42.231827 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 95/198] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:01:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:42.232612 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3039668-58f9-4075-8736-552937440391 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:42.269985 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5248ffc-1dea-41e6-a290-56df1799f3ad None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:42.310368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe86943-d5e3-40ce-aeaf-8cfeed14bdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:42.310572 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe86943-d5e3-40ce-aeaf-8cfeed14bdc5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:42.310799 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe86943-d5e3-40ce-aeaf-8cfeed14bdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:42.311094 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe86943-d5e3-40ce-aeaf-8cfeed14bdc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:42.311866 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe86943-d5e3-40ce-aeaf-8cfeed14bdc5 None admin] RBAC: Adding query filter params (role.id=2223c0caa0c948abbe85384d16a465a2, scope.project.id=d8c9d9f0198e42e3b6f246fbc1d41e7c, user.id=3e999bbc5d4a4abe863d44cfcf3acf0d) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:42.312165 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe86943-d5e3-40ce-aeaf-8cfeed14bdc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:42.313723 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe86943-d5e3-40ce-aeaf-8cfeed14bdc5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:42.321350 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 104/199] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:01:42 2022] GET /identity/v3/role_assignments?user.id=3e999bbc5d4a4abe863d44cfcf3acf0d&scope.project.id=d8c9d9f0198e42e3b6f246fbc1d41e7c&role.id=2223c0caa0c948abbe85384d16a465a2 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:42.322232 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe86943-d5e3-40ce-aeaf-8cfeed14bdc5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:42.362933 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3039668-58f9-4075-8736-552937440391 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:42.373767 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:42.399187 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:42.421859 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64feec-1ac5-4c2d-8491-ff6bd072d81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:42.421859 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64feec-1ac5-4c2d-8491-ff6bd072d81d None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:42.421859 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64feec-1ac5-4c2d-8491-ff6bd072d81d None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:42.421859 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64feec-1ac5-4c2d-8491-ff6bd072d81d None admin] PATH_INFO: `/v3/users/886b53f516ec477abff1f988eff16281` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:42.423177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64feec-1ac5-4c2d-8491-ff6bd072d81d None admin] RBAC: Authorizing `identity:get_user(user_id=886b53f516ec477abff1f988eff16281)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:42.426497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64feec-1ac5-4c2d-8491-ff6bd072d81d None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:42.426497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 96/200] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:42 2022] GET /identity/v3/users/886b53f516ec477abff1f988eff16281 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:42.427347 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64feec-1ac5-4c2d-8491-ff6bd072d81d None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:42.461277 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe86943-d5e3-40ce-aeaf-8cfeed14bdc5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:42.511257 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770e7e8-04f5-41b7-a0b8-680794d7c033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:42.511882 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770e7e8-04f5-41b7-a0b8-680794d7c033 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:42.512163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770e7e8-04f5-41b7-a0b8-680794d7c033 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:42.512434 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770e7e8-04f5-41b7-a0b8-680794d7c033 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:42.573309 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64feec-1ac5-4c2d-8491-ff6bd072d81d None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:42.624420 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770e7e8-04f5-41b7-a0b8-680794d7c033 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:42.625998 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770e7e8-04f5-41b7-a0b8-680794d7c033 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:42.630352 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91abb8-d4ba-4f09-a512-d048cf2989b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:42.630993 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91abb8-d4ba-4f09-a512-d048cf2989b0 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:42.631342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91abb8-d4ba-4f09-a512-d048cf2989b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:42.631617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91abb8-d4ba-4f09-a512-d048cf2989b0 None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:42.632826 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91abb8-d4ba-4f09-a512-d048cf2989b0 None admin] RBAC: Authorizing `identity:get_project(project_id=68df1934bba847eeaf81f0f154f6edd1)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:42.634393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91abb8-d4ba-4f09-a512-d048cf2989b0 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:42.636105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 97/201] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:42 2022] GET /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:42.637069 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91abb8-d4ba-4f09-a512-d048cf2989b0 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:42.673510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:42.703683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:42.742948 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 105/202] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:01:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:42.743936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770e7e8-04f5-41b7-a0b8-680794d7c033 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:42.750159 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91abb8-d4ba-4f09-a512-d048cf2989b0 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:42.788573 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb20e3d-7cc3-4e88-b673-73a248ab3420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:42.789336 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb20e3d-7cc3-4e88-b673-73a248ab3420 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:42.789683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb20e3d-7cc3-4e88-b673-73a248ab3420 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:42.790027 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb20e3d-7cc3-4e88-b673-73a248ab3420 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:42.855997 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770e7e8-04f5-41b7-a0b8-680794d7c033 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:42.865197 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb20e3d-7cc3-4e88-b673-73a248ab3420 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:42.866943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb20e3d-7cc3-4e88-b673-73a248ab3420 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:42.893711 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8b5f2-e9eb-4f1d-a9c7-139c974f2224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:42.894591 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8b5f2-e9eb-4f1d-a9c7-139c974f2224 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:42.894879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8b5f2-e9eb-4f1d-a9c7-139c974f2224 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:42.895182 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8b5f2-e9eb-4f1d-a9c7-139c974f2224 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:42.896175 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8b5f2-e9eb-4f1d-a9c7-139c974f2224 None admin] RBAC: Adding query filter params (role.id=d9c9200468cb4f7ab6a23882bfb1f062, scope.project.id=68df1934bba847eeaf81f0f154f6edd1, user.id=886b53f516ec477abff1f988eff16281) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:42.896906 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8b5f2-e9eb-4f1d-a9c7-139c974f2224 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:42.899460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8b5f2-e9eb-4f1d-a9c7-139c974f2224 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:42.907228 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 106/203] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:01:42 2022] GET /identity/v3/role_assignments?user.id=886b53f516ec477abff1f988eff16281&scope.project.id=68df1934bba847eeaf81f0f154f6edd1&role.id=d9c9200468cb4f7ab6a23882bfb1f062 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:42.907885 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8b5f2-e9eb-4f1d-a9c7-139c974f2224 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:42.917643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:42.959395 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:43.049953 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 98/204] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:01:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:43.066286 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb20e3d-7cc3-4e88-b673-73a248ab3420 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:43.096774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8b5f2-e9eb-4f1d-a9c7-139c974f2224 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:43.133402 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8d3bb-987f-4a86-b7b1-97c38ecb3cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:43.134047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8d3bb-987f-4a86-b7b1-97c38ecb3cde None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:43.134332 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8d3bb-987f-4a86-b7b1-97c38ecb3cde None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:43.134613 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8d3bb-987f-4a86-b7b1-97c38ecb3cde None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:43.135790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8d3bb-987f-4a86-b7b1-97c38ecb3cde None admin] RBAC: Authorizing `identity:get_project(project_id=66166393e3e0490ea30d39e178525784)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:43.137405 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8d3bb-987f-4a86-b7b1-97c38ecb3cde None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:43.139152 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 107/205] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:42 2022] GET /identity/v3/projects/66166393e3e0490ea30d39e178525784 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:43.146759 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8d3bb-987f-4a86-b7b1-97c38ecb3cde None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:43.208705 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb20e3d-7cc3-4e88-b673-73a248ab3420 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:43.257006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8d3bb-987f-4a86-b7b1-97c38ecb3cde None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:43.259722 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:43.281531 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea218ab8-4fda-4ecf-bfa4-16009fa9a76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:43.282189 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea218ab8-4fda-4ecf-bfa4-16009fa9a76b None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:43.282464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea218ab8-4fda-4ecf-bfa4-16009fa9a76b None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:43.282735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea218ab8-4fda-4ecf-bfa4-16009fa9a76b None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:43.286982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea218ab8-4fda-4ecf-bfa4-16009fa9a76b None admin] RBAC: Authorizing `identity:get_project(project_id=68df1934bba847eeaf81f0f154f6edd1)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:43.290320 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea218ab8-4fda-4ecf-bfa4-16009fa9a76b None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:43.293526 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 99/206] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:43 2022] GET /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:01:43.300079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea218ab8-4fda-4ecf-bfa4-16009fa9a76b None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:43.311705 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d913d0-4db5-4f10-8271-e5d93878e519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:43.312430 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d913d0-4db5-4f10-8271-e5d93878e519 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:43.312780 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d913d0-4db5-4f10-8271-e5d93878e519 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:43.313063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d913d0-4db5-4f10-8271-e5d93878e519 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:43.313899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d913d0-4db5-4f10-8271-e5d93878e519 None admin] RBAC: Adding query filter params (role.id=78d0cc90d2f2496b9c3e75bb0ddf0c6d, scope.project.id=66166393e3e0490ea30d39e178525784, user.id=cdf37649a32840a2a68be3a46014c762) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:43.314219 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d913d0-4db5-4f10-8271-e5d93878e519 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:43.315750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d913d0-4db5-4f10-8271-e5d93878e519 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:43.322652 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 108/207] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:01:43 2022] GET /identity/v3/role_assignments?user.id=cdf37649a32840a2a68be3a46014c762&scope.project.id=66166393e3e0490ea30d39e178525784&role.id=78d0cc90d2f2496b9c3e75bb0ddf0c6d => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:43.373614 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:43.472782 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea218ab8-4fda-4ecf-bfa4-16009fa9a76b None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:43.508754 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800ebff-f1f7-410a-85ae-64a9251cfd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:43.509363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800ebff-f1f7-410a-85ae-64a9251cfd06 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:43.509637 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800ebff-f1f7-410a-85ae-64a9251cfd06 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:43.509905 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800ebff-f1f7-410a-85ae-64a9251cfd06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:43.510636 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800ebff-f1f7-410a-85ae-64a9251cfd06 None admin] RBAC: Adding query filter params (role.id=0a020d67ea4d4d62b1305fd0cd952779, scope.project.id=68df1934bba847eeaf81f0f154f6edd1, user.id=886b53f516ec477abff1f988eff16281) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:43.510941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800ebff-f1f7-410a-85ae-64a9251cfd06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:43.512478 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800ebff-f1f7-410a-85ae-64a9251cfd06 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:43.518895 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 100/208] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:01:43 2022] GET /identity/v3/role_assignments?user.id=886b53f516ec477abff1f988eff16281&scope.project.id=68df1934bba847eeaf81f0f154f6edd1&role.id=0a020d67ea4d4d62b1305fd0cd952779 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:44.530764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459dc73-c08c-41bf-96cc-418711d552aa None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:44.531359 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459dc73-c08c-41bf-96cc-418711d552aa None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:44.531359 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459dc73-c08c-41bf-96cc-418711d552aa None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:44.532698 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 109/209] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:44.538585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e82ec-21f0-480a-a505-d1667ea30cbb None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:44.539334 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e82ec-21f0-480a-a505-d1667ea30cbb None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:44.539774 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e82ec-21f0-480a-a505-d1667ea30cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:44.558604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-1f7e82ec-21f0-480a-a505-d1667ea30cbb None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:44.560056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-1f7e82ec-21f0-480a-a505-d1667ea30cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:44.583239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb83dd5-bc67-44ef-bec0-f78ac1af7878 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:44.583843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb83dd5-bc67-44ef-bec0-f78ac1af7878 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:44.584337 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb83dd5-bc67-44ef-bec0-f78ac1af7878 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:44.586738 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 110/210] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:44.592043 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064fedb-24eb-42b7-af0b-3efc1dc4dffe None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:44.592606 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064fedb-24eb-42b7-af0b-3efc1dc4dffe None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:44.593082 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064fedb-24eb-42b7-af0b-3efc1dc4dffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:44.611319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b064fedb-24eb-42b7-af0b-3efc1dc4dffe None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:44.612885 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b064fedb-24eb-42b7-af0b-3efc1dc4dffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:44.643057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 101/211] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:01:44.663298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e82ec-21f0-480a-a505-d1667ea30cbb None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:44.690818 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:44.693234 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 111/212] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:01:44.717324 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064fedb-24eb-42b7-af0b-3efc1dc4dffe None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:44.785024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e82ec-21f0-480a-a505-d1667ea30cbb None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:44.785571 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:44.826958 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bde630-9374-45f1-9a92-0c948ee4d30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:44.827998 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bde630-9374-45f1-9a92-0c948ee4d30c None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:44.828477 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bde630-9374-45f1-9a92-0c948ee4d30c None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:44.828678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064fedb-24eb-42b7-af0b-3efc1dc4dffe None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:44.829139 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bde630-9374-45f1-9a92-0c948ee4d30c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:44.841214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bde630-9374-45f1-9a92-0c948ee4d30c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:44.846598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-92bde630-9374-45f1-9a92-0c948ee4d30c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:44.846598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:44.846598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:44.846598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:44.846598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:44.846598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:44.846598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:44.846598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:44.846598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:44.846598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:44.846598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:44.846598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:44.846598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:44.846598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:44.846598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:44.846598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:44.847546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:44.847546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:44.847546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:44.847546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:44.847546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:44.847546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:44.847546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:44.847546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:44.847546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:44.847546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:44.847546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:44.847546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:44.847546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:44.847546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:44.847546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:44.847546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:44.848379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:44.848379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:44.848379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:44.848379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:44.848379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:44.848379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:44.848379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:44.848379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:44.848379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:44.848379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:44.848379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:44.848379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:01:44.851262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 102/213] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:01:44.857586 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bde630-9374-45f1-9a92-0c948ee4d30c None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:44.877058 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8c207-ccde-4e83-b860-67f2e92de5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:44.878129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8c207-ccde-4e83-b860-67f2e92de5db None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:44.878614 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8c207-ccde-4e83-b860-67f2e92de5db None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:44.879153 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8c207-ccde-4e83-b860-67f2e92de5db None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:44.880476 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b8c207-ccde-4e83-b860-67f2e92de5db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:44.882139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b8c207-ccde-4e83-b860-67f2e92de5db None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:44.884056 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 112/214] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:01:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:01:44.889517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8c207-ccde-4e83-b860-67f2e92de5db None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:44.967210 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:44.992115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bde630-9374-45f1-9a92-0c948ee4d30c None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:45.007784 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8c207-ccde-4e83-b860-67f2e92de5db None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:45.035744 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97527851-fca3-4a9f-a251-d4cb3a602125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:45.036272 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97527851-fca3-4a9f-a251-d4cb3a602125 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:45.036549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97527851-fca3-4a9f-a251-d4cb3a602125 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:45.036821 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97527851-fca3-4a9f-a251-d4cb3a602125 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:45.037491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97527851-fca3-4a9f-a251-d4cb3a602125 None admin] RBAC: Adding query filter params (name=member) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:45.037777 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97527851-fca3-4a9f-a251-d4cb3a602125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:45.039757 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97527851-fca3-4a9f-a251-d4cb3a602125 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:45.042766 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:45.049100 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431a87b-e485-449b-b92a-ca978f89b22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:45.054134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 103/215] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:01:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:01:45.054263 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431a87b-e485-449b-b92a-ca978f89b22a None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:45.054263 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431a87b-e485-449b-b92a-ca978f89b22a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:45.054263 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431a87b-e485-449b-b92a-ca978f89b22a None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:45.054263 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431a87b-e485-449b-b92a-ca978f89b22a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:45.054263 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431a87b-e485-449b-b92a-ca978f89b22a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:45.056005 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97527851-fca3-4a9f-a251-d4cb3a602125 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:45.082517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 113/216] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 10 13:01:44 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:01:45.182876 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19577437-53bf-49f5-a40d-cc2719085db0 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:45.183385 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19577437-53bf-49f5-a40d-cc2719085db0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:45.183762 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19577437-53bf-49f5-a40d-cc2719085db0 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:45.184573 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97527851-fca3-4a9f-a251-d4cb3a602125 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:45.185396 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 114/217] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:01:45.190927 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddcfe5-4b2d-4e0f-bd5a-6b4a079f3445 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:45.191350 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddcfe5-4b2d-4e0f-bd5a-6b4a079f3445 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:45.191735 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddcfe5-4b2d-4e0f-bd5a-6b4a079f3445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:45.211029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-83ddcfe5-4b2d-4e0f-bd5a-6b4a079f3445 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:45.212406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-83ddcfe5-4b2d-4e0f-bd5a-6b4a079f3445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:45.234016 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd98525-3371-4ded-95f1-b5b3c56425c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:45.234963 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd98525-3371-4ded-95f1-b5b3c56425c9 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:45.235269 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd98525-3371-4ded-95f1-b5b3c56425c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:45.235536 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd98525-3371-4ded-95f1-b5b3c56425c9 None admin] PATH_INFO: `/v3/users/918fa96b48e24fbb9f3f25a639e2759e` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:45.255181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:45.257401 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd98525-3371-4ded-95f1-b5b3c56425c9 None admin] RBAC: Authorizing `identity:get_user(user_id=918fa96b48e24fbb9f3f25a639e2759e)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:45.259511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd98525-3371-4ded-95f1-b5b3c56425c9 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:45.261686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 104/218] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:45 2022] GET /identity/v3/users/918fa96b48e24fbb9f3f25a639e2759e => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:01:45.267605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd98525-3371-4ded-95f1-b5b3c56425c9 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:45.290592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 115/219] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:45.313307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ddcfe5-4b2d-4e0f-bd5a-6b4a079f3445 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:45.395664 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd98525-3371-4ded-95f1-b5b3c56425c9 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:45.443403 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ddcfe5-4b2d-4e0f-bd5a-6b4a079f3445 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:45.445504 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2660f2-1976-4ec8-b05a-c9ae94502b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:45.446960 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2660f2-1976-4ec8-b05a-c9ae94502b7b None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:45.447265 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2660f2-1976-4ec8-b05a-c9ae94502b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:45.447549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2660f2-1976-4ec8-b05a-c9ae94502b7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:45.475375 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:45.496548 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c9586-c383-46db-a20e-6e2431c71c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:45.497587 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c9586-c383-46db-a20e-6e2431c71c69 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:45.498082 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c9586-c383-46db-a20e-6e2431c71c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:45.498551 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c9586-c383-46db-a20e-6e2431c71c69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:45.514330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c9586-c383-46db-a20e-6e2431c71c69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:45.521679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-553c9586-c383-46db-a20e-6e2431c71c69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:01:45.521679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:45.521679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:45.521679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:45.521679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:45.521679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:45.521679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:45.521679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:45.521679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:45.521679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:45.521679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:45.521679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:45.521679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:45.521679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:45.521679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:45.521679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:45.523259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:45.523259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:45.523259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:45.523259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:45.523259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:45.523259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:45.523259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:45.523259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:45.523259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:45.523259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:45.523259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:45.523259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:45.523259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:45.523259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:45.523259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:45.523259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:45.524051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:45.524051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:45.524051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:45.524051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:45.524051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:45.524051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:45.524051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:45.524051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:45.524051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:45.524051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:45.524051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:01:45.524051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:01:45.524651 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 116/220] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:01:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:01:45.531521 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c9586-c383-46db-a20e-6e2431c71c69 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:45.538257 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:45.540515 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2660f2-1976-4ec8-b05a-c9ae94502b7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:45.542776 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2660f2-1976-4ec8-b05a-c9ae94502b7b None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:45.641684 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c9586-c383-46db-a20e-6e2431c71c69 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:45.646767 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 105/221] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:01:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:45.662412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2660f2-1976-4ec8-b05a-c9ae94502b7b None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:45.685590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48befe55-f0b9-4640-a6de-d8a88888f75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:45.686197 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48befe55-f0b9-4640-a6de-d8a88888f75c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:45.686489 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48befe55-f0b9-4640-a6de-d8a88888f75c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:45.686771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48befe55-f0b9-4640-a6de-d8a88888f75c None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:45.695026 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48befe55-f0b9-4640-a6de-d8a88888f75c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:45.695026 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48befe55-f0b9-4640-a6de-d8a88888f75c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:45.695026 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48befe55-f0b9-4640-a6de-d8a88888f75c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:45.702448 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 117/222] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:45.703720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48befe55-f0b9-4640-a6de-d8a88888f75c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:45.748385 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:45.788702 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2660f2-1976-4ec8-b05a-c9ae94502b7b None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:45.790353 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:45.811948 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48befe55-f0b9-4640-a6de-d8a88888f75c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:45.825045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f90de-0292-4cc7-8815-117de7ae61f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:45.825687 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f90de-0292-4cc7-8815-117de7ae61f7 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:45.825964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f90de-0292-4cc7-8815-117de7ae61f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:45.826237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f90de-0292-4cc7-8815-117de7ae61f7 None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:45.827432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f90de-0292-4cc7-8815-117de7ae61f7 None admin] RBAC: Authorizing `identity:get_project(project_id=68df1934bba847eeaf81f0f154f6edd1)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:45.828893 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f90de-0292-4cc7-8815-117de7ae61f7 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:45.830837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 106/223] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:45 2022] GET /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:45.832116 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed59bd-fca2-4b20-a533-c2fa404d58e7 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:45.832394 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed59bd-fca2-4b20-a533-c2fa404d58e7 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:45.832662 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed59bd-fca2-4b20-a533-c2fa404d58e7 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:45.833870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 107/224] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:45.840750 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed59bd-fca2-4b20-a533-c2fa404d58e7 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:45.858956 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcac01-d97c-44e7-a220-c530a34f1a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:45.860529 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcac01-d97c-44e7-a220-c530a34f1a77 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:45.860984 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcac01-d97c-44e7-a220-c530a34f1a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:45.861494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcac01-d97c-44e7-a220-c530a34f1a77 None admin] PATH_INFO: `/v3/users/886b53f516ec477abff1f988eff16281` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:45.862976 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcac01-d97c-44e7-a220-c530a34f1a77 None admin] RBAC: Authorizing `identity:get_user(user_id=886b53f516ec477abff1f988eff16281)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:45.864688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcac01-d97c-44e7-a220-c530a34f1a77 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:45.867226 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 118/225] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:45 2022] GET /identity/v3/users/886b53f516ec477abff1f988eff16281 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:01:45.873498 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a1e5e-8fe2-45a3-b083-dfb9a0da8fca None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:45.874015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a1e5e-8fe2-45a3-b083-dfb9a0da8fca None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:45.874482 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a1e5e-8fe2-45a3-b083-dfb9a0da8fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:45.895084 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e54a1e5e-8fe2-45a3-b083-dfb9a0da8fca None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:45.896561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e54a1e5e-8fe2-45a3-b083-dfb9a0da8fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:45.962336 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed59bd-fca2-4b20-a533-c2fa404d58e7 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:46.003106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80824ed5-e202-4654-acf2-4dc0d7c12fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:46.003762 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80824ed5-e202-4654-acf2-4dc0d7c12fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:46.004065 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 119/226] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:46.004196 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80824ed5-e202-4654-acf2-4dc0d7c12fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:46.004436 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80824ed5-e202-4654-acf2-4dc0d7c12fb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:46.005233 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80824ed5-e202-4654-acf2-4dc0d7c12fb5 None admin] RBAC: Adding query filter params (role.id=2223c0caa0c948abbe85384d16a465a2, scope.project.id=68df1934bba847eeaf81f0f154f6edd1, user.id=918fa96b48e24fbb9f3f25a639e2759e) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:46.005614 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80824ed5-e202-4654-acf2-4dc0d7c12fb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:46.006402 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a1e5e-8fe2-45a3-b083-dfb9a0da8fca None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:46.007348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80824ed5-e202-4654-acf2-4dc0d7c12fb5 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:46.014003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 108/227] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:01:45 2022] GET /identity/v3/role_assignments?user.id=918fa96b48e24fbb9f3f25a639e2759e&scope.project.id=68df1934bba847eeaf81f0f154f6edd1&role.id=2223c0caa0c948abbe85384d16a465a2 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:46.072198 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80824ed5-e202-4654-acf2-4dc0d7c12fb5 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:46.076478 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:46.131175 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:46.145538 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a1e5e-8fe2-45a3-b083-dfb9a0da8fca None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:46.234329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80824ed5-e202-4654-acf2-4dc0d7c12fb5 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:46.237331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c6946-8235-4989-8da8-abdd1e28f7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:46.238295 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c6946-8235-4989-8da8-abdd1e28f7bc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:46.238747 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c6946-8235-4989-8da8-abdd1e28f7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:46.239204 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c6946-8235-4989-8da8-abdd1e28f7bc None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:46.240678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c6946-8235-4989-8da8-abdd1e28f7bc None admin] RBAC: Authorizing `identity:get_project(project_id=68df1934bba847eeaf81f0f154f6edd1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:46.242834 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c6946-8235-4989-8da8-abdd1e28f7bc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:46.245529 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 120/228] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:46 2022] GET /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:46.250763 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c6946-8235-4989-8da8-abdd1e28f7bc None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:46.296323 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6918898-48cb-451a-b4bb-c8e4f3282e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:46.298064 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6918898-48cb-451a-b4bb-c8e4f3282e1b None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:46.298064 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6918898-48cb-451a-b4bb-c8e4f3282e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:46.298064 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6918898-48cb-451a-b4bb-c8e4f3282e1b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:46.309232 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6918898-48cb-451a-b4bb-c8e4f3282e1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:46.314648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-c6918898-48cb-451a-b4bb-c8e4f3282e1b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:01:46.314648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:46.314648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:46.314648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:46.314648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:46.314648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:46.314648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:46.314648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:46.314648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:46.314648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:46.314648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:46.314648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:46.314648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:46.314648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:46.314648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:46.314648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:46.315714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:46.315714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:46.315714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:46.315714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:46.315714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:46.315714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:46.315714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:46.315714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:46.315714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:46.315714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:46.315714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:46.315714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:46.315714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:46.315714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:46.315714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:46.315714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:46.316692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:46.316692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:46.316692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:46.316692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:46.316692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:46.316692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:46.316692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:46.316692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:46.316692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:46.316692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:46.316692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:01:46.316692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:01:46.318859 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 109/229] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 10 13:01:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:46.327988 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6918898-48cb-451a-b4bb-c8e4f3282e1b None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:46.386833 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c6946-8235-4989-8da8-abdd1e28f7bc None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:46.419586 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:46.433095 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ee924-6221-401f-bce6-6610206258e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:46.433800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ee924-6221-401f-bce6-6610206258e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:46.434087 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ee924-6221-401f-bce6-6610206258e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:46.434364 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ee924-6221-401f-bce6-6610206258e3 None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1/users/886b53f516ec477abff1f988eff16281/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:46.439845 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ee924-6221-401f-bce6-6610206258e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=68df1934bba847eeaf81f0f154f6edd1, user_id=886b53f516ec477abff1f988eff16281, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:46.441429 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ee924-6221-401f-bce6-6610206258e3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:46.460014 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:46.468254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 121/230] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:01:46 2022] PUT /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1/users/886b53f516ec477abff1f988eff16281/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:01:46.469684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6918898-48cb-451a-b4bb-c8e4f3282e1b None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:46.530868 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3711609-e3c5-418d-b93a-d7cc8d2e2d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:46.531943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3711609-e3c5-418d-b93a-d7cc8d2e2d06 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:46.532426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3711609-e3c5-418d-b93a-d7cc8d2e2d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:46.533043 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3711609-e3c5-418d-b93a-d7cc8d2e2d06 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:46.533962 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3711609-e3c5-418d-b93a-d7cc8d2e2d06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:46.534476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3711609-e3c5-418d-b93a-d7cc8d2e2d06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:46.536162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3711609-e3c5-418d-b93a-d7cc8d2e2d06 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:46.547050 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 110/231] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:01:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:46.552934 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ee924-6221-401f-bce6-6610206258e3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:46.717351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ee924-6221-401f-bce6-6610206258e3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:46.761143 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01b0cc-693a-490e-9b39-46830b561b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:46.761795 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01b0cc-693a-490e-9b39-46830b561b6a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:46.762079 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01b0cc-693a-490e-9b39-46830b561b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:46.762350 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01b0cc-693a-490e-9b39-46830b561b6a None admin] PATH_INFO: `/v3/users/886b53f516ec477abff1f988eff16281` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:46.763656 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01b0cc-693a-490e-9b39-46830b561b6a None admin] RBAC: Authorizing `identity:get_user(user_id=886b53f516ec477abff1f988eff16281)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:46.765099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01b0cc-693a-490e-9b39-46830b561b6a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:46.766702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 122/232] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:46 2022] GET /identity/v3/users/886b53f516ec477abff1f988eff16281 => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:46.776117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3711609-e3c5-418d-b93a-d7cc8d2e2d06 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:46.891219 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3711609-e3c5-418d-b93a-d7cc8d2e2d06 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:46.926069 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02872e-eef5-4ecc-8474-3b0c467e0492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:46.926711 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02872e-eef5-4ecc-8474-3b0c467e0492 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:46.926991 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02872e-eef5-4ecc-8474-3b0c467e0492 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:46.927357 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02872e-eef5-4ecc-8474-3b0c467e0492 None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:46.928491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02872e-eef5-4ecc-8474-3b0c467e0492 None admin] RBAC: Authorizing `identity:get_project(project_id=68df1934bba847eeaf81f0f154f6edd1)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:46.929964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02872e-eef5-4ecc-8474-3b0c467e0492 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:46.931918 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 111/233] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:46 2022] GET /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:46.937482 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01b0cc-693a-490e-9b39-46830b561b6a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:46.996537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:47.090107 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01b0cc-693a-490e-9b39-46830b561b6a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:47.130499 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ae2a4-bd8a-435d-bd85-f5a0b7fb19ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:47.131228 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ae2a4-bd8a-435d-bd85-f5a0b7fb19ef None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:47.131515 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ae2a4-bd8a-435d-bd85-f5a0b7fb19ef None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:47.131825 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ae2a4-bd8a-435d-bd85-f5a0b7fb19ef None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1/users/886b53f516ec477abff1f988eff16281/roles/0a020d67ea4d4d62b1305fd0cd952779` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:47.136913 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ae2a4-bd8a-435d-bd85-f5a0b7fb19ef None admin] RBAC: Authorizing `identity:create_grant(project_id=68df1934bba847eeaf81f0f154f6edd1, user_id=886b53f516ec477abff1f988eff16281, role_id=0a020d67ea4d4d62b1305fd0cd952779)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:47.138424 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ae2a4-bd8a-435d-bd85-f5a0b7fb19ef None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:47.156613 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 123/234] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:01:46 2022] PUT /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1/users/886b53f516ec477abff1f988eff16281/roles/0a020d67ea4d4d62b1305fd0cd952779 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:01:47.598948 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376a962-7520-4216-b8be-2cadbfc2e6d3 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:47.599522 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376a962-7520-4216-b8be-2cadbfc2e6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:47.599599 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376a962-7520-4216-b8be-2cadbfc2e6d3 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:47.601891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 112/235] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:47.607527 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934abd7-eed5-4119-815b-881ca8a3bea7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:47.607949 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934abd7-eed5-4119-815b-881ca8a3bea7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:47.608143 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934abd7-eed5-4119-815b-881ca8a3bea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:47.631182 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9934abd7-eed5-4119-815b-881ca8a3bea7 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:47.632925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9934abd7-eed5-4119-815b-881ca8a3bea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:47.722256 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 124/236] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:47.759556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376a962-7520-4216-b8be-2cadbfc2e6d3 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:47.790005 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:47.883209 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376a962-7520-4216-b8be-2cadbfc2e6d3 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:47.924617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09519f-e4f7-4460-aae9-8bae2d441fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:47.925260 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09519f-e4f7-4460-aae9-8bae2d441fbf None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:47.925536 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09519f-e4f7-4460-aae9-8bae2d441fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:47.925807 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09519f-e4f7-4460-aae9-8bae2d441fbf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:47.937024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09519f-e4f7-4460-aae9-8bae2d441fbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:47.941794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-1a09519f-e4f7-4460-aae9-8bae2d441fbf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 13:01:47.941794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:47.941794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:47.941794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:47.941794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:47.941794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:47.941794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:47.941794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:47.941794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:47.941794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:47.941794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:47.941794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:47.941794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:47.941794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:47.941794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:47.941794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:47.942683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:47.942683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:47.942683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:47.942683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:47.942683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:47.942683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:47.942683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:47.942683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:47.942683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:47.942683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:47.942683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:47.942683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:47.942683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:47.942683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:47.942683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:47.942683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:47.943910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:47.943910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:47.943910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:47.943910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:47.943910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:47.943910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:47.943910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:47.943910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:47.943910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:47.943910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:47.943910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 13:01:47.943910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:01:47.943910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 113/237] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:47.950866 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934abd7-eed5-4119-815b-881ca8a3bea7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:47.991025 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:48.088904 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35036058-9fc6-4188-a22b-395423185fea None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:48.089221 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35036058-9fc6-4188-a22b-395423185fea None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:48.089449 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35036058-9fc6-4188-a22b-395423185fea None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:48.090788 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 114/238] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:01:48.095913 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934abd7-eed5-4119-815b-881ca8a3bea7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:48.097552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80c72-8864-49a9-bbb2-4aa2f98a9276 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:48.097846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80c72-8864-49a9-bbb2-4aa2f98a9276 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:48.098089 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80c72-8864-49a9-bbb2-4aa2f98a9276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:48.126132 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-dac80c72-8864-49a9-bbb2-4aa2f98a9276 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:48.127344 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-dac80c72-8864-49a9-bbb2-4aa2f98a9276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:48.174475 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442b94d-d4ca-4fa4-9f24-7f31382ab402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:48.175024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442b94d-d4ca-4fa4-9f24-7f31382ab402 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:48.175362 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442b94d-d4ca-4fa4-9f24-7f31382ab402 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:48.175637 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442b94d-d4ca-4fa4-9f24-7f31382ab402 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:48.176309 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442b94d-d4ca-4fa4-9f24-7f31382ab402 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:48.176610 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442b94d-d4ca-4fa4-9f24-7f31382ab402 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:48.177989 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442b94d-d4ca-4fa4-9f24-7f31382ab402 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:48.197841 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 125/239] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:01:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:48.203863 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442b94d-d4ca-4fa4-9f24-7f31382ab402 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:48.238177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 115/240] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:01:48.263577 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80c72-8864-49a9-bbb2-4aa2f98a9276 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:48.279361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:48.376035 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:48.391088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442b94d-d4ca-4fa4-9f24-7f31382ab402 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:48.430413 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2a659-86d3-4a27-9257-398bf4758678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:48.431425 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2a659-86d3-4a27-9257-398bf4758678 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:48.431899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2a659-86d3-4a27-9257-398bf4758678 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:48.432376 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2a659-86d3-4a27-9257-398bf4758678 None admin] PATH_INFO: `/v3/users/f380cfc196434097b47cf06957f53152` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:48.445160 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80c72-8864-49a9-bbb2-4aa2f98a9276 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:48.448113 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2a659-86d3-4a27-9257-398bf4758678 None admin] RBAC: Authorizing `identity:get_user(user_id=f380cfc196434097b47cf06957f53152)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:48.449803 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2a659-86d3-4a27-9257-398bf4758678 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:48.451706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 126/241] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:48 2022] GET /identity/v3/users/f380cfc196434097b47cf06957f53152 => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:48.458740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2a659-86d3-4a27-9257-398bf4758678 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:48.542719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a637e1-5b67-4238-baf3-7b18a4a9a515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:48.543387 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a637e1-5b67-4238-baf3-7b18a4a9a515 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:48.543671 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a637e1-5b67-4238-baf3-7b18a4a9a515 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:48.543945 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a637e1-5b67-4238-baf3-7b18a4a9a515 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:48.546886 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a637e1-5b67-4238-baf3-7b18a4a9a515 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:48.548523 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a637e1-5b67-4238-baf3-7b18a4a9a515 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:48.550149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 116/242] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:01:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:01:48.561206 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a637e1-5b67-4238-baf3-7b18a4a9a515 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:48.583488 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2a659-86d3-4a27-9257-398bf4758678 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:48.631147 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9655d-580e-4016-b395-f2bb79e23ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:48.632720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9655d-580e-4016-b395-f2bb79e23ada None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:48.633504 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9655d-580e-4016-b395-f2bb79e23ada None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:48.634419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9655d-580e-4016-b395-f2bb79e23ada None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:48.655949 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:48.657067 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:48.679642 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a637e1-5b67-4238-baf3-7b18a4a9a515 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:48.720678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6837304-8847-4651-b2d1-b6c53946ca06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:48.721380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6837304-8847-4651-b2d1-b6c53946ca06 None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:48.721660 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6837304-8847-4651-b2d1-b6c53946ca06 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:48.721928 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6837304-8847-4651-b2d1-b6c53946ca06 None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:48.722565 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6837304-8847-4651-b2d1-b6c53946ca06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:48.724706 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6837304-8847-4651-b2d1-b6c53946ca06 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:48.729581 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9655d-580e-4016-b395-f2bb79e23ada None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:48.731399 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9655d-580e-4016-b395-f2bb79e23ada None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:48.764102 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 117/243] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 10 13:01:48 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:01:48.766922 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6eab4e-84fe-49c5-a5e0-83850978518e None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:48.767526 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6eab4e-84fe-49c5-a5e0-83850978518e None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:48.768345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6eab4e-84fe-49c5-a5e0-83850978518e None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:48.771092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 118/244] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:48.785097 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97853d10-7b8b-41b7-ba12-a3ad7ec8ec89 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:48.787421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97853d10-7b8b-41b7-ba12-a3ad7ec8ec89 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:48.787723 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97853d10-7b8b-41b7-ba12-a3ad7ec8ec89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:48.840599 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-97853d10-7b8b-41b7-ba12-a3ad7ec8ec89 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:48.843382 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-97853d10-7b8b-41b7-ba12-a3ad7ec8ec89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:48.900579 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 127/245] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:01:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:48.912245 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9655d-580e-4016-b395-f2bb79e23ada None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:48.958574 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 119/246] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:48.960537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977746e-e942-4e5e-94bd-90a590e8a5a1 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:48.961180 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977746e-e942-4e5e-94bd-90a590e8a5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:48.961684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977746e-e942-4e5e-94bd-90a590e8a5a1 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:48.963467 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 120/247] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:48.969034 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65017efd-241d-4a5f-9997-40e0dd76fc2d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:48.969885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65017efd-241d-4a5f-9997-40e0dd76fc2d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:48.970376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65017efd-241d-4a5f-9997-40e0dd76fc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:48.973879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:48.995454 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-65017efd-241d-4a5f-9997-40e0dd76fc2d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:48.996707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-65017efd-241d-4a5f-9997-40e0dd76fc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:49.044646 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9655d-580e-4016-b395-f2bb79e23ada None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:49.062349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:49.071466 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 121/248] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:01:49.073934 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65017efd-241d-4a5f-9997-40e0dd76fc2d None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:49.097820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6a5c9-b874-474f-a156-f91dee54db14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:49.099468 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6a5c9-b874-474f-a156-f91dee54db14 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:49.099775 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6a5c9-b874-474f-a156-f91dee54db14 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:49.100022 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6a5c9-b874-474f-a156-f91dee54db14 None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:49.102594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6a5c9-b874-474f-a156-f91dee54db14 None admin] RBAC: Authorizing `identity:get_project(project_id=68df1934bba847eeaf81f0f154f6edd1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:49.104180 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6a5c9-b874-474f-a156-f91dee54db14 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:49.109182 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 128/249] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:48 2022] GET /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:49.109965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6a5c9-b874-474f-a156-f91dee54db14 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:49.220856 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65017efd-241d-4a5f-9997-40e0dd76fc2d None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:49.241000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6a5c9-b874-474f-a156-f91dee54db14 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:49.263398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:49.281749 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd2cda-59ea-4dfd-9b09-87902377ed07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:49.282404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd2cda-59ea-4dfd-9b09-87902377ed07 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:49.282682 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd2cda-59ea-4dfd-9b09-87902377ed07 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:49.282965 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd2cda-59ea-4dfd-9b09-87902377ed07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:49.291034 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ddc16-1a41-43cf-af37-21a1eb186f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:49.291746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ddc16-1a41-43cf-af37-21a1eb186f92 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:49.292030 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ddc16-1a41-43cf-af37-21a1eb186f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:49.292301 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ddc16-1a41-43cf-af37-21a1eb186f92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:49.303311 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd2cda-59ea-4dfd-9b09-87902377ed07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:49.308605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-e9bd2cda-59ea-4dfd-9b09-87902377ed07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:49.308605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:49.308605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:49.308605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:49.308605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:49.308605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:49.308605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:49.308605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:49.308605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:49.308605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:49.308605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:49.308605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:49.308605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:49.308605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:49.308605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:49.308605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:49.309501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:49.309501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:49.309501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:49.309501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:49.309501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:49.309501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:49.309501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:49.309501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:49.309501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:49.309501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:49.309501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:49.309501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:49.309501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:49.309501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:49.309501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:49.309501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:49.310302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:49.310302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:49.310302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:49.310302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:49.310302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:49.310302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:49.310302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:49.310302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:49.310302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:49.310302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:49.310302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:49.310302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:01:49.316198 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 122/250] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:49.319363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ddc16-1a41-43cf-af37-21a1eb186f92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:49.324172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-a84ddc16-1a41-43cf-af37-21a1eb186f92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:01:49.324172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:49.324172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:49.324172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:49.324172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:49.324172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:49.324172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:49.324172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:49.324172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:49.324172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:49.324172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:49.324172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:49.324172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:49.324172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:49.324172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:49.324172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:49.326230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:49.326230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:49.326230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:49.326230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:49.326230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:49.326230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:49.326230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:49.326230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:49.326230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:49.326230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:49.326230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:49.326230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:49.326230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:49.326230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:49.326230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:49.326230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:49.328129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:49.328129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:49.328129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:49.328129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:49.328129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:49.328129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:49.328129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:49.328129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:49.328129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:49.328129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:49.328129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:01:49.328129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:01:49.329529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd2cda-59ea-4dfd-9b09-87902377ed07 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:49.333860 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 129/251] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:01:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:49.337333 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ddc16-1a41-43cf-af37-21a1eb186f92 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:49.436408 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:49.519508 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd2cda-59ea-4dfd-9b09-87902377ed07 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:49.523587 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ddc16-1a41-43cf-af37-21a1eb186f92 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:49.577439 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20142043-3f6d-41e7-8376-3c5ba711dee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:49.578056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20142043-3f6d-41e7-8376-3c5ba711dee2 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:49.578331 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20142043-3f6d-41e7-8376-3c5ba711dee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:49.578667 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20142043-3f6d-41e7-8376-3c5ba711dee2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:49.579438 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20142043-3f6d-41e7-8376-3c5ba711dee2 None admin] RBAC: Adding query filter params (role.id=78d0cc90d2f2496b9c3e75bb0ddf0c6d, scope.project.id=68df1934bba847eeaf81f0f154f6edd1, user.id=f380cfc196434097b47cf06957f53152) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:49.580218 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20142043-3f6d-41e7-8376-3c5ba711dee2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:49.581858 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20142043-3f6d-41e7-8376-3c5ba711dee2 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:49.590315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 123/252] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:01:49 2022] GET /identity/v3/role_assignments?user.id=f380cfc196434097b47cf06957f53152&scope.project.id=68df1934bba847eeaf81f0f154f6edd1&role.id=78d0cc90d2f2496b9c3e75bb0ddf0c6d => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:49.591274 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20142043-3f6d-41e7-8376-3c5ba711dee2 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:49.592300 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e32575-aa96-441b-b38e-7cf33eaef11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:49.592990 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e32575-aa96-441b-b38e-7cf33eaef11c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:49.593279 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e32575-aa96-441b-b38e-7cf33eaef11c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:49.593590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e32575-aa96-441b-b38e-7cf33eaef11c None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:49.594567 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e32575-aa96-441b-b38e-7cf33eaef11c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:49.594871 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e32575-aa96-441b-b38e-7cf33eaef11c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:49.596326 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e32575-aa96-441b-b38e-7cf33eaef11c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:49.616683 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 130/253] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:49.624193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e32575-aa96-441b-b38e-7cf33eaef11c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:49.700315 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:49.784792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20142043-3f6d-41e7-8376-3c5ba711dee2 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:49.825158 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e32575-aa96-441b-b38e-7cf33eaef11c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:49.840133 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:49.871660 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d46d4-eb85-4071-99be-83bbf50e9f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:49.872685 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d46d4-eb85-4071-99be-83bbf50e9f56 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:49.873167 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d46d4-eb85-4071-99be-83bbf50e9f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:49.873676 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d46d4-eb85-4071-99be-83bbf50e9f56 None admin] PATH_INFO: `/v3/users/886b53f516ec477abff1f988eff16281` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:49.875283 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d46d4-eb85-4071-99be-83bbf50e9f56 None admin] RBAC: Authorizing `identity:get_user(user_id=886b53f516ec477abff1f988eff16281)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:49.877350 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d46d4-eb85-4071-99be-83bbf50e9f56 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:49.879353 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 131/254] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:49 2022] GET /identity/v3/users/886b53f516ec477abff1f988eff16281 => generated 283 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:49.880766 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06fbfd-277b-43f4-9ccb-77a809c50b77 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:49.885992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06fbfd-277b-43f4-9ccb-77a809c50b77 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:49.886705 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06fbfd-277b-43f4-9ccb-77a809c50b77 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:49.888506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 132/255] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:49.889549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06fbfd-277b-43f4-9ccb-77a809c50b77 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:49.899117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffa275-3746-413b-a1b0-76c0bf7da790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:49.899416 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffa275-3746-413b-a1b0-76c0bf7da790 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:49.899692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffa275-3746-413b-a1b0-76c0bf7da790 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:49.900097 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffa275-3746-413b-a1b0-76c0bf7da790 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:49.901109 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffa275-3746-413b-a1b0-76c0bf7da790 None admin] RBAC: Adding query filter params (name=member) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:49.902084 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffa275-3746-413b-a1b0-76c0bf7da790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:49.903891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffa275-3746-413b-a1b0-76c0bf7da790 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:49.915952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 124/256] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:01:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:49.917505 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f0e75-bf49-4bd5-b849-0c8898eba111 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:49.917505 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f0e75-bf49-4bd5-b849-0c8898eba111 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:49.917797 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f0e75-bf49-4bd5-b849-0c8898eba111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:49.941074 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-3b1f0e75-bf49-4bd5-b849-0c8898eba111 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:49.942281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3b1f0e75-bf49-4bd5-b849-0c8898eba111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:50.020461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06fbfd-277b-43f4-9ccb-77a809c50b77 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:50.022047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:50.057870 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39406dd-9e1b-4867-b34e-e5e9c5e67ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:50.058508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39406dd-9e1b-4867-b34e-e5e9c5e67ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:50.058853 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39406dd-9e1b-4867-b34e-e5e9c5e67ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:50.059377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39406dd-9e1b-4867-b34e-e5e9c5e67ed7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:50.080096 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 125/257] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:50.080983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f0e75-bf49-4bd5-b849-0c8898eba111 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:50.134194 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39406dd-9e1b-4867-b34e-e5e9c5e67ed7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:50.135811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39406dd-9e1b-4867-b34e-e5e9c5e67ed7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:50.245697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 133/258] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:01:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:50.246703 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39406dd-9e1b-4867-b34e-e5e9c5e67ed7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:50.255379 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:50.376438 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f0e75-bf49-4bd5-b849-0c8898eba111 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:50.386136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39406dd-9e1b-4867-b34e-e5e9c5e67ed7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:50.410817 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:50.454668 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70116c9-a82e-4b4f-b0f2-b98b2478b53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:50.455568 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70116c9-a82e-4b4f-b0f2-b98b2478b53d None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:50.455848 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70116c9-a82e-4b4f-b0f2-b98b2478b53d None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:50.456549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70116c9-a82e-4b4f-b0f2-b98b2478b53d None admin] PATH_INFO: `/v3/users/918fa96b48e24fbb9f3f25a639e2759e` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:50.457910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70116c9-a82e-4b4f-b0f2-b98b2478b53d None admin] RBAC: Authorizing `identity:get_user(user_id=918fa96b48e24fbb9f3f25a639e2759e)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:50.459390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70116c9-a82e-4b4f-b0f2-b98b2478b53d None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:50.461228 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 126/259] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:50 2022] GET /identity/v3/users/918fa96b48e24fbb9f3f25a639e2759e => generated 297 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:50.461842 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70116c9-a82e-4b4f-b0f2-b98b2478b53d None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:50.467686 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1e1de-44df-4cb1-bdab-4405132297d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:50.468335 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1e1de-44df-4cb1-bdab-4405132297d4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:50.468611 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1e1de-44df-4cb1-bdab-4405132297d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:50.468880 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1e1de-44df-4cb1-bdab-4405132297d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:50.509710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1e1de-44df-4cb1-bdab-4405132297d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:50.514512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-0be1e1de-44df-4cb1-bdab-4405132297d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:01:50.514512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:50.514512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:50.514512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:50.514512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:50.514512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:50.514512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:50.514512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:50.514512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:50.514512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:50.514512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:50.514512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:50.514512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:50.514512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:50.514512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:50.514512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:50.516674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:50.516674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:50.516674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:50.516674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:50.516674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:50.516674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:50.516674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:50.516674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:50.516674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:50.516674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:50.516674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:50.516674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:50.516674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:50.516674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:50.516674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:50.516674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:50.518847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:50.518847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:50.518847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:50.518847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:50.518847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:50.518847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:50.518847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:50.518847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:50.518847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:50.518847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:50.518847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:01:50.518847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:01:50.518847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 134/260] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 10 13:01:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:50.518847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1e1de-44df-4cb1-bdab-4405132297d4 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:50.585243 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70116c9-a82e-4b4f-b0f2-b98b2478b53d None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:50.632652 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:50.659957 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3400eea-375b-4260-8872-3a7e7038264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:50.660976 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3400eea-375b-4260-8872-3a7e7038264f None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:50.661456 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3400eea-375b-4260-8872-3a7e7038264f None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:50.661986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3400eea-375b-4260-8872-3a7e7038264f None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:50.671886 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3400eea-375b-4260-8872-3a7e7038264f None admin] RBAC: Authorizing `identity:get_project(project_id=68df1934bba847eeaf81f0f154f6edd1)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:50.673637 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3400eea-375b-4260-8872-3a7e7038264f None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:50.675949 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 127/261] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:50 2022] GET /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:50.676063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1e1de-44df-4cb1-bdab-4405132297d4 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:50.677036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3400eea-375b-4260-8872-3a7e7038264f None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:50.718753 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d009e4-5e33-43ff-b370-44a03f234853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:50.723951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d009e4-5e33-43ff-b370-44a03f234853 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:50.724234 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d009e4-5e33-43ff-b370-44a03f234853 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:50.724510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d009e4-5e33-43ff-b370-44a03f234853 None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:50.728850 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d009e4-5e33-43ff-b370-44a03f234853 None admin] RBAC: Authorizing `identity:get_project(project_id=68df1934bba847eeaf81f0f154f6edd1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:50.730380 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d009e4-5e33-43ff-b370-44a03f234853 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:50.736353 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 135/262] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:50 2022] GET /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:50.737139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d009e4-5e33-43ff-b370-44a03f234853 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:50.781575 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:50.856867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3400eea-375b-4260-8872-3a7e7038264f None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:50.919113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8172a-db5b-4323-be8b-1267670f99fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:50.919113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8172a-db5b-4323-be8b-1267670f99fd None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:50.919113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8172a-db5b-4323-be8b-1267670f99fd None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:50.919113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8172a-db5b-4323-be8b-1267670f99fd None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:50.919496 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8172a-db5b-4323-be8b-1267670f99fd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:50.919496 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8172a-db5b-4323-be8b-1267670f99fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:50.919496 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8172a-db5b-4323-be8b-1267670f99fd None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:50.931974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 128/263] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:01:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:50.932797 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8172a-db5b-4323-be8b-1267670f99fd None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:50.952374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d009e4-5e33-43ff-b370-44a03f234853 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:51.021060 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:51.030341 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844698f-5bdb-4f14-b221-79796c4f5fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:51.032114 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844698f-5bdb-4f14-b221-79796c4f5fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:51.033392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844698f-5bdb-4f14-b221-79796c4f5fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:51.034031 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844698f-5bdb-4f14-b221-79796c4f5fc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:51.036194 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844698f-5bdb-4f14-b221-79796c4f5fc0 None admin] RBAC: Adding query filter params (role.id=d9c9200468cb4f7ab6a23882bfb1f062, scope.project.id=68df1934bba847eeaf81f0f154f6edd1, user.id=886b53f516ec477abff1f988eff16281) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:51.037469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844698f-5bdb-4f14-b221-79796c4f5fc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:51.042222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844698f-5bdb-4f14-b221-79796c4f5fc0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:51.054120 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 136/264] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:01:50 2022] GET /identity/v3/role_assignments?user.id=886b53f516ec477abff1f988eff16281&scope.project.id=68df1934bba847eeaf81f0f154f6edd1&role.id=d9c9200468cb4f7ab6a23882bfb1f062 => generated 608 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:51.055913 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844698f-5bdb-4f14-b221-79796c4f5fc0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:51.165039 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8172a-db5b-4323-be8b-1267670f99fd None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:51.182966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:51.242013 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16d5d0-e8e9-4b4e-86d4-b8ae5bfe41b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:51.242699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16d5d0-e8e9-4b4e-86d4-b8ae5bfe41b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:51.242972 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16d5d0-e8e9-4b4e-86d4-b8ae5bfe41b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:51.243270 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16d5d0-e8e9-4b4e-86d4-b8ae5bfe41b5 None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1/users/918fa96b48e24fbb9f3f25a639e2759e/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:51.244114 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844698f-5bdb-4f14-b221-79796c4f5fc0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:51.248462 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16d5d0-e8e9-4b4e-86d4-b8ae5bfe41b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=68df1934bba847eeaf81f0f154f6edd1, user_id=918fa96b48e24fbb9f3f25a639e2759e, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:51.249936 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16d5d0-e8e9-4b4e-86d4-b8ae5bfe41b5 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:51.280032 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 129/265] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:01:50 2022] PUT /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1/users/918fa96b48e24fbb9f3f25a639e2759e/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:01:51.281301 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685c8a9-8082-46ff-98b9-265b0bc0f699 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:51.281584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685c8a9-8082-46ff-98b9-265b0bc0f699 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:51.281853 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685c8a9-8082-46ff-98b9-265b0bc0f699 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:51.287511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 130/266] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:51.291636 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a8824-4c0b-4662-a2c4-e93d5b758de6 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:51.291915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a8824-4c0b-4662-a2c4-e93d5b758de6 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:51.292189 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a8824-4c0b-4662-a2c4-e93d5b758de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:51.311817 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cc020-d002-4c64-b110-8efb900126d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:51.312947 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cc020-d002-4c64-b110-8efb900126d0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:51.313424 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cc020-d002-4c64-b110-8efb900126d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:51.313915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cc020-d002-4c64-b110-8efb900126d0 None admin] PATH_INFO: `/v3/users/886b53f516ec477abff1f988eff16281` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:51.316006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9cc020-d002-4c64-b110-8efb900126d0 None admin] RBAC: Authorizing `identity:get_user(user_id=886b53f516ec477abff1f988eff16281)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:51.321281 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9cc020-d002-4c64-b110-8efb900126d0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:51.325332 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 137/267] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:51 2022] GET /identity/v3/users/886b53f516ec477abff1f988eff16281 => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:51.328148 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-666a8824-4c0b-4662-a2c4-e93d5b758de6 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:51.329525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-666a8824-4c0b-4662-a2c4-e93d5b758de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:51.330974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cc020-d002-4c64-b110-8efb900126d0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:51.453705 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:51.472657 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 131/268] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:51.505750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cc020-d002-4c64-b110-8efb900126d0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:51.510354 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a8824-4c0b-4662-a2c4-e93d5b758de6 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:51.551590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933e134-96c6-436d-a9e9-6a1a49c4b69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:51.552321 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933e134-96c6-436d-a9e9-6a1a49c4b69f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:51.552673 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933e134-96c6-436d-a9e9-6a1a49c4b69f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:51.553020 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933e134-96c6-436d-a9e9-6a1a49c4b69f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:51.638600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933e134-96c6-436d-a9e9-6a1a49c4b69f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:51.640112 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933e134-96c6-436d-a9e9-6a1a49c4b69f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:51.649713 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:51.654186 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a8824-4c0b-4662-a2c4-e93d5b758de6 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:51.699063 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd64de-b2b5-4655-85c1-cff96471f469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:51.700147 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd64de-b2b5-4655-85c1-cff96471f469 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:51.700428 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd64de-b2b5-4655-85c1-cff96471f469 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:51.700795 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd64de-b2b5-4655-85c1-cff96471f469 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:51.701915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd64de-b2b5-4655-85c1-cff96471f469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:51.703377 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd64de-b2b5-4655-85c1-cff96471f469 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:51.705405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 132/269] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:01:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:01:51.706669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b02aaf-3771-4032-a226-dffdb70c7adc None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:51.706950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b02aaf-3771-4032-a226-dffdb70c7adc None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:51.707340 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b02aaf-3771-4032-a226-dffdb70c7adc None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:51.708699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 133/270] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:51.713981 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:51.714819 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b02aaf-3771-4032-a226-dffdb70c7adc None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:51.771836 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 138/271] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:01:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:51.773213 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f809b8-78d3-4fe6-9f46-85f4d584b2fb None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:51.773569 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f809b8-78d3-4fe6-9f46-85f4d584b2fb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:51.773853 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f809b8-78d3-4fe6-9f46-85f4d584b2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:51.793524 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-41f809b8-78d3-4fe6-9f46-85f4d584b2fb None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:51.794719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-41f809b8-78d3-4fe6-9f46-85f4d584b2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:51.844625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b02aaf-3771-4032-a226-dffdb70c7adc None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:51.874750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 139/272] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:51.875881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f809b8-78d3-4fe6-9f46-85f4d584b2fb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:51.888922 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1f5d0-a131-4e10-8699-a0b53854cacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:51.889572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1f5d0-a131-4e10-8699-a0b53854cacf None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:51.889800 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1f5d0-a131-4e10-8699-a0b53854cacf None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:51.893485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1f5d0-a131-4e10-8699-a0b53854cacf None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:51.893485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1f5d0-a131-4e10-8699-a0b53854cacf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:51.893485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1f5d0-a131-4e10-8699-a0b53854cacf None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:51.920633 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 134/273] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 10 13:01:51 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:01:51.921678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1f5d0-a131-4e10-8699-a0b53854cacf None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:51.960411 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:52.052007 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1f5d0-a131-4e10-8699-a0b53854cacf None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:52.072260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:52.093383 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b17a75-9b33-4a6c-8c46-a24be1df3618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:52.094856 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b17a75-9b33-4a6c-8c46-a24be1df3618 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:52.095284 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b17a75-9b33-4a6c-8c46-a24be1df3618 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:52.095705 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b17a75-9b33-4a6c-8c46-a24be1df3618 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:52.102361 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f809b8-78d3-4fe6-9f46-85f4d584b2fb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:52.109929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b17a75-9b33-4a6c-8c46-a24be1df3618 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:52.116315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-06b17a75-9b33-4a6c-8c46-a24be1df3618 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:52.116315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:52.116315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:52.116315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:52.116315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:52.116315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:52.116315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:52.116315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:52.116315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:52.116315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:52.116315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:52.116315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:52.116315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:52.116315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:52.116315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:52.116315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:52.117222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:52.117222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:52.117222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:52.117222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:52.117222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:52.117222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:52.117222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:52.117222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:52.117222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:52.117222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:52.117222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:52.117222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:52.117222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:52.117222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:52.117222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:52.117222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:52.118351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:52.118351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:52.118351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:52.118351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:52.118351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:52.118351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:52.118351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:52.118351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:52.118351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:52.118351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:52.118351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:52.118351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:01:52.118351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 135/274] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:52.123953 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b17a75-9b33-4a6c-8c46-a24be1df3618 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:52.153070 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce0331-34b2-4e74-b3c8-17b080e05441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:52.153799 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce0331-34b2-4e74-b3c8-17b080e05441 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:52.154196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce0331-34b2-4e74-b3c8-17b080e05441 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:52.154562 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce0331-34b2-4e74-b3c8-17b080e05441 None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:52.155800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce0331-34b2-4e74-b3c8-17b080e05441 None admin] RBAC: Authorizing `identity:get_project(project_id=68df1934bba847eeaf81f0f154f6edd1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:52.157483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce0331-34b2-4e74-b3c8-17b080e05441 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:52.159292 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 140/275] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:51 2022] GET /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:52.168531 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce0331-34b2-4e74-b3c8-17b080e05441 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:52.232028 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:52.250987 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b17a75-9b33-4a6c-8c46-a24be1df3618 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:52.298742 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdee74-818d-4b43-a389-a5311a6938c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:52.298742 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdee74-818d-4b43-a389-a5311a6938c7 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:52.298742 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdee74-818d-4b43-a389-a5311a6938c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:52.298742 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdee74-818d-4b43-a389-a5311a6938c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:52.299225 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdee74-818d-4b43-a389-a5311a6938c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:52.299225 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdee74-818d-4b43-a389-a5311a6938c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:52.300905 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdee74-818d-4b43-a389-a5311a6938c7 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:52.302516 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce0331-34b2-4e74-b3c8-17b080e05441 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:52.310609 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 136/276] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:01:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:01:52.316445 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdee74-818d-4b43-a389-a5311a6938c7 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:52.356163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c812e99-ab00-42a5-b623-9c1a3f7157fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:52.357148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c812e99-ab00-42a5-b623-9c1a3f7157fc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:52.357634 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c812e99-ab00-42a5-b623-9c1a3f7157fc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:52.358100 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c812e99-ab00-42a5-b623-9c1a3f7157fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:52.359180 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c812e99-ab00-42a5-b623-9c1a3f7157fc None admin] RBAC: Adding query filter params (role.id=0a020d67ea4d4d62b1305fd0cd952779, scope.project.id=68df1934bba847eeaf81f0f154f6edd1, user.id=886b53f516ec477abff1f988eff16281) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:52.359554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c812e99-ab00-42a5-b623-9c1a3f7157fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:52.361011 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c812e99-ab00-42a5-b623-9c1a3f7157fc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:52.367768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 141/277] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:01:52 2022] GET /identity/v3/role_assignments?user.id=886b53f516ec477abff1f988eff16281&scope.project.id=68df1934bba847eeaf81f0f154f6edd1&role.id=0a020d67ea4d4d62b1305fd0cd952779 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:52.368977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41f934-e7b4-49cb-99c1-fd28bea39873 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:52.369346 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41f934-e7b4-49cb-99c1-fd28bea39873 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:52.369543 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41f934-e7b4-49cb-99c1-fd28bea39873 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:52.376720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 142/278] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:52.378089 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737058f9-1207-4853-b9a8-11028107edb0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:52.378373 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737058f9-1207-4853-b9a8-11028107edb0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:52.378646 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737058f9-1207-4853-b9a8-11028107edb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:52.409794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-737058f9-1207-4853-b9a8-11028107edb0 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:52.411049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-737058f9-1207-4853-b9a8-11028107edb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:52.435677 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:52.453421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdee74-818d-4b43-a389-a5311a6938c7 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:52.495187 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8a814-e2f0-437b-8724-4f55d0cb0fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:52.499066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 143/279] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:52.499873 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8a814-e2f0-437b-8724-4f55d0cb0fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:52.500144 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8a814-e2f0-437b-8724-4f55d0cb0fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:52.500422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8a814-e2f0-437b-8724-4f55d0cb0fe5 None admin] PATH_INFO: `/v3/users/af5a5056e6b24a23bf877d9d12e86299` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:52.516972 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8a814-e2f0-437b-8724-4f55d0cb0fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=af5a5056e6b24a23bf877d9d12e86299)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:52.518484 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8a814-e2f0-437b-8724-4f55d0cb0fe5 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:52.520274 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 137/280] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:52 2022] GET /identity/v3/users/af5a5056e6b24a23bf877d9d12e86299 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:52.527127 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737058f9-1207-4853-b9a8-11028107edb0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:52.532110 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8a814-e2f0-437b-8724-4f55d0cb0fe5 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:52.547439 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:52.649586 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8a814-e2f0-437b-8724-4f55d0cb0fe5 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:52.653118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737058f9-1207-4853-b9a8-11028107edb0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:52.688179 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59744a04-64ca-4eae-94a5-ca29f6bddaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:52.689236 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59744a04-64ca-4eae-94a5-ca29f6bddaa8 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:52.689819 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59744a04-64ca-4eae-94a5-ca29f6bddaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:52.690505 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59744a04-64ca-4eae-94a5-ca29f6bddaa8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:52.691662 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfca2ca-7e0b-4745-89e0-3d045ba7b73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:52.692294 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfca2ca-7e0b-4745-89e0-3d045ba7b73f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:52.692563 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfca2ca-7e0b-4745-89e0-3d045ba7b73f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:52.692839 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfca2ca-7e0b-4745-89e0-3d045ba7b73f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:52.693594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfca2ca-7e0b-4745-89e0-3d045ba7b73f None admin] RBAC: Adding query filter params (role.id=2223c0caa0c948abbe85384d16a465a2, user.id=af5a5056e6b24a23bf877d9d12e86299, scope.system=all) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:52.693936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfca2ca-7e0b-4745-89e0-3d045ba7b73f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:52.697041 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfca2ca-7e0b-4745-89e0-3d045ba7b73f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:52.704108 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 144/281] 10.222.0.46 () {56 vars in 1308 bytes} [Wed Aug 10 13:01:52 2022] GET /identity/v3/role_assignments?user.id=af5a5056e6b24a23bf877d9d12e86299&scope.system=all&role.id=2223c0caa0c948abbe85384d16a465a2 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:52.706152 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59744a04-64ca-4eae-94a5-ca29f6bddaa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:52.711528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-59744a04-64ca-4eae-94a5-ca29f6bddaa8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 13:01:52.711528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:52.711528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:52.711528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:52.711528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:52.711528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:52.711528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:52.711528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:52.711528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:52.711528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:52.711528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:52.711528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:52.711528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:52.711528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:52.711528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:52.711528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:52.712551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:52.712551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:52.712551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:52.712551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:52.712551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:52.712551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:52.712551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:52.712551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:52.712551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:52.712551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:52.712551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:52.712551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:52.712551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:52.712551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:52.712551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:52.712551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:52.713366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:52.713366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:52.713366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:52.713366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:52.713366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:52.713366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:52.713366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:52.713366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:52.713366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:52.713366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:52.713366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 13:01:52.713366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:01:52.721143 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 138/282] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:52.723237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfca2ca-7e0b-4745-89e0-3d045ba7b73f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:52.746230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:52.876235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfca2ca-7e0b-4745-89e0-3d045ba7b73f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:52.928237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d45cf-0aaa-4092-afcb-acac46127ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:52.928921 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d45cf-0aaa-4092-afcb-acac46127ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:52.929198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d45cf-0aaa-4092-afcb-acac46127ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:52.929468 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d45cf-0aaa-4092-afcb-acac46127ae6 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:52.930120 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d45cf-0aaa-4092-afcb-acac46127ae6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:52.930419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d45cf-0aaa-4092-afcb-acac46127ae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:52.931824 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d45cf-0aaa-4092-afcb-acac46127ae6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:52.940815 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 145/283] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:01:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:52.947079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59744a04-64ca-4eae-94a5-ca29f6bddaa8 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:53.079975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:53.144862 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59744a04-64ca-4eae-94a5-ca29f6bddaa8 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:53.187886 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8e5b8-15aa-493b-9d85-8831b3277755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:53.188863 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8e5b8-15aa-493b-9d85-8831b3277755 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:53.189363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8e5b8-15aa-493b-9d85-8831b3277755 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:53.189832 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8e5b8-15aa-493b-9d85-8831b3277755 None admin] PATH_INFO: `/v3/users/f380cfc196434097b47cf06957f53152` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:53.191223 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8e5b8-15aa-493b-9d85-8831b3277755 None admin] RBAC: Authorizing `identity:get_user(user_id=f380cfc196434097b47cf06957f53152)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:53.192869 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8e5b8-15aa-493b-9d85-8831b3277755 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:53.201693 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 139/284] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:52 2022] GET /identity/v3/users/f380cfc196434097b47cf06957f53152 => generated 297 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:53.210218 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d45cf-0aaa-4092-afcb-acac46127ae6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:53.317588 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:53.337874 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d45cf-0aaa-4092-afcb-acac46127ae6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:53.372180 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ec8bd-1183-476a-8cab-71bd7cb17652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:53.372812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ec8bd-1183-476a-8cab-71bd7cb17652 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:53.373088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ec8bd-1183-476a-8cab-71bd7cb17652 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:53.373354 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ec8bd-1183-476a-8cab-71bd7cb17652 None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:53.374465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ec8bd-1183-476a-8cab-71bd7cb17652 None admin] RBAC: Authorizing `identity:get_project(project_id=68df1934bba847eeaf81f0f154f6edd1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:53.375933 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ec8bd-1183-476a-8cab-71bd7cb17652 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:53.377855 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 146/285] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:53 2022] GET /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:53.383862 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8e5b8-15aa-493b-9d85-8831b3277755 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:53.533737 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8e5b8-15aa-493b-9d85-8831b3277755 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:53.570836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:53.580544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60aa6da-e35b-4659-85af-9e7b44d8792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:53.581496 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aa6da-e35b-4659-85af-9e7b44d8792a None admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:53.581978 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aa6da-e35b-4659-85af-9e7b44d8792a None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:53.582448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aa6da-e35b-4659-85af-9e7b44d8792a None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1/users/f380cfc196434097b47cf06957f53152/roles/78d0cc90d2f2496b9c3e75bb0ddf0c6d` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:53.584666 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60aa6da-e35b-4659-85af-9e7b44d8792a None admin] RBAC: Authorizing `identity:create_grant(project_id=68df1934bba847eeaf81f0f154f6edd1, user_id=f380cfc196434097b47cf06957f53152, role_id=78d0cc90d2f2496b9c3e75bb0ddf0c6d)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:53.586317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60aa6da-e35b-4659-85af-9e7b44d8792a None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:53.606246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 140/286] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:01:53 2022] PUT /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1/users/f380cfc196434097b47cf06957f53152/roles/78d0cc90d2f2496b9c3e75bb0ddf0c6d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:01:53.896230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8504091-cf0a-4dd7-9131-6972b2e2b68a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:53.896716 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8504091-cf0a-4dd7-9131-6972b2e2b68a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:53.896791 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8504091-cf0a-4dd7-9131-6972b2e2b68a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:53.898363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 147/287] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:53.904703 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ecda7-3794-488c-88bb-f2c94ec3f10a None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:53.904985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ecda7-3794-488c-88bb-f2c94ec3f10a None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:53.905253 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ecda7-3794-488c-88bb-f2c94ec3f10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:53.926505 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-833ecda7-3794-488c-88bb-f2c94ec3f10a None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:53.927775 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-833ecda7-3794-488c-88bb-f2c94ec3f10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:54.032434 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 141/288] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:01:54.075637 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8504091-cf0a-4dd7-9131-6972b2e2b68a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:54.208858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8504091-cf0a-4dd7-9131-6972b2e2b68a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:54.257829 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea392b-b712-40cb-a211-1e39b0f0c4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:54.258467 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea392b-b712-40cb-a211-1e39b0f0c4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:54.258744 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea392b-b712-40cb-a211-1e39b0f0c4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:54.259027 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea392b-b712-40cb-a211-1e39b0f0c4e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:54.274817 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea392b-b712-40cb-a211-1e39b0f0c4e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:54.279584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-92ea392b-b712-40cb-a211-1e39b0f0c4e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:54.279584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:54.279584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:54.279584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:54.279584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:54.279584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:54.279584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:54.279584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:54.279584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:54.279584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:54.279584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:54.279584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:54.279584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:54.279584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:54.279584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:54.279584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:54.280465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:54.280465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:54.280465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:54.280465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:54.280465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:54.280465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:54.280465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:54.280465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:54.280465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:54.280465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:54.280465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:54.280465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:54.280465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:54.280465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:54.280465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:54.280465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:54.281267 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:54.281267 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:54.281267 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:54.281267 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:54.281267 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:54.281267 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:54.281267 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:54.281267 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:54.281267 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:54.281267 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:54.281267 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:54.281267 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:01:54.284630 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 148/289] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:54.290723 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ecda7-3794-488c-88bb-f2c94ec3f10a None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:54.417091 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ecda7-3794-488c-88bb-f2c94ec3f10a None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:54.447392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:54.471791 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6887a-57ff-4267-91f2-5f710d0eaac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:54.472727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6887a-57ff-4267-91f2-5f710d0eaac1 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:54.473207 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6887a-57ff-4267-91f2-5f710d0eaac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:54.473676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6887a-57ff-4267-91f2-5f710d0eaac1 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:54.474542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6887a-57ff-4267-91f2-5f710d0eaac1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:54.475623 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6887a-57ff-4267-91f2-5f710d0eaac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:54.477217 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6887a-57ff-4267-91f2-5f710d0eaac1 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:54.486386 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 142/290] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:01:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:54.492354 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea392b-b712-40cb-a211-1e39b0f0c4e8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:54.505971 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:54.637883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea392b-b712-40cb-a211-1e39b0f0c4e8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:54.677115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fd49e-f0b1-438b-8993-4f8d6d2bdef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:54.677756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fd49e-f0b1-438b-8993-4f8d6d2bdef1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:54.678037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fd49e-f0b1-438b-8993-4f8d6d2bdef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:54.678347 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fd49e-f0b1-438b-8993-4f8d6d2bdef1 None admin] PATH_INFO: `/v3/users/918fa96b48e24fbb9f3f25a639e2759e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:54.679522 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34fd49e-f0b1-438b-8993-4f8d6d2bdef1 None admin] RBAC: Authorizing `identity:get_user(user_id=918fa96b48e24fbb9f3f25a639e2759e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:54.680993 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34fd49e-f0b1-438b-8993-4f8d6d2bdef1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:54.682579 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 149/291] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:54 2022] GET /identity/v3/users/918fa96b48e24fbb9f3f25a639e2759e => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:54.688234 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6887a-57ff-4267-91f2-5f710d0eaac1 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:54.847701 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6887a-57ff-4267-91f2-5f710d0eaac1 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:54.903723 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4708bfb-32d4-4885-a755-1ed9a2ead662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:54.904701 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4708bfb-32d4-4885-a755-1ed9a2ead662 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:54.906843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4708bfb-32d4-4885-a755-1ed9a2ead662 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:54.907354 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4708bfb-32d4-4885-a755-1ed9a2ead662 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:54.926907 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e1cb5-5d19-4889-944a-ab3aeb0615a5 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:54.927883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e1cb5-5d19-4889-944a-ab3aeb0615a5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:54.928852 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e1cb5-5d19-4889-944a-ab3aeb0615a5 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:54.930353 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 150/292] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:54.940650 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f4624-d34b-4bc8-884d-a1d6fd3cf57f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:54.940650 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f4624-d34b-4bc8-884d-a1d6fd3cf57f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:54.940650 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f4624-d34b-4bc8-884d-a1d6fd3cf57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:54.974871 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4e7f4624-d34b-4bc8-884d-a1d6fd3cf57f None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:54.976632 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4e7f4624-d34b-4bc8-884d-a1d6fd3cf57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:54.989291 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:55.000145 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4708bfb-32d4-4885-a755-1ed9a2ead662 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:55.001960 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4708bfb-32d4-4885-a755-1ed9a2ead662 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:55.089279 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 151/293] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:55.091499 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9736d-d991-44c9-8a82-353b627acbe9 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:55.091984 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9736d-d991-44c9-8a82-353b627acbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:55.092450 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9736d-d991-44c9-8a82-353b627acbe9 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:55.094522 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 152/294] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:55.102552 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1d98a-28b1-41b1-a5ca-04edb75ad0ff None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:55.103386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1d98a-28b1-41b1-a5ca-04edb75ad0ff None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:55.104328 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1d98a-28b1-41b1-a5ca-04edb75ad0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:55.131108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 143/295] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:01:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:55.132195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:55.132503 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4708bfb-32d4-4885-a755-1ed9a2ead662 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:55.141029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b4c1d98a-28b1-41b1-a5ca-04edb75ad0ff None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:55.141029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b4c1d98a-28b1-41b1-a5ca-04edb75ad0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:55.211366 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 153/296] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:01:55.212288 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1d98a-28b1-41b1-a5ca-04edb75ad0ff None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:55.229324 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:55.246533 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4708bfb-32d4-4885-a755-1ed9a2ead662 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:55.282966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613b5bf-d427-4630-9109-c90f2d14c7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:55.283628 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613b5bf-d427-4630-9109-c90f2d14c7de None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:55.283915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613b5bf-d427-4630-9109-c90f2d14c7de None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:55.284189 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613b5bf-d427-4630-9109-c90f2d14c7de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:55.301221 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613b5bf-d427-4630-9109-c90f2d14c7de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:55.306171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-7613b5bf-d427-4630-9109-c90f2d14c7de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 13:01:55.306171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:55.306171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:55.306171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:55.306171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:55.306171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:55.306171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:55.306171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:55.306171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:55.306171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:55.306171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:55.306171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:55.306171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:55.306171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:55.306171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:55.306171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:55.307149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:55.307149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:55.307149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:55.307149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:55.307149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:55.307149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:55.307149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:55.307149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:55.307149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:55.307149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:55.307149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:55.307149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:55.307149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:55.307149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:55.307149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:55.307149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:55.307955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:55.307955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:55.307955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:55.307955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:55.307955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:55.307955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:55.307955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:55.307955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:55.307955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:55.307955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:55.307955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 13:01:55.307955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:01:55.307955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 144/297] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:55.308636 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a874e31-4505-4138-a4cc-d75d550ba82d None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:55.309206 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a874e31-4505-4138-a4cc-d75d550ba82d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:55.309206 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a874e31-4505-4138-a4cc-d75d550ba82d None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:55.314709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 145/298] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:55.314709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a874e31-4505-4138-a4cc-d75d550ba82d None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:55.340403 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1d98a-28b1-41b1-a5ca-04edb75ad0ff None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:55.379555 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61799c3b-a216-464d-bd61-bfa0ba22295b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:55.380109 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61799c3b-a216-464d-bd61-bfa0ba22295b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:55.380384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61799c3b-a216-464d-bd61-bfa0ba22295b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:55.380655 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61799c3b-a216-464d-bd61-bfa0ba22295b None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:55.381827 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61799c3b-a216-464d-bd61-bfa0ba22295b None admin] RBAC: Authorizing `identity:get_project(project_id=68df1934bba847eeaf81f0f154f6edd1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:55.383336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61799c3b-a216-464d-bd61-bfa0ba22295b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:55.390102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 154/299] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:55 2022] GET /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:55.390102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61799c3b-a216-464d-bd61-bfa0ba22295b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:55.394280 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:55.431320 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a874e31-4505-4138-a4cc-d75d550ba82d None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:55.469426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e1695-5fe3-4678-b259-afa216deabeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:55.470053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e1695-5fe3-4678-b259-afa216deabeb None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:55.470326 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e1695-5fe3-4678-b259-afa216deabeb None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:55.470594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e1695-5fe3-4678-b259-afa216deabeb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:55.471947 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e1695-5fe3-4678-b259-afa216deabeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:55.473389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e1695-5fe3-4678-b259-afa216deabeb None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:55.474955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 146/300] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:01:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:55.474955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013ced9-e692-4533-9b4e-37e357d66099 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:55.474955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013ced9-e692-4533-9b4e-37e357d66099 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:55.474955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013ced9-e692-4533-9b4e-37e357d66099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:55.496873 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-f013ced9-e692-4533-9b4e-37e357d66099 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:55.498079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-f013ced9-e692-4533-9b4e-37e357d66099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:55.503677 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61799c3b-a216-464d-bd61-bfa0ba22295b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:55.506760 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:55.541034 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2a7b0-8efb-4023-8039-bedbc05675d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:55.541650 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2a7b0-8efb-4023-8039-bedbc05675d7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:55.541930 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2a7b0-8efb-4023-8039-bedbc05675d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:55.542203 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2a7b0-8efb-4023-8039-bedbc05675d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:55.542868 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2a7b0-8efb-4023-8039-bedbc05675d7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:55.543199 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2a7b0-8efb-4023-8039-bedbc05675d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:55.544570 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2a7b0-8efb-4023-8039-bedbc05675d7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:55.557148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 155/301] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:01:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:55.557148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2a7b0-8efb-4023-8039-bedbc05675d7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:55.573409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 147/302] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:55.576125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013ced9-e692-4533-9b4e-37e357d66099 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:55.627367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:55.667120 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2a7b0-8efb-4023-8039-bedbc05675d7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:55.692786 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013ced9-e692-4533-9b4e-37e357d66099 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:55.702380 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef5d0a-c60c-4ac9-ac72-9d47a7ff6286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:55.702984 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef5d0a-c60c-4ac9-ac72-9d47a7ff6286 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:55.703411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef5d0a-c60c-4ac9-ac72-9d47a7ff6286 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:55.703542 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef5d0a-c60c-4ac9-ac72-9d47a7ff6286 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:55.704249 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef5d0a-c60c-4ac9-ac72-9d47a7ff6286 None admin] RBAC: Adding query filter params (role.id=2223c0caa0c948abbe85384d16a465a2, scope.project.id=68df1934bba847eeaf81f0f154f6edd1, user.id=918fa96b48e24fbb9f3f25a639e2759e) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:55.704550 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef5d0a-c60c-4ac9-ac72-9d47a7ff6286 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:55.705978 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef5d0a-c60c-4ac9-ac72-9d47a7ff6286 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:55.712952 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 156/303] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:01:55 2022] GET /identity/v3/role_assignments?user.id=918fa96b48e24fbb9f3f25a639e2759e&scope.project.id=68df1934bba847eeaf81f0f154f6edd1&role.id=2223c0caa0c948abbe85384d16a465a2 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:55.714009 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef5d0a-c60c-4ac9-ac72-9d47a7ff6286 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:55.751201 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc30bc-7f49-4f28-8d0c-c9fb2e469727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:55.751833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc30bc-7f49-4f28-8d0c-c9fb2e469727 None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:55.752106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc30bc-7f49-4f28-8d0c-c9fb2e469727 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:55.752378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc30bc-7f49-4f28-8d0c-c9fb2e469727 None admin] PATH_INFO: `/v3/groups` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:55.753600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc30bc-7f49-4f28-8d0c-c9fb2e469727 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:55.755465 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc30bc-7f49-4f28-8d0c-c9fb2e469727 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:55.788563 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 148/304] 10.222.0.46 () {60 vars in 1134 bytes} [Wed Aug 10 13:01:55 2022] POST /identity/v3/groups => generated 229 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:01:55.790202 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc30bc-7f49-4f28-8d0c-c9fb2e469727 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:55.800326 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:55.913766 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef5d0a-c60c-4ac9-ac72-9d47a7ff6286 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:55.962969 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc30bc-7f49-4f28-8d0c-c9fb2e469727 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:55.970159 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:55.980023 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1dabfb-a868-4cb3-996f-86422f226887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:55.980666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dabfb-a868-4cb3-996f-86422f226887 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:55.980945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dabfb-a868-4cb3-996f-86422f226887 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:55.981215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dabfb-a868-4cb3-996f-86422f226887 None admin] PATH_INFO: `/v3/users/2a3f17e923814e93b5e8b404112c17a5` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:56.000292 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1dabfb-a868-4cb3-996f-86422f226887 None admin] RBAC: Authorizing `identity:get_user(user_id=2a3f17e923814e93b5e8b404112c17a5)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:56.001934 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1dabfb-a868-4cb3-996f-86422f226887 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:56.007371 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 157/305] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:55 2022] GET /identity/v3/users/2a3f17e923814e93b5e8b404112c17a5 => generated 293 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:56.009747 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1dabfb-a868-4cb3-996f-86422f226887 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:56.015163 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25837f6e-6a38-4839-9bd5-5617bff90466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:56.015795 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25837f6e-6a38-4839-9bd5-5617bff90466 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:56.016072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25837f6e-6a38-4839-9bd5-5617bff90466 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:56.016339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25837f6e-6a38-4839-9bd5-5617bff90466 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:56.032256 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25837f6e-6a38-4839-9bd5-5617bff90466 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:56.039184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-25837f6e-6a38-4839-9bd5-5617bff90466 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:56.039184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:56.039184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:56.039184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:56.039184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:56.039184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:56.039184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:56.039184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:56.039184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:56.039184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:56.039184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:56.039184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:56.039184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:56.039184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:56.039184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:56.039184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:56.040166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:56.040166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:56.040166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:56.040166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:56.040166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:56.040166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:56.040166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:56.040166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:56.040166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:56.040166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:56.040166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:56.040166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:56.040166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:56.040166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:56.040166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:56.040166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:56.041000 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:56.041000 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:56.041000 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:56.041000 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:56.041000 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:56.041000 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:56.041000 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:56.041000 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:56.041000 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:56.041000 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:56.041000 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:56.041000 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:01:56.041000 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 149/306] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:56.048185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25837f6e-6a38-4839-9bd5-5617bff90466 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:56.133264 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:56.144575 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1dabfb-a868-4cb3-996f-86422f226887 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:56.181079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25837f6e-6a38-4839-9bd5-5617bff90466 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:56.182746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cb82a-823a-4a32-ab7c-dce5655fb2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:56.183395 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cb82a-823a-4a32-ab7c-dce5655fb2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:56.183673 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cb82a-823a-4a32-ab7c-dce5655fb2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:56.183944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cb82a-823a-4a32-ab7c-dce5655fb2a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:56.184681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cb82a-823a-4a32-ab7c-dce5655fb2a5 None admin] RBAC: Adding query filter params (role.id=78d0cc90d2f2496b9c3e75bb0ddf0c6d, user.id=2a3f17e923814e93b5e8b404112c17a5, scope.system=all) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:56.184976 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cb82a-823a-4a32-ab7c-dce5655fb2a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:56.186423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cb82a-823a-4a32-ab7c-dce5655fb2a5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:56.192587 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 158/307] 10.222.0.46 () {56 vars in 1308 bytes} [Wed Aug 10 13:01:56 2022] GET /identity/v3/role_assignments?user.id=2a3f17e923814e93b5e8b404112c17a5&scope.system=all&role.id=78d0cc90d2f2496b9c3e75bb0ddf0c6d => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:01:56.227441 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ec551-58b4-4d61-8acc-9af63625193d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:56.228403 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ec551-58b4-4d61-8acc-9af63625193d None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:56.228899 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ec551-58b4-4d61-8acc-9af63625193d None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:56.229385 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ec551-58b4-4d61-8acc-9af63625193d None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:56.230300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ec551-58b4-4d61-8acc-9af63625193d None admin] RBAC: Adding query filter params (name=member) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:56.230810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ec551-58b4-4d61-8acc-9af63625193d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:56.232490 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ec551-58b4-4d61-8acc-9af63625193d None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:56.242810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 150/308] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:01:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:56.252168 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cb82a-823a-4a32-ab7c-dce5655fb2a5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:56.261128 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af36fc-7fa1-4eb3-af10-f4f54820b66b None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:56.261433 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af36fc-7fa1-4eb3-af10-f4f54820b66b None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:56.261689 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af36fc-7fa1-4eb3-af10-f4f54820b66b None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:56.267136 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 151/309] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:01:56.268859 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16feb2c5-a797-4b41-9975-a27fad81578c None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:56.269217 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16feb2c5-a797-4b41-9975-a27fad81578c None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:56.269409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16feb2c5-a797-4b41-9975-a27fad81578c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:56.289747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-16feb2c5-a797-4b41-9975-a27fad81578c None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:56.290958 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-16feb2c5-a797-4b41-9975-a27fad81578c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:56.313563 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:56.378293 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cb82a-823a-4a32-ab7c-dce5655fb2a5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:56.380222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 152/310] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:01:56.405420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16feb2c5-a797-4b41-9975-a27fad81578c None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:56.417894 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485023a-c4c7-45e1-8f82-6f6b2c879100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:56.418529 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485023a-c4c7-45e1-8f82-6f6b2c879100 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:56.418810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485023a-c4c7-45e1-8f82-6f6b2c879100 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:56.419128 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485023a-c4c7-45e1-8f82-6f6b2c879100 None admin] PATH_INFO: `/v3/users/af5a5056e6b24a23bf877d9d12e86299` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:56.420274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485023a-c4c7-45e1-8f82-6f6b2c879100 None admin] RBAC: Authorizing `identity:get_user(user_id=af5a5056e6b24a23bf877d9d12e86299)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:56.421716 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485023a-c4c7-45e1-8f82-6f6b2c879100 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:56.423516 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 159/311] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:56 2022] GET /identity/v3/users/af5a5056e6b24a23bf877d9d12e86299 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:56.429409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485023a-c4c7-45e1-8f82-6f6b2c879100 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:56.463888 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:56.510251 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16feb2c5-a797-4b41-9975-a27fad81578c None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:56.546397 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485023a-c4c7-45e1-8f82-6f6b2c879100 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:56.555619 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3377e-c218-48f3-938c-272f73f1a6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:56.556624 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3377e-c218-48f3-938c-272f73f1a6aa None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:56.557095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3377e-c218-48f3-938c-272f73f1a6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:56.557610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3377e-c218-48f3-938c-272f73f1a6aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:56.574225 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3377e-c218-48f3-938c-272f73f1a6aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:56.578864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:56.586983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-abe3377e-c218-48f3-938c-272f73f1a6aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 13:01:56.586983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:56.586983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:56.586983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:56.586983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:56.586983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:56.586983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:56.586983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:56.586983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:56.586983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:56.586983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:56.586983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:56.586983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:56.586983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:56.586983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:56.586983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:56.587950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:56.587950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:56.587950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:56.587950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:56.587950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:56.587950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:56.587950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:56.587950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:56.587950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:56.587950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:56.587950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:56.587950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:56.587950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:56.587950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:56.587950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:56.587950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:56.588748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:56.588748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:56.588748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:56.588748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:56.588748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:56.588748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:56.588748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:56.588748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:56.588748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:56.588748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:56.588748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 13:01:56.588748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:01:56.590111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 153/312] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:01:56.595855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3377e-c218-48f3-938c-272f73f1a6aa None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:56.605749 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19303e7d-6846-4615-9e47-24a8640808de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:56.606724 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19303e7d-6846-4615-9e47-24a8640808de None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:56.607257 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19303e7d-6846-4615-9e47-24a8640808de None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:56.607782 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19303e7d-6846-4615-9e47-24a8640808de None admin] PATH_INFO: `/v3/system/users/af5a5056e6b24a23bf877d9d12e86299/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:56.609533 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19303e7d-6846-4615-9e47-24a8640808de None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=af5a5056e6b24a23bf877d9d12e86299, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:56.611189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19303e7d-6846-4615-9e47-24a8640808de None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:56.621827 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 160/313] 10.222.0.46 () {58 vars in 1334 bytes} [Wed Aug 10 13:01:56 2022] PUT /identity/v3/system/users/af5a5056e6b24a23bf877d9d12e86299/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:01:56.717395 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3377e-c218-48f3-938c-272f73f1a6aa None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:56.733937 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:56.759280 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75327ef-0c96-4956-b20c-5f8a2b2eb783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:56.759985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75327ef-0c96-4956-b20c-5f8a2b2eb783 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:56.760321 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75327ef-0c96-4956-b20c-5f8a2b2eb783 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:56.760530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75327ef-0c96-4956-b20c-5f8a2b2eb783 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:56.761205 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75327ef-0c96-4956-b20c-5f8a2b2eb783 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:56.761502 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75327ef-0c96-4956-b20c-5f8a2b2eb783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:56.762908 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75327ef-0c96-4956-b20c-5f8a2b2eb783 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:56.772543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 154/314] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:01:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:01:56.778150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19303e7d-6846-4615-9e47-24a8640808de None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:56.885276 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19303e7d-6846-4615-9e47-24a8640808de None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:56.919801 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191df4c-f683-49bf-880e-fb4ff50c91a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:56.920421 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191df4c-f683-49bf-880e-fb4ff50c91a5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:56.920697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191df4c-f683-49bf-880e-fb4ff50c91a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:56.921470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191df4c-f683-49bf-880e-fb4ff50c91a5 None admin] PATH_INFO: `/v3/users/f380cfc196434097b47cf06957f53152` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:56.922447 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191df4c-f683-49bf-880e-fb4ff50c91a5 None admin] RBAC: Authorizing `identity:get_user(user_id=f380cfc196434097b47cf06957f53152)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:56.923671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191df4c-f683-49bf-880e-fb4ff50c91a5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:56.925517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 161/315] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:56 2022] GET /identity/v3/users/f380cfc196434097b47cf06957f53152 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:56.931152 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75327ef-0c96-4956-b20c-5f8a2b2eb783 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:57.040968 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75327ef-0c96-4956-b20c-5f8a2b2eb783 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:57.079113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bcb33-cb8b-4d49-bcc5-7639568992ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:57.079733 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bcb33-cb8b-4d49-bcc5-7639568992ab None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:57.080010 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bcb33-cb8b-4d49-bcc5-7639568992ab None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:57.080281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bcb33-cb8b-4d49-bcc5-7639568992ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:57.129163 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:57.153805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bcb33-cb8b-4d49-bcc5-7639568992ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:57.155293 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bcb33-cb8b-4d49-bcc5-7639568992ab None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:57.258586 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 155/316] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:01:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:57.264043 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191df4c-f683-49bf-880e-fb4ff50c91a5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:57.320195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:57.369392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191df4c-f683-49bf-880e-fb4ff50c91a5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:57.405540 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c297d99-cc88-40e7-a650-724e61c5903c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:57.406169 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c297d99-cc88-40e7-a650-724e61c5903c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:57.406448 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c297d99-cc88-40e7-a650-724e61c5903c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:57.406720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c297d99-cc88-40e7-a650-724e61c5903c None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:57.407873 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c297d99-cc88-40e7-a650-724e61c5903c None admin] RBAC: Authorizing `identity:get_project(project_id=68df1934bba847eeaf81f0f154f6edd1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:57.409496 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c297d99-cc88-40e7-a650-724e61c5903c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:57.411461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 162/317] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:01:57 2022] GET /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:57.422155 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bcb33-cb8b-4d49-bcc5-7639568992ab None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:57.501362 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:57.531797 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bcb33-cb8b-4d49-bcc5-7639568992ab None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:57.571579 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39578f-c1e1-4f26-80b0-f4c82a36b5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:57.572107 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39578f-c1e1-4f26-80b0-f4c82a36b5fe None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:57.572409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39578f-c1e1-4f26-80b0-f4c82a36b5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:57.572682 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39578f-c1e1-4f26-80b0-f4c82a36b5fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:57.573407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39578f-c1e1-4f26-80b0-f4c82a36b5fe None admin] RBAC: Adding query filter params (role.id=78d0cc90d2f2496b9c3e75bb0ddf0c6d, scope.project.id=68df1934bba847eeaf81f0f154f6edd1, user.id=f380cfc196434097b47cf06957f53152) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:57.573713 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39578f-c1e1-4f26-80b0-f4c82a36b5fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:57.575164 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39578f-c1e1-4f26-80b0-f4c82a36b5fe None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:57.581756 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 156/318] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:01:57 2022] GET /identity/v3/role_assignments?user.id=f380cfc196434097b47cf06957f53152&scope.project.id=68df1934bba847eeaf81f0f154f6edd1&role.id=78d0cc90d2f2496b9c3e75bb0ddf0c6d => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:57.980163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63b9ce-7ba3-4669-84be-e72984c23cc1 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:57.980500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63b9ce-7ba3-4669-84be-e72984c23cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:57.980671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63b9ce-7ba3-4669-84be-e72984c23cc1 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:57.982431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 163/319] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:57.987434 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1189537-a70e-4f24-99a1-8e0ca19aad3a None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:57.987718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1189537-a70e-4f24-99a1-8e0ca19aad3a None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:57.987987 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1189537-a70e-4f24-99a1-8e0ca19aad3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:58.006428 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-e1189537-a70e-4f24-99a1-8e0ca19aad3a None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:58.007651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-e1189537-a70e-4f24-99a1-8e0ca19aad3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:58.073968 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 157/320] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:01:58.095681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63b9ce-7ba3-4669-84be-e72984c23cc1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:58.196302 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63b9ce-7ba3-4669-84be-e72984c23cc1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:58.216399 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:58.232653 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169277c8-e02c-4c5f-955c-4f59e0c08bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:58.233218 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169277c8-e02c-4c5f-955c-4f59e0c08bce None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:58.233495 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169277c8-e02c-4c5f-955c-4f59e0c08bce None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:58.233766 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169277c8-e02c-4c5f-955c-4f59e0c08bce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:58.234851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169277c8-e02c-4c5f-955c-4f59e0c08bce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:58.236307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169277c8-e02c-4c5f-955c-4f59e0c08bce None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:58.238032 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 164/321] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:01:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:58.243920 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1189537-a70e-4f24-99a1-8e0ca19aad3a None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:58.317197 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:58.350260 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1189537-a70e-4f24-99a1-8e0ca19aad3a None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:58.385192 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036fe22-8aa4-444f-9873-44e697618430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:58.385752 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036fe22-8aa4-444f-9873-44e697618430 None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:58.386033 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036fe22-8aa4-444f-9873-44e697618430 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:58.386407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036fe22-8aa4-444f-9873-44e697618430 None admin] PATH_INFO: `/v3/groups` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:58.386933 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036fe22-8aa4-444f-9873-44e697618430 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:58.388457 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036fe22-8aa4-444f-9873-44e697618430 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:58.411045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 158/322] 10.222.0.46 () {60 vars in 1134 bytes} [Wed Aug 10 13:01:58 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:01:58.430439 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12721edc-b481-4ade-bd0e-eb021ce5c3d6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:58.430981 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12721edc-b481-4ade-bd0e-eb021ce5c3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:58.430981 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12721edc-b481-4ade-bd0e-eb021ce5c3d6 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:58.432633 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 165/323] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:01:58.438215 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e1dbd-a32f-4f2d-851d-ccd58c4ff1cb None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:58.438503 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e1dbd-a32f-4f2d-851d-ccd58c4ff1cb None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:58.438779 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e1dbd-a32f-4f2d-851d-ccd58c4ff1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:58.458551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-5c9e1dbd-a32f-4f2d-851d-ccd58c4ff1cb None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:58.459820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-5c9e1dbd-a32f-4f2d-851d-ccd58c4ff1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:58.535254 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 159/324] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:01:58.557945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12721edc-b481-4ade-bd0e-eb021ce5c3d6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:58.674555 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12721edc-b481-4ade-bd0e-eb021ce5c3d6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:58.710876 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b13aa-eef1-4c02-a5f7-b9f4ddfc55a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:58.711601 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b13aa-eef1-4c02-a5f7-b9f4ddfc55a7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:58.711882 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b13aa-eef1-4c02-a5f7-b9f4ddfc55a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:58.712155 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b13aa-eef1-4c02-a5f7-b9f4ddfc55a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:58.722952 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b13aa-eef1-4c02-a5f7-b9f4ddfc55a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:58.728794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2f4b13aa-eef1-4c02-a5f7-b9f4ddfc55a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 13:01:58.728794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:58.728794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:58.728794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:58.728794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:58.728794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:58.728794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:58.728794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:58.728794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:58.728794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:58.728794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:58.728794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:58.728794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:58.728794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:58.728794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:58.728794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:58.729699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:58.729699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:58.729699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:58.729699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:58.729699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:58.729699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:58.729699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:58.729699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:58.729699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:58.729699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:58.729699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:58.729699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:58.729699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:58.729699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:58.729699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:58.729699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:58.730511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:58.730511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:58.730511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:58.730511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:58.730511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:58.730511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:58.730511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:58.730511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:58.730511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:58.730511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:58.730511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 13:01:58.730511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:01:58.734735 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 166/325] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:01:58.739212 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e1dbd-a32f-4f2d-851d-ccd58c4ff1cb None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:58.741846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2c223-dc38-42a2-a8e4-0f483313f209 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:58.742132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2c223-dc38-42a2-a8e4-0f483313f209 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:58.742406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2c223-dc38-42a2-a8e4-0f483313f209 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:58.743938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 167/326] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:01:58.748902 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513cbb5-e18f-4308-acf8-fb7e25c94326 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:58.749183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513cbb5-e18f-4308-acf8-fb7e25c94326 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:58.749451 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513cbb5-e18f-4308-acf8-fb7e25c94326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:58.772831 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6513cbb5-e18f-4308-acf8-fb7e25c94326 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:01:58.774377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6513cbb5-e18f-4308-acf8-fb7e25c94326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:01:58.818441 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:58.828295 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:58.870622 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 168/327] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:01:58.877033 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e1dbd-a32f-4f2d-851d-ccd58c4ff1cb None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:58.892822 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513cbb5-e18f-4308-acf8-fb7e25c94326 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:58.921834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a1f63-ae75-4dd2-a77d-965c4f297730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:58.922457 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a1f63-ae75-4dd2-a77d-965c4f297730 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:58.922734 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a1f63-ae75-4dd2-a77d-965c4f297730 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:58.923022 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a1f63-ae75-4dd2-a77d-965c4f297730 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:58.923771 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a1f63-ae75-4dd2-a77d-965c4f297730 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:58.924073 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a1f63-ae75-4dd2-a77d-965c4f297730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:58.925440 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a1f63-ae75-4dd2-a77d-965c4f297730 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:58.938112 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 160/328] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:01:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:58.946478 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a1f63-ae75-4dd2-a77d-965c4f297730 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:59.034636 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513cbb5-e18f-4308-acf8-fb7e25c94326 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:59.082856 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042ef00-54dc-46fc-80c3-f26647261359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:59.083949 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042ef00-54dc-46fc-80c3-f26647261359 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:59.084993 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042ef00-54dc-46fc-80c3-f26647261359 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:59.085510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042ef00-54dc-46fc-80c3-f26647261359 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:59.093217 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a1f63-ae75-4dd2-a77d-965c4f297730 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:59.103745 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042ef00-54dc-46fc-80c3-f26647261359 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:01:59.109078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-1042ef00-54dc-46fc-80c3-f26647261359 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:59.109078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:01:59.109078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:01:59.109078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:01:59.109078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:01:59.109078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:01:59.109078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:01:59.109078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:01:59.109078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:01:59.109078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:01:59.109078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:01:59.109078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:01:59.109078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:01:59.109078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:01:59.109078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:01:59.109078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:01:59.109951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:01:59.109951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:01:59.109951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:01:59.109951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:01:59.109951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:01:59.109951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:01:59.109951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:01:59.109951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:01:59.109951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:01:59.109951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:01:59.109951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:01:59.109951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:01:59.109951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:01:59.109951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:01:59.109951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:01:59.109951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:01:59.110770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:01:59.110770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:01:59.110770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:01:59.110770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:01:59.110770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:01:59.110770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:01:59.110770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:01:59.110770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:01:59.110770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:01:59.110770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:01:59.110770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:01:59.110770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:01:59.113475 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 169/329] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:01:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:01:59.119510 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:59.120295 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042ef00-54dc-46fc-80c3-f26647261359 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:59.137282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfa3ee-15e3-4ee8-ac67-54d66e47283c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:59.138287 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfa3ee-15e3-4ee8-ac67-54d66e47283c None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:59.138807 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfa3ee-15e3-4ee8-ac67-54d66e47283c None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:59.139353 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfa3ee-15e3-4ee8-ac67-54d66e47283c None admin] PATH_INFO: `/v3/users/2a3f17e923814e93b5e8b404112c17a5` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:59.141169 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfa3ee-15e3-4ee8-ac67-54d66e47283c None admin] RBAC: Authorizing `identity:get_user(user_id=2a3f17e923814e93b5e8b404112c17a5)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:59.142833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfa3ee-15e3-4ee8-ac67-54d66e47283c None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:59.148671 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 161/330] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:58 2022] GET /identity/v3/users/2a3f17e923814e93b5e8b404112c17a5 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:01:59.150982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfa3ee-15e3-4ee8-ac67-54d66e47283c None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:59.179661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:59.260406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042ef00-54dc-46fc-80c3-f26647261359 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:59.288428 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfa3ee-15e3-4ee8-ac67-54d66e47283c None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:59.308248 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bd920-e562-4cc9-b7e0-133230d99e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:59.309382 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bd920-e562-4cc9-b7e0-133230d99e52 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:59.309866 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bd920-e562-4cc9-b7e0-133230d99e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:59.310428 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bd920-e562-4cc9-b7e0-133230d99e52 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:59.311445 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bd920-e562-4cc9-b7e0-133230d99e52 None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:59.312075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bd920-e562-4cc9-b7e0-133230d99e52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:59.313688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bd920-e562-4cc9-b7e0-133230d99e52 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:59.324291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 170/331] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:01:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:59.332164 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bd920-e562-4cc9-b7e0-133230d99e52 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:59.332481 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f29315-b62c-47b7-a9ed-1873cf5da8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:59.333272 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f29315-b62c-47b7-a9ed-1873cf5da8e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:59.333499 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f29315-b62c-47b7-a9ed-1873cf5da8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:59.333776 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f29315-b62c-47b7-a9ed-1873cf5da8e0 None admin] PATH_INFO: `/v3/system/users/2a3f17e923814e93b5e8b404112c17a5/roles/78d0cc90d2f2496b9c3e75bb0ddf0c6d` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:59.335913 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f29315-b62c-47b7-a9ed-1873cf5da8e0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2a3f17e923814e93b5e8b404112c17a5, role_id=78d0cc90d2f2496b9c3e75bb0ddf0c6d)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:59.339248 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f29315-b62c-47b7-a9ed-1873cf5da8e0 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:59.349476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 162/332] 10.222.0.46 () {58 vars in 1334 bytes} [Wed Aug 10 13:01:59 2022] PUT /identity/v3/system/users/2a3f17e923814e93b5e8b404112c17a5/roles/78d0cc90d2f2496b9c3e75bb0ddf0c6d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:01:59.479182 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:59.491039 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bd920-e562-4cc9-b7e0-133230d99e52 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:59.535199 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d9702-6e0b-4beb-8e0d-0641eb296b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:59.535847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d9702-6e0b-4beb-8e0d-0641eb296b96 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:59.536124 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d9702-6e0b-4beb-8e0d-0641eb296b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:59.536399 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d9702-6e0b-4beb-8e0d-0641eb296b96 None admin] PATH_INFO: `/v3/users/af5a5056e6b24a23bf877d9d12e86299` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:59.543980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d9702-6e0b-4beb-8e0d-0641eb296b96 None admin] RBAC: Authorizing `identity:get_user(user_id=af5a5056e6b24a23bf877d9d12e86299)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:59.545485 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d9702-6e0b-4beb-8e0d-0641eb296b96 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:59.547573 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 171/333] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:01:59 2022] GET /identity/v3/users/af5a5056e6b24a23bf877d9d12e86299 => generated 293 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:01:59.553754 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f29315-b62c-47b7-a9ed-1873cf5da8e0 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:01:59.647644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:59.705044 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f29315-b62c-47b7-a9ed-1873cf5da8e0 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:01:59.749693 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70d6c0-eea4-42d2-aa52-7c98feb7d7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:01:59.750306 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70d6c0-eea4-42d2-aa52-7c98feb7d7be None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:01:59.750585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70d6c0-eea4-42d2-aa52-7c98feb7d7be None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:01:59.750858 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70d6c0-eea4-42d2-aa52-7c98feb7d7be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:01:59.751611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70d6c0-eea4-42d2-aa52-7c98feb7d7be None admin] RBAC: Adding query filter params (role.id=2223c0caa0c948abbe85384d16a465a2, user.id=af5a5056e6b24a23bf877d9d12e86299, scope.system=all) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:01:59.751919 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70d6c0-eea4-42d2-aa52-7c98feb7d7be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:01:59.753357 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70d6c0-eea4-42d2-aa52-7c98feb7d7be None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:01:59.768344 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 163/334] 10.222.0.46 () {56 vars in 1308 bytes} [Wed Aug 10 13:01:59 2022] GET /identity/v3/role_assignments?user.id=af5a5056e6b24a23bf877d9d12e86299&scope.system=all&role.id=2223c0caa0c948abbe85384d16a465a2 => generated 510 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:00.860994 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18100d-5cd1-4343-8418-1c2ec969cc17 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:00.861512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18100d-5cd1-4343-8418-1c2ec969cc17 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:00.861512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18100d-5cd1-4343-8418-1c2ec969cc17 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:00.863268 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 172/335] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:00.869436 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c11435-c001-4179-92bd-c8fa059d674d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:00.869880 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c11435-c001-4179-92bd-c8fa059d674d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:00.869974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c11435-c001-4179-92bd-c8fa059d674d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:00.893196 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-21c11435-c001-4179-92bd-c8fa059d674d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:00.894388 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-21c11435-c001-4179-92bd-c8fa059d674d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:00.980661 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 164/336] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:01.017563 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18100d-5cd1-4343-8418-1c2ec969cc17 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:01.143829 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18100d-5cd1-4343-8418-1c2ec969cc17 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:01.184599 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5aa241-526b-485d-8de5-6989dab1dbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:01.185232 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5aa241-526b-485d-8de5-6989dab1dbef None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:01.185511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5aa241-526b-485d-8de5-6989dab1dbef None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:01.185838 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5aa241-526b-485d-8de5-6989dab1dbef None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:01.203934 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5aa241-526b-485d-8de5-6989dab1dbef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:01.209436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-8b5aa241-526b-485d-8de5-6989dab1dbef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:02:01.209436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:01.209436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:01.209436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:01.209436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:01.209436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:01.209436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:01.209436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:01.209436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:01.209436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:01.209436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:01.209436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:01.209436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:01.209436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:01.209436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:01.209436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:01.210363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:01.210363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:01.210363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:01.210363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:01.210363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:01.210363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:01.210363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:01.210363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:01.210363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:01.210363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:01.210363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:01.210363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:01.210363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:01.210363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:01.210363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:01.210363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:01.211600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:01.211600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:01.211600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:01.211600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:01.211600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:01.211600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:01.211600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:01.211600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:01.211600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:01.211600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:01.211600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:02:01.211600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:01.211600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 173/337] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:02:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:01.216823 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c11435-c001-4179-92bd-c8fa059d674d None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:01.291943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:01.363805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c11435-c001-4179-92bd-c8fa059d674d None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:01.406481 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9df7c7-1f04-4e72-a84f-e4b55836998a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:01.407033 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9df7c7-1f04-4e72-a84f-e4b55836998a None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:01.407314 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9df7c7-1f04-4e72-a84f-e4b55836998a None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:01.407587 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9df7c7-1f04-4e72-a84f-e4b55836998a None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:01.408438 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9df7c7-1f04-4e72-a84f-e4b55836998a None admin] RBAC: Adding query filter params (name=member) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:01.408742 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9df7c7-1f04-4e72-a84f-e4b55836998a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:01.410110 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9df7c7-1f04-4e72-a84f-e4b55836998a None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:01.415165 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd257833-7f8c-47ef-8cf0-3372cec2b389 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:01.415452 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd257833-7f8c-47ef-8cf0-3372cec2b389 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:01.415728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd257833-7f8c-47ef-8cf0-3372cec2b389 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:01.417291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 174/338] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:01.419745 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 165/339] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:02:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:01.428622 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9df7c7-1f04-4e72-a84f-e4b55836998a None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:01.428860 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ebe3f-f69f-4fc5-9be6-020f9a622242 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:01.429150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ebe3f-f69f-4fc5-9be6-020f9a622242 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:01.429423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ebe3f-f69f-4fc5-9be6-020f9a622242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:01.451813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5e7ebe3f-f69f-4fc5-9be6-020f9a622242 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:01.453015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5e7ebe3f-f69f-4fc5-9be6-020f9a622242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:01.498874 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:01.604076 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9df7c7-1f04-4e72-a84f-e4b55836998a None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:01.611363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:01.626639 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 175/340] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:01.651401 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a497230-4db2-4fc0-9a7f-3829d0eaa2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:01.652062 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a497230-4db2-4fc0-9a7f-3829d0eaa2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:01.652350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a497230-4db2-4fc0-9a7f-3829d0eaa2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:01.652623 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a497230-4db2-4fc0-9a7f-3829d0eaa2b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:01.672247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ebe3f-f69f-4fc5-9be6-020f9a622242 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:01.732636 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a497230-4db2-4fc0-9a7f-3829d0eaa2b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:01.734101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a497230-4db2-4fc0-9a7f-3829d0eaa2b8 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:01.879338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 166/341] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:01.891026 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a497230-4db2-4fc0-9a7f-3829d0eaa2b8 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:01.895347 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:01.965853 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ebe3f-f69f-4fc5-9be6-020f9a622242 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:02.029562 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a497230-4db2-4fc0-9a7f-3829d0eaa2b8 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:02.067104 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f8a4d-06de-4168-9832-3ec6bbe2b0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:02.068084 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f8a4d-06de-4168-9832-3ec6bbe2b0c0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:02.068631 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f8a4d-06de-4168-9832-3ec6bbe2b0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:02.069593 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f8a4d-06de-4168-9832-3ec6bbe2b0c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:02.087762 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b907af-6920-4de1-bc46-1c98c9728b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:02.088427 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b907af-6920-4de1-bc46-1c98c9728b42 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:02.088712 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b907af-6920-4de1-bc46-1c98c9728b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:02.088985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b907af-6920-4de1-bc46-1c98c9728b42 None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:02.089701 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f8a4d-06de-4168-9832-3ec6bbe2b0c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:02.090204 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b907af-6920-4de1-bc46-1c98c9728b42 None admin] RBAC: Authorizing `identity:get_project(project_id=66166393e3e0490ea30d39e178525784)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:02.091673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b907af-6920-4de1-bc46-1c98c9728b42 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:02.094527 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 167/342] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:02:01 2022] GET /identity/v3/projects/66166393e3e0490ea30d39e178525784 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:02.096398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5a8f8a4d-06de-4168-9832-3ec6bbe2b0c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:02:02.096398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:02.096398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:02.096398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:02.096398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:02.096398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:02.096398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:02.096398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:02.096398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:02.096398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:02.096398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:02.096398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:02.096398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:02.096398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:02.096398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:02.096398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:02.097284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:02.097284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:02.097284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:02.097284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:02.097284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:02.097284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:02.097284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:02.097284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:02.097284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:02.097284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:02.097284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:02.097284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:02.097284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:02.097284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:02.097284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:02.097284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:02.103848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:02.103848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:02.103848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:02.103848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:02.103848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:02.103848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:02.103848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:02.103848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:02.103848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:02.103848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:02.103848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:02:02.103848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:02.104454 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b907af-6920-4de1-bc46-1c98c9728b42 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:02.106348 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 176/343] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 10 13:02:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:02.111783 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f8a4d-06de-4168-9832-3ec6bbe2b0c0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:02.155363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:02.221398 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:02.257763 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b907af-6920-4de1-bc46-1c98c9728b42 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:02.328846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd30a9d-7716-42a7-8ce7-e20dfa90e1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:02.329496 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd30a9d-7716-42a7-8ce7-e20dfa90e1ec None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:02.329811 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd30a9d-7716-42a7-8ce7-e20dfa90e1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:02.330043 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd30a9d-7716-42a7-8ce7-e20dfa90e1ec None admin] PATH_INFO: `/v3/groups/a295b2ec238e436f8f0ffaaf63111c43` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:02.332244 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f8a4d-06de-4168-9832-3ec6bbe2b0c0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:02.347178 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd30a9d-7716-42a7-8ce7-e20dfa90e1ec None admin] RBAC: Authorizing `identity:get_group(group_id=a295b2ec238e436f8f0ffaaf63111c43)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:02.348767 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd30a9d-7716-42a7-8ce7-e20dfa90e1ec None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:02.350802 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 168/344] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 10 13:02:02 2022] GET /identity/v3/groups/a295b2ec238e436f8f0ffaaf63111c43 => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:02.357077 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd30a9d-7716-42a7-8ce7-e20dfa90e1ec None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:02.384511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966136f-4ad3-4f78-bf18-4296fc08ed51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:02.385721 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966136f-4ad3-4f78-bf18-4296fc08ed51 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:02.386199 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966136f-4ad3-4f78-bf18-4296fc08ed51 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:02.386660 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966136f-4ad3-4f78-bf18-4296fc08ed51 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:02.387577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966136f-4ad3-4f78-bf18-4296fc08ed51 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:02.388075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966136f-4ad3-4f78-bf18-4296fc08ed51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:02.389678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966136f-4ad3-4f78-bf18-4296fc08ed51 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:02.403423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 177/345] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:02:02.404702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966136f-4ad3-4f78-bf18-4296fc08ed51 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:02.501353 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:02.524936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966136f-4ad3-4f78-bf18-4296fc08ed51 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:02.558884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd30a9d-7716-42a7-8ce7-e20dfa90e1ec None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:02.574116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f9d72-aeaa-4a7e-95bf-0eaf4738f8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:02.574745 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f9d72-aeaa-4a7e-95bf-0eaf4738f8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:02.575041 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f9d72-aeaa-4a7e-95bf-0eaf4738f8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:02.575317 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f9d72-aeaa-4a7e-95bf-0eaf4738f8d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:02.621888 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ad8fb-a8e7-45b4-9732-9110dd78aa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:02.622416 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ad8fb-a8e7-45b4-9732-9110dd78aa9f None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:02.622704 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ad8fb-a8e7-45b4-9732-9110dd78aa9f None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:02.622978 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ad8fb-a8e7-45b4-9732-9110dd78aa9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:02.623733 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ad8fb-a8e7-45b4-9732-9110dd78aa9f None admin] RBAC: Adding query filter params (group.id=a295b2ec238e436f8f0ffaaf63111c43, role.id=2223c0caa0c948abbe85384d16a465a2, scope.project.id=66166393e3e0490ea30d39e178525784) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:02.624044 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ad8fb-a8e7-45b4-9732-9110dd78aa9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:02.625566 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ad8fb-a8e7-45b4-9732-9110dd78aa9f None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:02.640933 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 169/346] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Aug 10 13:02:02 2022] GET /identity/v3/role_assignments?group.id=a295b2ec238e436f8f0ffaaf63111c43&scope.project.id=66166393e3e0490ea30d39e178525784&role.id=2223c0caa0c948abbe85384d16a465a2 => generated 260 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:02.642282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635128dd-97c2-45d2-98a6-1236ac055ee5 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:02.642571 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635128dd-97c2-45d2-98a6-1236ac055ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:02.642844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635128dd-97c2-45d2-98a6-1236ac055ee5 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:02.644857 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 170/347] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:02.646411 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:02.651072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ec196-ce74-4f6b-a8f7-8daf15eb40b1 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:02.651394 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ec196-ce74-4f6b-a8f7-8daf15eb40b1 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:02.651637 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ec196-ce74-4f6b-a8f7-8daf15eb40b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:02.667015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f9d72-aeaa-4a7e-95bf-0eaf4738f8d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:02.668951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f9d72-aeaa-4a7e-95bf-0eaf4738f8d1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:02.692541 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-3c6ec196-ce74-4f6b-a8f7-8daf15eb40b1 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:02.693923 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3c6ec196-ce74-4f6b-a8f7-8daf15eb40b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:02.777732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:02.801937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 178/348] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:02.808235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7469e-2f93-4872-9a90-584222ff1966 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:02.808812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7469e-2f93-4872-9a90-584222ff1966 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:02.809352 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7469e-2f93-4872-9a90-584222ff1966 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:02.811598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 179/349] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:02.811859 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 171/350] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:02.812962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7469e-2f93-4872-9a90-584222ff1966 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:02.830571 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9d237-1be4-40e1-8529-68752ed0c9ff None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:02.830909 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9d237-1be4-40e1-8529-68752ed0c9ff None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:02.831238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9d237-1be4-40e1-8529-68752ed0c9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:02.861774 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-e8e9d237-1be4-40e1-8529-68752ed0c9ff None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:02.862811 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-e8e9d237-1be4-40e1-8529-68752ed0c9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:02.952817 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 172/351] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:02.953555 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9d237-1be4-40e1-8529-68752ed0c9ff None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:02.954581 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7469e-2f93-4872-9a90-584222ff1966 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:03.014132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e12035-b05d-4874-8cb1-2bf10e85eaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:03.014883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e12035-b05d-4874-8cb1-2bf10e85eaac None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:03.015150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e12035-b05d-4874-8cb1-2bf10e85eaac None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:03.015426 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e12035-b05d-4874-8cb1-2bf10e85eaac None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:03.017703 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e12035-b05d-4874-8cb1-2bf10e85eaac None admin] RBAC: Authorizing `identity:get_project(project_id=66166393e3e0490ea30d39e178525784)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:03.019183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e12035-b05d-4874-8cb1-2bf10e85eaac None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:03.020897 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 180/352] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:02:02 2022] GET /identity/v3/projects/66166393e3e0490ea30d39e178525784 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:03.022199 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e12035-b05d-4874-8cb1-2bf10e85eaac None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:03.080541 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:03.122500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:03.142547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9d237-1be4-40e1-8529-68752ed0c9ff None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:03.180303 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e12035-b05d-4874-8cb1-2bf10e85eaac None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:03.183815 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f5563-f98e-4ba9-b722-7159adc83df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:03.184557 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f5563-f98e-4ba9-b722-7159adc83df8 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:03.184930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f5563-f98e-4ba9-b722-7159adc83df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:03.185294 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f5563-f98e-4ba9-b722-7159adc83df8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:03.198378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f5563-f98e-4ba9-b722-7159adc83df8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:03.203719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-9c8f5563-f98e-4ba9-b722-7159adc83df8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 13:02:03.203719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:03.203719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:03.203719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:03.203719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:03.203719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:03.203719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:03.203719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:03.203719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:03.203719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:03.203719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:03.203719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:03.203719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:03.203719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:03.203719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:03.203719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:03.204885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:03.204885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:03.204885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:03.204885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:03.204885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:03.204885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:03.204885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:03.204885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:03.204885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:03.204885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:03.204885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:03.204885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:03.204885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:03.204885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:03.204885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:03.204885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:03.205813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:03.205813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:03.205813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:03.205813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:03.205813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:03.205813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:03.205813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:03.205813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:03.205813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:03.205813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:03.205813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 13:02:03.205813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:03.206450 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 173/353] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:02:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:03.207572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f5563-f98e-4ba9-b722-7159adc83df8 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:03.222230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf037f-b10f-4e83-8c0f-1a15b2231f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:03.223196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf037f-b10f-4e83-8c0f-1a15b2231f19 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:03.223654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf037f-b10f-4e83-8c0f-1a15b2231f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:03.224100 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf037f-b10f-4e83-8c0f-1a15b2231f19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:03.235227 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf037f-b10f-4e83-8c0f-1a15b2231f19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:03.240286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-1daf037f-b10f-4e83-8c0f-1a15b2231f19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:02:03.240286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:03.240286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:03.240286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:03.240286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:03.240286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:03.240286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:03.240286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:03.240286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:03.240286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:03.240286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:03.240286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:03.240286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:03.240286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:03.240286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:03.240286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:03.241220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:03.241220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:03.241220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:03.241220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:03.241220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:03.241220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:03.241220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:03.241220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:03.241220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:03.241220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:03.241220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:03.241220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:03.241220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:03.241220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:03.241220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:03.241220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:03.242028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:03.242028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:03.242028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:03.242028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:03.242028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:03.242028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:03.242028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:03.242028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:03.242028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:03.242028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:03.242028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:02:03.242028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:03.244627 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 181/354] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:02:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:03.246061 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c70c5-d692-4585-9089-a876abad1ffc None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:03.246552 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c70c5-d692-4585-9089-a876abad1ffc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:03.247078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c70c5-d692-4585-9089-a876abad1ffc None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:03.248811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 182/355] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:03.249729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c70c5-d692-4585-9089-a876abad1ffc None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:03.319222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f5563-f98e-4ba9-b722-7159adc83df8 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:03.340912 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:03.357261 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8950a88-ef40-4981-8cde-2bac84557f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:03.357893 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8950a88-ef40-4981-8cde-2bac84557f3c None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:03.358165 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8950a88-ef40-4981-8cde-2bac84557f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:03.358433 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8950a88-ef40-4981-8cde-2bac84557f3c None admin] PATH_INFO: `/v3/groups/a295b2ec238e436f8f0ffaaf63111c43` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:03.359556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8950a88-ef40-4981-8cde-2bac84557f3c None admin] RBAC: Authorizing `identity:get_group(group_id=a295b2ec238e436f8f0ffaaf63111c43)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:03.360981 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8950a88-ef40-4981-8cde-2bac84557f3c None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:03.362888 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 174/356] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 10 13:02:03 2022] GET /identity/v3/groups/a295b2ec238e436f8f0ffaaf63111c43 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:03.363807 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8950a88-ef40-4981-8cde-2bac84557f3c None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:03.368800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c70c5-d692-4585-9089-a876abad1ffc None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:03.379595 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:03.408648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a308486-bada-45db-b999-981cef5a5157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:03.409649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a308486-bada-45db-b999-981cef5a5157 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:03.410140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a308486-bada-45db-b999-981cef5a5157 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:03.410610 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a308486-bada-45db-b999-981cef5a5157 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:03.413217 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a308486-bada-45db-b999-981cef5a5157 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:03.413769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a308486-bada-45db-b999-981cef5a5157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:03.415451 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a308486-bada-45db-b999-981cef5a5157 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:03.424900 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 183/357] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:02:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:03.426536 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cc690-5c1b-4076-81e5-19fac19af2f6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:03.427102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cc690-5c1b-4076-81e5-19fac19af2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:03.427578 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cc690-5c1b-4076-81e5-19fac19af2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:03.446322 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d89cc690-5c1b-4076-81e5-19fac19af2f6 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:03.447912 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d89cc690-5c1b-4076-81e5-19fac19af2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:03.473630 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8950a88-ef40-4981-8cde-2bac84557f3c None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:03.512144 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6af59-83bc-43cc-b7de-2b065942eddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:03.512853 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6af59-83bc-43cc-b7de-2b065942eddc None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:03.513054 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6af59-83bc-43cc-b7de-2b065942eddc None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:03.513315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6af59-83bc-43cc-b7de-2b065942eddc None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:03.513975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6af59-83bc-43cc-b7de-2b065942eddc None admin] RBAC: Adding query filter params (name=member) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:03.514532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6af59-83bc-43cc-b7de-2b065942eddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:03.516381 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6af59-83bc-43cc-b7de-2b065942eddc None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:03.524299 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 184/358] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:03.525420 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cc690-5c1b-4076-81e5-19fac19af2f6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:03.526349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 175/359] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:02:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:03.531036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6af59-83bc-43cc-b7de-2b065942eddc None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:03.581236 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:03.638466 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6af59-83bc-43cc-b7de-2b065942eddc None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:03.652227 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:03.656238 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cc690-5c1b-4076-81e5-19fac19af2f6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:03.681481 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e03d85-a5fd-422b-a7d7-786d905b8e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:03.682120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e03d85-a5fd-422b-a7d7-786d905b8e17 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:03.682397 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e03d85-a5fd-422b-a7d7-786d905b8e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:03.682669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e03d85-a5fd-422b-a7d7-786d905b8e17 None admin] PATH_INFO: `/v3/users/2a3f17e923814e93b5e8b404112c17a5` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:03.687355 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e03d85-a5fd-422b-a7d7-786d905b8e17 None admin] RBAC: Authorizing `identity:get_user(user_id=2a3f17e923814e93b5e8b404112c17a5)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:03.689267 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e03d85-a5fd-422b-a7d7-786d905b8e17 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:03.691394 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 176/360] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:02:03 2022] GET /identity/v3/users/2a3f17e923814e93b5e8b404112c17a5 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:03.692665 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e03d85-a5fd-422b-a7d7-786d905b8e17 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:03.696926 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50956c30-ded0-473e-83a4-0046ec2b56cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:03.697716 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50956c30-ded0-473e-83a4-0046ec2b56cb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:03.698142 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50956c30-ded0-473e-83a4-0046ec2b56cb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:03.698558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50956c30-ded0-473e-83a4-0046ec2b56cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:03.699509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50956c30-ded0-473e-83a4-0046ec2b56cb None admin] RBAC: Adding query filter params (group.id=a295b2ec238e436f8f0ffaaf63111c43, role.id=0a020d67ea4d4d62b1305fd0cd952779, scope.project.id=66166393e3e0490ea30d39e178525784) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:03.699984 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50956c30-ded0-473e-83a4-0046ec2b56cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:03.701563 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50956c30-ded0-473e-83a4-0046ec2b56cb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:03.709871 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 185/361] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Aug 10 13:02:03 2022] GET /identity/v3/role_assignments?group.id=a295b2ec238e436f8f0ffaaf63111c43&scope.project.id=66166393e3e0490ea30d39e178525784&role.id=0a020d67ea4d4d62b1305fd0cd952779 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:03.711045 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50956c30-ded0-473e-83a4-0046ec2b56cb None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:03.825000 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e03d85-a5fd-422b-a7d7-786d905b8e17 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:03.838331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50956c30-ded0-473e-83a4-0046ec2b56cb None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:03.844455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:03.863589 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355b0f6-dde5-4b74-95f2-a78ca9b7b94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:03.864210 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355b0f6-dde5-4b74-95f2-a78ca9b7b94a None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:03.864486 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355b0f6-dde5-4b74-95f2-a78ca9b7b94a None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:03.864755 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355b0f6-dde5-4b74-95f2-a78ca9b7b94a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:03.880044 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d79bf3-a2a6-4f4f-a06d-8e5372557da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:03.881924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d79bf3-a2a6-4f4f-a06d-8e5372557da4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:03.882607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d79bf3-a2a6-4f4f-a06d-8e5372557da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:03.883074 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d79bf3-a2a6-4f4f-a06d-8e5372557da4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:03.898661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d79bf3-a2a6-4f4f-a06d-8e5372557da4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:03.905812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-f0d79bf3-a2a6-4f4f-a06d-8e5372557da4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:02:03.905812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:03.905812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:03.905812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:03.905812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:03.905812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:03.905812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:03.905812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:03.905812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:03.905812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:03.905812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:03.905812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:03.905812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:03.905812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:03.905812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:03.905812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:03.906887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:03.906887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:03.906887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:03.906887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:03.906887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:03.906887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:03.906887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:03.906887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:03.906887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:03.906887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:03.906887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:03.906887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:03.906887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:03.906887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:03.906887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:03.906887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:03.907920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:03.907920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:03.907920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:03.907920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:03.907920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:03.907920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:03.907920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:03.907920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:03.907920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:03.907920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:03.907920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:02:03.907920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:03.908591 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 186/362] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 10 13:02:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:03.914700 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f97b2-aad2-42d4-a98f-320d5854ac1f None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:03.914700 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f97b2-aad2-42d4-a98f-320d5854ac1f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:03.914700 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f97b2-aad2-42d4-a98f-320d5854ac1f None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:03.914700 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 187/363] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:03.914700 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f97b2-aad2-42d4-a98f-320d5854ac1f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:03.951379 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:03.956768 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355b0f6-dde5-4b74-95f2-a78ca9b7b94a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:03.958845 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355b0f6-dde5-4b74-95f2-a78ca9b7b94a None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:04.049188 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f97b2-aad2-42d4-a98f-320d5854ac1f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:04.094841 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ee1ef-3054-493d-ab92-e4cf60b2bbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:04.095492 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ee1ef-3054-493d-ab92-e4cf60b2bbe4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:04.095774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ee1ef-3054-493d-ab92-e4cf60b2bbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:04.096047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ee1ef-3054-493d-ab92-e4cf60b2bbe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:04.096771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ee1ef-3054-493d-ab92-e4cf60b2bbe4 None admin] RBAC: Adding query filter params (role.id=78d0cc90d2f2496b9c3e75bb0ddf0c6d, user.id=2a3f17e923814e93b5e8b404112c17a5, scope.system=all) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:04.097078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ee1ef-3054-493d-ab92-e4cf60b2bbe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:04.098521 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ee1ef-3054-493d-ab92-e4cf60b2bbe4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:04.113513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 188/364] 10.222.0.46 () {56 vars in 1308 bytes} [Wed Aug 10 13:02:03 2022] GET /identity/v3/role_assignments?user.id=2a3f17e923814e93b5e8b404112c17a5&scope.system=all&role.id=78d0cc90d2f2496b9c3e75bb0ddf0c6d => generated 510 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:04.114443 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ee1ef-3054-493d-ab92-e4cf60b2bbe4 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:04.118341 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 177/365] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:04.122425 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4db704-9deb-455e-b53a-6325c831698e None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:04.122708 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4db704-9deb-455e-b53a-6325c831698e None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:04.123895 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4db704-9deb-455e-b53a-6325c831698e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:04.159323 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-fa4db704-9deb-455e-b53a-6325c831698e None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:04.160536 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-fa4db704-9deb-455e-b53a-6325c831698e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:04.195556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:04.285071 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:04.297367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ee1ef-3054-493d-ab92-e4cf60b2bbe4 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:04.330539 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 178/366] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:04.331754 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4db704-9deb-455e-b53a-6325c831698e None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:04.359067 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42defc49-3213-45c8-8adf-2dfc7b992c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:04.359067 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42defc49-3213-45c8-8adf-2dfc7b992c47 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:04.359067 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42defc49-3213-45c8-8adf-2dfc7b992c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:04.359067 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42defc49-3213-45c8-8adf-2dfc7b992c47 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:04.359842 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42defc49-3213-45c8-8adf-2dfc7b992c47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:04.360283 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42defc49-3213-45c8-8adf-2dfc7b992c47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:04.361683 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42defc49-3213-45c8-8adf-2dfc7b992c47 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:04.371893 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 189/367] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:04.372665 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42defc49-3213-45c8-8adf-2dfc7b992c47 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:04.496620 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4db704-9deb-455e-b53a-6325c831698e None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:04.502164 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42defc49-3213-45c8-8adf-2dfc7b992c47 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:04.539214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48597450-c304-4ec0-82cd-ddd4372ca984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:04.539854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48597450-c304-4ec0-82cd-ddd4372ca984 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:04.540190 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48597450-c304-4ec0-82cd-ddd4372ca984 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:04.540494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48597450-c304-4ec0-82cd-ddd4372ca984 None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:04.541609 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48597450-c304-4ec0-82cd-ddd4372ca984 None admin] RBAC: Authorizing `identity:get_project(project_id=68df1934bba847eeaf81f0f154f6edd1)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:04.543585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48597450-c304-4ec0-82cd-ddd4372ca984 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:04.545263 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b09d79-e04a-4902-99a2-02642511cddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:04.545874 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 179/368] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:02:04 2022] GET /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:04.545980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b09d79-e04a-4902-99a2-02642511cddf None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:04.546245 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b09d79-e04a-4902-99a2-02642511cddf None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:04.546588 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b09d79-e04a-4902-99a2-02642511cddf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:04.546689 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48597450-c304-4ec0-82cd-ddd4372ca984 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:04.562961 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b09d79-e04a-4902-99a2-02642511cddf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:04.569982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:04.571706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-06b09d79-e04a-4902-99a2-02642511cddf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:02:04.571706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:04.571706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:04.571706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:04.571706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:04.571706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:04.571706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:04.571706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:04.571706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:04.571706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:04.571706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:04.571706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:04.571706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:04.571706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:04.571706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:04.571706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:04.572982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:04.572982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:04.572982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:04.572982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:04.572982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:04.572982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:04.572982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:04.572982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:04.572982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:04.572982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:04.572982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:04.572982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:04.572982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:04.572982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:04.572982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:04.572982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:04.573778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:04.573778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:04.573778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:04.573778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:04.573778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:04.573778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:04.573778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:04.573778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:04.573778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:04.573778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:04.573778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:02:04.573778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:04.573778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 190/369] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:02:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:04.574442 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b09d79-e04a-4902-99a2-02642511cddf None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:04.584967 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:04.689829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48597450-c304-4ec0-82cd-ddd4372ca984 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:04.716122 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b09d79-e04a-4902-99a2-02642511cddf None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:04.739201 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc1f9d-896f-4c67-a047-da5ea6d30eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:04.741017 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc1f9d-896f-4c67-a047-da5ea6d30eea None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:04.741017 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc1f9d-896f-4c67-a047-da5ea6d30eea None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:04.741017 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc1f9d-896f-4c67-a047-da5ea6d30eea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:04.756995 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b74b3-6824-4da3-909a-3c68571b0443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:04.757960 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b74b3-6824-4da3-909a-3c68571b0443 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:04.758476 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b74b3-6824-4da3-909a-3c68571b0443 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:04.758939 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b74b3-6824-4da3-909a-3c68571b0443 None admin] PATH_INFO: `/v3/groups/a295b2ec238e436f8f0ffaaf63111c43` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:04.760482 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b74b3-6824-4da3-909a-3c68571b0443 None admin] RBAC: Authorizing `identity:get_group(group_id=a295b2ec238e436f8f0ffaaf63111c43)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:04.762101 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b74b3-6824-4da3-909a-3c68571b0443 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:04.764383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 191/370] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 10 13:02:04 2022] GET /identity/v3/groups/a295b2ec238e436f8f0ffaaf63111c43 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:04.765409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b74b3-6824-4da3-909a-3c68571b0443 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:04.827069 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc1f9d-896f-4c67-a047-da5ea6d30eea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:04.828928 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc1f9d-896f-4c67-a047-da5ea6d30eea None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:04.848463 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:04.859693 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:04.902858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b74b3-6824-4da3-909a-3c68571b0443 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:04.949557 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b2c31-86f1-4cac-b42f-b8bb65b538b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:04.949807 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 180/371] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:04.950544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b2c31-86f1-4cac-b42f-b8bb65b538b2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:04.950843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc1f9d-896f-4c67-a047-da5ea6d30eea None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:04.951174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b2c31-86f1-4cac-b42f-b8bb65b538b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:04.951575 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b2c31-86f1-4cac-b42f-b8bb65b538b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:04.952369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b2c31-86f1-4cac-b42f-b8bb65b538b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:04.952799 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b2c31-86f1-4cac-b42f-b8bb65b538b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:04.954402 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b2c31-86f1-4cac-b42f-b8bb65b538b2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:04.970308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 192/372] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:02:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:04.970308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b2c31-86f1-4cac-b42f-b8bb65b538b2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:05.094511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b2c31-86f1-4cac-b42f-b8bb65b538b2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:05.102843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc1f9d-896f-4c67-a047-da5ea6d30eea None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:05.130055 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:05.140072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf96b64-1f43-4e28-9f4c-18c12e6e1f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:05.141046 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf96b64-1f43-4e28-9f4c-18c12e6e1f41 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:05.141530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf96b64-1f43-4e28-9f4c-18c12e6e1f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:05.142003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf96b64-1f43-4e28-9f4c-18c12e6e1f41 None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:05.143595 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf96b64-1f43-4e28-9f4c-18c12e6e1f41 None admin] RBAC: Authorizing `identity:get_project(project_id=68df1934bba847eeaf81f0f154f6edd1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:05.145268 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf96b64-1f43-4e28-9f4c-18c12e6e1f41 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:05.147844 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 193/373] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:02:04 2022] GET /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:05.149043 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf96b64-1f43-4e28-9f4c-18c12e6e1f41 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:05.154866 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:05.160241 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2caa04-2721-4fae-b50c-371f5083ccd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:05.161032 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2caa04-2721-4fae-b50c-371f5083ccd5 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:05.161313 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2caa04-2721-4fae-b50c-371f5083ccd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:05.161583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2caa04-2721-4fae-b50c-371f5083ccd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:05.162883 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2caa04-2721-4fae-b50c-371f5083ccd5 None admin] RBAC: Adding query filter params (group.id=a295b2ec238e436f8f0ffaaf63111c43, role.id=2223c0caa0c948abbe85384d16a465a2, scope.project.id=68df1934bba847eeaf81f0f154f6edd1) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:05.163510 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2caa04-2721-4fae-b50c-371f5083ccd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:05.165092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2caa04-2721-4fae-b50c-371f5083ccd5 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:05.174222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 181/374] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Aug 10 13:02:04 2022] GET /identity/v3/role_assignments?group.id=a295b2ec238e436f8f0ffaaf63111c43&scope.project.id=68df1934bba847eeaf81f0f154f6edd1&role.id=2223c0caa0c948abbe85384d16a465a2 => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:05.175391 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2caa04-2721-4fae-b50c-371f5083ccd5 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:05.294675 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf96b64-1f43-4e28-9f4c-18c12e6e1f41 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:05.315139 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2caa04-2721-4fae-b50c-371f5083ccd5 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:05.337265 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135da9dd-f436-4d2d-af51-7c953fb3a7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:05.338253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135da9dd-f436-4d2d-af51-7c953fb3a7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:05.338735 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135da9dd-f436-4d2d-af51-7c953fb3a7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:05.339242 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135da9dd-f436-4d2d-af51-7c953fb3a7c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:05.366012 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2455e-7c96-4537-adfd-af53b88abaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:05.367033 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2455e-7c96-4537-adfd-af53b88abaa1 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:05.367527 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2455e-7c96-4537-adfd-af53b88abaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:05.368007 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2455e-7c96-4537-adfd-af53b88abaa1 None admin] PATH_INFO: `/v3/groups/a295b2ec238e436f8f0ffaaf63111c43` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:05.369471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2455e-7c96-4537-adfd-af53b88abaa1 None admin] RBAC: Authorizing `identity:get_group(group_id=a295b2ec238e436f8f0ffaaf63111c43)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:05.371258 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2455e-7c96-4537-adfd-af53b88abaa1 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:05.373197 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 182/375] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 10 13:02:05 2022] GET /identity/v3/groups/a295b2ec238e436f8f0ffaaf63111c43 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:05.375224 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c439b8-ffc8-4dce-bf32-a62bb137aaec None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:05.375728 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c439b8-ffc8-4dce-bf32-a62bb137aaec None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:05.376224 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c439b8-ffc8-4dce-bf32-a62bb137aaec None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:05.377995 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 183/376] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:05.384129 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a3d94-79d0-42b5-be70-45ad1b732800 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:05.384705 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a3d94-79d0-42b5-be70-45ad1b732800 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:05.385179 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a3d94-79d0-42b5-be70-45ad1b732800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:05.405968 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-3b2a3d94-79d0-42b5-be70-45ad1b732800 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:05.408375 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3b2a3d94-79d0-42b5-be70-45ad1b732800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:05.436100 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135da9dd-f436-4d2d-af51-7c953fb3a7c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:05.437593 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135da9dd-f436-4d2d-af51-7c953fb3a7c3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:05.439774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:05.466209 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:05.492686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 184/377] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:05.493754 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a3d94-79d0-42b5-be70-45ad1b732800 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:05.559910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 194/378] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:05.561024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135da9dd-f436-4d2d-af51-7c953fb3a7c3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:05.609713 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a3d94-79d0-42b5-be70-45ad1b732800 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:05.647559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ef266-f587-4811-9ba1-8d4a4cf3bc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:05.648248 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ef266-f587-4811-9ba1-8d4a4cf3bc30 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:05.648629 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ef266-f587-4811-9ba1-8d4a4cf3bc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:05.649023 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ef266-f587-4811-9ba1-8d4a4cf3bc30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:05.649862 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ef266-f587-4811-9ba1-8d4a4cf3bc30 None admin] RBAC: Adding query filter params (group.id=a295b2ec238e436f8f0ffaaf63111c43, role.id=0a020d67ea4d4d62b1305fd0cd952779, scope.project.id=68df1934bba847eeaf81f0f154f6edd1) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:05.650276 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ef266-f587-4811-9ba1-8d4a4cf3bc30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:05.652081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ef266-f587-4811-9ba1-8d4a4cf3bc30 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:05.658851 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 185/379] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Aug 10 13:02:05 2022] GET /identity/v3/role_assignments?group.id=a295b2ec238e436f8f0ffaaf63111c43&scope.project.id=68df1934bba847eeaf81f0f154f6edd1&role.id=0a020d67ea4d4d62b1305fd0cd952779 => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:05.659969 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ef266-f587-4811-9ba1-8d4a4cf3bc30 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:05.672561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135da9dd-f436-4d2d-af51-7c953fb3a7c3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:05.674402 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:05.715056 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5d726-ce9d-4ae5-8942-39e2aaebe8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:05.715964 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5d726-ce9d-4ae5-8942-39e2aaebe8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:05.716365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5d726-ce9d-4ae5-8942-39e2aaebe8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:05.716775 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5d726-ce9d-4ae5-8942-39e2aaebe8c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:05.729083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5d726-ce9d-4ae5-8942-39e2aaebe8c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:05.734409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-a0b5d726-ce9d-4ae5-8942-39e2aaebe8c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:02:05.734409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:05.734409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:05.734409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:05.734409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:05.734409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:05.734409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:05.734409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:05.734409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:05.734409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:05.734409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:05.734409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:05.734409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:05.734409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:05.734409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:05.734409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:05.735313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:05.735313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:05.735313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:05.735313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:05.735313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:05.735313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:05.735313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:05.735313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:05.735313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:05.735313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:05.735313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:05.735313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:05.735313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:05.735313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:05.735313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:05.735313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:05.736117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:05.736117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:05.736117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:05.736117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:05.736117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:05.736117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:05.736117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:05.736117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:05.736117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:05.736117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:05.736117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:02:05.736117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:05.738716 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 195/380] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:02:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:05.752469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5d726-ce9d-4ae5-8942-39e2aaebe8c5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:05.759856 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:05.839285 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ef266-f587-4811-9ba1-8d4a4cf3bc30 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:05.904615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380bb89-8b61-444d-b09a-903e5a4f668f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:05.905176 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380bb89-8b61-444d-b09a-903e5a4f668f None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:05.905451 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380bb89-8b61-444d-b09a-903e5a4f668f None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:05.905721 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380bb89-8b61-444d-b09a-903e5a4f668f None admin] PATH_INFO: `/v3/projects/3a5ada6b0d15453089d18d03b8cafc46` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:05.909172 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380bb89-8b61-444d-b09a-903e5a4f668f None admin] RBAC: Authorizing `identity:get_project(project_id=3a5ada6b0d15453089d18d03b8cafc46)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:05.910607 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380bb89-8b61-444d-b09a-903e5a4f668f None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:05.915166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 186/381] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:02:05 2022] GET /identity/v3/projects/3a5ada6b0d15453089d18d03b8cafc46 => generated 344 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:05.919243 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380bb89-8b61-444d-b09a-903e5a4f668f None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:05.957072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5d726-ce9d-4ae5-8942-39e2aaebe8c5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:06.013167 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cb21f-8dd3-4fcd-b2b9-7cbfadd6bb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:06.013778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cb21f-8dd3-4fcd-b2b9-7cbfadd6bb99 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:06.014052 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cb21f-8dd3-4fcd-b2b9-7cbfadd6bb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:06.014918 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cb21f-8dd3-4fcd-b2b9-7cbfadd6bb99 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:06.015633 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cb21f-8dd3-4fcd-b2b9-7cbfadd6bb99 None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:06.015934 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cb21f-8dd3-4fcd-b2b9-7cbfadd6bb99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:06.017830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cb21f-8dd3-4fcd-b2b9-7cbfadd6bb99 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:06.029368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 196/382] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:02:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:02:06.035764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cb21f-8dd3-4fcd-b2b9-7cbfadd6bb99 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:06.048768 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380bb89-8b61-444d-b09a-903e5a4f668f None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:06.060824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:06.072238 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:06.099475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cd1a1-2646-497d-969c-70e7f2c08e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:06.100149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cd1a1-2646-497d-969c-70e7f2c08e9f None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:06.100534 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cd1a1-2646-497d-969c-70e7f2c08e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:06.100807 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cd1a1-2646-497d-969c-70e7f2c08e9f None admin] PATH_INFO: `/v3/groups/765a0aef22094393809c356dd4d83361` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:06.106227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cd1a1-2646-497d-969c-70e7f2c08e9f None admin] RBAC: Authorizing `identity:get_group(group_id=765a0aef22094393809c356dd4d83361)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:06.107834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cd1a1-2646-497d-969c-70e7f2c08e9f None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:06.109838 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 187/383] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 10 13:02:05 2022] GET /identity/v3/groups/765a0aef22094393809c356dd4d83361 => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:06.117452 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cd1a1-2646-497d-969c-70e7f2c08e9f None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:06.165813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cb21f-8dd3-4fcd-b2b9-7cbfadd6bb99 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:06.207693 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61783f1-f7fe-4675-b36a-85e5d47a1553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:06.208315 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61783f1-f7fe-4675-b36a-85e5d47a1553 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:06.208594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61783f1-f7fe-4675-b36a-85e5d47a1553 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:06.208863 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61783f1-f7fe-4675-b36a-85e5d47a1553 None admin] PATH_INFO: `/v3/groups/a295b2ec238e436f8f0ffaaf63111c43` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:06.213429 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61783f1-f7fe-4675-b36a-85e5d47a1553 None admin] RBAC: Authorizing `identity:get_group(group_id=a295b2ec238e436f8f0ffaaf63111c43)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:06.214888 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61783f1-f7fe-4675-b36a-85e5d47a1553 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:06.216677 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 197/384] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 10 13:02:06 2022] GET /identity/v3/groups/a295b2ec238e436f8f0ffaaf63111c43 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:06.222170 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61783f1-f7fe-4675-b36a-85e5d47a1553 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:06.278873 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cd1a1-2646-497d-969c-70e7f2c08e9f None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:06.326893 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f6bc8-0282-4ee5-9cbe-bf66a4a37148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:06.328024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f6bc8-0282-4ee5-9cbe-bf66a4a37148 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:06.328314 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f6bc8-0282-4ee5-9cbe-bf66a4a37148 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:06.328628 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f6bc8-0282-4ee5-9cbe-bf66a4a37148 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:06.329739 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f6bc8-0282-4ee5-9cbe-bf66a4a37148 None admin] RBAC: Adding query filter params (group.id=765a0aef22094393809c356dd4d83361, role.id=d9c9200468cb4f7ab6a23882bfb1f062, scope.project.id=3a5ada6b0d15453089d18d03b8cafc46) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:06.330220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f6bc8-0282-4ee5-9cbe-bf66a4a37148 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:06.332073 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f6bc8-0282-4ee5-9cbe-bf66a4a37148 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:06.339465 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 188/385] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Aug 10 13:02:06 2022] GET /identity/v3/role_assignments?group.id=765a0aef22094393809c356dd4d83361&scope.project.id=3a5ada6b0d15453089d18d03b8cafc46&role.id=d9c9200468cb4f7ab6a23882bfb1f062 => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:06.341388 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1106e-c132-4c23-87bd-113a0ad3b1d0 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:06.341677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1106e-c132-4c23-87bd-113a0ad3b1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:06.341954 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1106e-c132-4c23-87bd-113a0ad3b1d0 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:06.343467 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 189/386] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:06.350171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b577d53-9abe-4109-b404-4d0cb79fdb0a None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:06.350458 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b577d53-9abe-4109-b404-4d0cb79fdb0a None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:06.350949 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:06.351992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b577d53-9abe-4109-b404-4d0cb79fdb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:06.361531 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61783f1-f7fe-4675-b36a-85e5d47a1553 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:06.373265 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-5b577d53-9abe-4109-b404-4d0cb79fdb0a None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:06.374814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-5b577d53-9abe-4109-b404-4d0cb79fdb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:06.402460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cc002-ca15-4968-9488-27e712e056e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:06.402460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cc002-ca15-4968-9488-27e712e056e5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:06.402460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cc002-ca15-4968-9488-27e712e056e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:06.402460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cc002-ca15-4968-9488-27e712e056e5 None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:06.405146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cc002-ca15-4968-9488-27e712e056e5 None admin] RBAC: Authorizing `identity:get_project(project_id=66166393e3e0490ea30d39e178525784)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:06.406484 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cc002-ca15-4968-9488-27e712e056e5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:06.408563 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 198/387] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:02:06 2022] GET /identity/v3/projects/66166393e3e0490ea30d39e178525784 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:06.414499 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cc002-ca15-4968-9488-27e712e056e5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:06.425935 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:06.486491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 190/388] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:06.525304 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b577d53-9abe-4109-b404-4d0cb79fdb0a None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:06.569205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cc002-ca15-4968-9488-27e712e056e5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:06.647692 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a663a-076d-4c33-97b8-d93e3f127ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:06.648369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a663a-076d-4c33-97b8-d93e3f127ebd None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:06.648647 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a663a-076d-4c33-97b8-d93e3f127ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:06.648919 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a663a-076d-4c33-97b8-d93e3f127ebd None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784/groups/a295b2ec238e436f8f0ffaaf63111c43/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:06.651475 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a663a-076d-4c33-97b8-d93e3f127ebd None admin] RBAC: Authorizing `identity:create_grant(project_id=66166393e3e0490ea30d39e178525784, group_id=a295b2ec238e436f8f0ffaaf63111c43, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:06.654331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a663a-076d-4c33-97b8-d93e3f127ebd None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:06.677621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 199/389] 10.222.0.46 () {58 vars in 1442 bytes} [Wed Aug 10 13:02:06 2022] PUT /identity/v3/projects/66166393e3e0490ea30d39e178525784/groups/a295b2ec238e436f8f0ffaaf63111c43/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:02:06.687227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b577d53-9abe-4109-b404-4d0cb79fdb0a None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:06.731539 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3974eef-6001-4e9b-9ca2-3fc337fa494a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:06.732241 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3974eef-6001-4e9b-9ca2-3fc337fa494a None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:06.732519 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3974eef-6001-4e9b-9ca2-3fc337fa494a None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:06.732792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3974eef-6001-4e9b-9ca2-3fc337fa494a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:06.745930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3974eef-6001-4e9b-9ca2-3fc337fa494a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:06.751081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-b3974eef-6001-4e9b-9ca2-3fc337fa494a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:02:06.751081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:06.751081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:06.751081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:06.751081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:06.751081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:06.751081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:06.751081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:06.751081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:06.751081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:06.751081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:06.751081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:06.751081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:06.751081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:06.751081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:06.751081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:06.752271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:06.752271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:06.752271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:06.752271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:06.752271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:06.752271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:06.752271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:06.752271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:06.752271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:06.752271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:06.752271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:06.752271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:06.752271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:06.752271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:06.752271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:06.752271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:06.753390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:06.753390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:06.753390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:06.753390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:06.753390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:06.753390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:06.753390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:06.753390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:06.753390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:06.753390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:06.753390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:02:06.753390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:06.753390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 191/390] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 10 13:02:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:02:06.759946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a663a-076d-4c33-97b8-d93e3f127ebd None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:06.795460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:06.917348 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a663a-076d-4c33-97b8-d93e3f127ebd None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:06.961609 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f35b5-b042-40e6-9bb5-312ca78e38ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:06.962144 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f35b5-b042-40e6-9bb5-312ca78e38ca None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:06.962424 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f35b5-b042-40e6-9bb5-312ca78e38ca None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:06.962698 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f35b5-b042-40e6-9bb5-312ca78e38ca None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:06.963397 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f35b5-b042-40e6-9bb5-312ca78e38ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:06.963704 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f35b5-b042-40e6-9bb5-312ca78e38ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:06.965076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f35b5-b042-40e6-9bb5-312ca78e38ca None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:06.978009 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 200/391] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:06.984374 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3974eef-6001-4e9b-9ca2-3fc337fa494a None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:07.047387 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:07.117179 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3974eef-6001-4e9b-9ca2-3fc337fa494a None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:07.157163 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db182807-ec0d-41f9-b797-ac712dd1d4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:07.158160 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db182807-ec0d-41f9-b797-ac712dd1d4ee None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:07.158641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db182807-ec0d-41f9-b797-ac712dd1d4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:07.159140 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db182807-ec0d-41f9-b797-ac712dd1d4ee None admin] PATH_INFO: `/v3/groups/a295b2ec238e436f8f0ffaaf63111c43` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:07.160459 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db182807-ec0d-41f9-b797-ac712dd1d4ee None admin] RBAC: Authorizing `identity:get_group(group_id=a295b2ec238e436f8f0ffaaf63111c43)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:07.162241 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db182807-ec0d-41f9-b797-ac712dd1d4ee None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:07.164464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 192/392] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 10 13:02:06 2022] GET /identity/v3/groups/a295b2ec238e436f8f0ffaaf63111c43 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:07.169640 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f35b5-b042-40e6-9bb5-312ca78e38ca None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:07.302279 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:07.323329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f35b5-b042-40e6-9bb5-312ca78e38ca None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:07.373958 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b8cfe-f0e6-44cf-89af-314af52b1c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:07.374967 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b8cfe-f0e6-44cf-89af-314af52b1c0d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:07.375472 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b8cfe-f0e6-44cf-89af-314af52b1c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:07.375947 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b8cfe-f0e6-44cf-89af-314af52b1c0d None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:07.379679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b8cfe-f0e6-44cf-89af-314af52b1c0d None admin] RBAC: Authorizing `identity:get_project(project_id=66166393e3e0490ea30d39e178525784)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:07.381406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b8cfe-f0e6-44cf-89af-314af52b1c0d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:07.383701 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 201/393] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:02:07 2022] GET /identity/v3/projects/66166393e3e0490ea30d39e178525784 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:07.389074 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db182807-ec0d-41f9-b797-ac712dd1d4ee None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:07.520060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:07.529077 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db182807-ec0d-41f9-b797-ac712dd1d4ee None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:07.570203 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb675895-263a-450a-82ae-6d6ceb4b359c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:07.570798 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb675895-263a-450a-82ae-6d6ceb4b359c None admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:07.571096 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb675895-263a-450a-82ae-6d6ceb4b359c None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:07.571366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb675895-263a-450a-82ae-6d6ceb4b359c None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784/groups/a295b2ec238e436f8f0ffaaf63111c43/roles/0a020d67ea4d4d62b1305fd0cd952779` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:07.573601 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb675895-263a-450a-82ae-6d6ceb4b359c None admin] RBAC: Authorizing `identity:create_grant(project_id=66166393e3e0490ea30d39e178525784, group_id=a295b2ec238e436f8f0ffaaf63111c43, role_id=0a020d67ea4d4d62b1305fd0cd952779)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:07.575049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb675895-263a-450a-82ae-6d6ceb4b359c None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:07.592376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 193/394] 10.222.0.46 () {58 vars in 1442 bytes} [Wed Aug 10 13:02:07 2022] PUT /identity/v3/projects/66166393e3e0490ea30d39e178525784/groups/a295b2ec238e436f8f0ffaaf63111c43/roles/0a020d67ea4d4d62b1305fd0cd952779 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:02:07.934073 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8320e3-83ca-4349-b3a4-b8ebf536cc89 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:07.934250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8320e3-83ca-4349-b3a4-b8ebf536cc89 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:07.934518 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8320e3-83ca-4349-b3a4-b8ebf536cc89 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:07.936142 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 202/395] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:07.941583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51210d6b-3e44-4075-b2bd-18c6d41b99ee None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:07.941871 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51210d6b-3e44-4075-b2bd-18c6d41b99ee None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:07.942142 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51210d6b-3e44-4075-b2bd-18c6d41b99ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:07.968065 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-51210d6b-3e44-4075-b2bd-18c6d41b99ee None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:07.969540 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-51210d6b-3e44-4075-b2bd-18c6d41b99ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:08.053648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 194/396] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:02:08.101689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8320e3-83ca-4349-b3a4-b8ebf536cc89 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:08.246774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8320e3-83ca-4349-b3a4-b8ebf536cc89 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:08.285811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02210af6-8cdd-4b55-955b-5ab0fcf1d0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:08.286445 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02210af6-8cdd-4b55-955b-5ab0fcf1d0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:08.286727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02210af6-8cdd-4b55-955b-5ab0fcf1d0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:08.287074 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02210af6-8cdd-4b55-955b-5ab0fcf1d0b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:08.305876 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02210af6-8cdd-4b55-955b-5ab0fcf1d0b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:08.311272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-02210af6-8cdd-4b55-955b-5ab0fcf1d0b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:02:08.311272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:08.311272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:08.311272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:08.311272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:08.311272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:08.311272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:08.311272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:08.311272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:08.311272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:08.311272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:08.311272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:08.311272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:08.311272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:08.311272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:08.311272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:08.312237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:08.312237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:08.312237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:08.312237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:08.312237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:08.312237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:08.312237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:08.312237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:08.312237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:08.312237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:08.312237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:08.312237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:08.312237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:08.312237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:08.312237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:08.312237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:08.313029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:08.313029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:08.313029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:08.313029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:08.313029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:08.313029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:08.313029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:08.313029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:08.313029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:08.313029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:08.313029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:02:08.313029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:08.313646 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 203/397] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:02:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:02:08.318404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51210d6b-3e44-4075-b2bd-18c6d41b99ee None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:08.452935 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:08.471474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51210d6b-3e44-4075-b2bd-18c6d41b99ee None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:08.512994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65a016-0ec5-45d3-958f-78b53edd915a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:08.513699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65a016-0ec5-45d3-958f-78b53edd915a None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:08.513976 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65a016-0ec5-45d3-958f-78b53edd915a None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:08.514244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65a016-0ec5-45d3-958f-78b53edd915a None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:08.514904 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65a016-0ec5-45d3-958f-78b53edd915a None admin] RBAC: Adding query filter params (name=member) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:08.515265 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65a016-0ec5-45d3-958f-78b53edd915a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:08.516729 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65a016-0ec5-45d3-958f-78b53edd915a None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:08.528378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 195/398] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:02:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:08.533641 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02210af6-8cdd-4b55-955b-5ab0fcf1d0b7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:08.548069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:08.655867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02210af6-8cdd-4b55-955b-5ab0fcf1d0b7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:08.692114 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96797876-ca1b-4299-a867-a3c89b84229b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:08.692745 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96797876-ca1b-4299-a867-a3c89b84229b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:08.693023 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96797876-ca1b-4299-a867-a3c89b84229b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:08.693810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96797876-ca1b-4299-a867-a3c89b84229b None admin] PATH_INFO: `/v3/groups/a295b2ec238e436f8f0ffaaf63111c43` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:08.695133 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96797876-ca1b-4299-a867-a3c89b84229b None admin] RBAC: Authorizing `identity:get_group(group_id=a295b2ec238e436f8f0ffaaf63111c43)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:08.696577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96797876-ca1b-4299-a867-a3c89b84229b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:08.698440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 204/399] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 10 13:02:08 2022] GET /identity/v3/groups/a295b2ec238e436f8f0ffaaf63111c43 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:08.703956 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65a016-0ec5-45d3-958f-78b53edd915a None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:08.829615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65a016-0ec5-45d3-958f-78b53edd915a None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:08.869575 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f031975-825a-4f32-95da-f01a8c9320f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:08.870209 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f031975-825a-4f32-95da-f01a8c9320f0 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:08.870483 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f031975-825a-4f32-95da-f01a8c9320f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:08.870752 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f031975-825a-4f32-95da-f01a8c9320f0 None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:08.871890 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f031975-825a-4f32-95da-f01a8c9320f0 None admin] RBAC: Authorizing `identity:get_project(project_id=68df1934bba847eeaf81f0f154f6edd1)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:08.873425 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f031975-825a-4f32-95da-f01a8c9320f0 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:08.875351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 196/400] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:02:08 2022] GET /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:08.884079 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96797876-ca1b-4299-a867-a3c89b84229b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:08.924884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fded468-2c6f-4532-a387-12235ca2fc8b None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:08.925204 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fded468-2c6f-4532-a387-12235ca2fc8b None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:08.925422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fded468-2c6f-4532-a387-12235ca2fc8b None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:08.926745 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 197/401] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:02:08.932834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e0874-a5cb-48e8-9d4e-52a240d109fe None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:08.933101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e0874-a5cb-48e8-9d4e-52a240d109fe None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:08.933372 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e0874-a5cb-48e8-9d4e-52a240d109fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:08.961079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-d20e0874-a5cb-48e8-9d4e-52a240d109fe None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:08.962278 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d20e0874-a5cb-48e8-9d4e-52a240d109fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:08.986570 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:09.022062 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:09.046836 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96797876-ca1b-4299-a867-a3c89b84229b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:09.066987 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 198/402] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:02:09.069064 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3591b-0649-4dc1-9264-7e7d5b9374ec None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:09.069490 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3591b-0649-4dc1-9264-7e7d5b9374ec None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:09.069902 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3591b-0649-4dc1-9264-7e7d5b9374ec None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:09.071434 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 199/403] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:09.077092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880382e3-3499-4930-9424-7f2b31178698 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:09.077498 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880382e3-3499-4930-9424-7f2b31178698 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:09.077873 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880382e3-3499-4930-9424-7f2b31178698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:09.091296 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca123a31-710d-4bd9-bbcb-3972882fd75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:09.092239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca123a31-710d-4bd9-bbcb-3972882fd75c None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:09.092780 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca123a31-710d-4bd9-bbcb-3972882fd75c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:09.093321 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca123a31-710d-4bd9-bbcb-3972882fd75c None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1/groups/a295b2ec238e436f8f0ffaaf63111c43/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:09.097072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca123a31-710d-4bd9-bbcb-3972882fd75c None admin] RBAC: Authorizing `identity:create_grant(project_id=68df1934bba847eeaf81f0f154f6edd1, group_id=a295b2ec238e436f8f0ffaaf63111c43, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:09.097368 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-880382e3-3499-4930-9424-7f2b31178698 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:09.098644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-880382e3-3499-4930-9424-7f2b31178698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:09.099120 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca123a31-710d-4bd9-bbcb-3972882fd75c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:09.123726 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 205/404] 10.222.0.46 () {58 vars in 1442 bytes} [Wed Aug 10 13:02:08 2022] PUT /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1/groups/a295b2ec238e436f8f0ffaaf63111c43/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:02:09.125841 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca123a31-710d-4bd9-bbcb-3972882fd75c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:09.199070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 200/405] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:02:09.229759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880382e3-3499-4930-9424-7f2b31178698 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:09.281812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca123a31-710d-4bd9-bbcb-3972882fd75c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:09.324175 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830d4e9-e3f6-4d5c-a9ab-b4db946a2640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:09.324830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830d4e9-e3f6-4d5c-a9ab-b4db946a2640 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:09.325113 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830d4e9-e3f6-4d5c-a9ab-b4db946a2640 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:09.325391 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830d4e9-e3f6-4d5c-a9ab-b4db946a2640 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:09.333724 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:09.338639 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830d4e9-e3f6-4d5c-a9ab-b4db946a2640 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:09.343702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-a830d4e9-e3f6-4d5c-a9ab-b4db946a2640 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:02:09.343702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:09.343702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:09.343702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:09.343702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:09.343702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:09.343702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:09.343702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:09.343702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:09.343702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:09.343702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:09.343702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:09.343702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:09.343702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:09.343702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:09.343702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:09.344867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:09.344867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:09.344867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:09.344867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:09.344867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:09.344867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:09.344867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:09.344867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:09.344867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:09.344867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:09.344867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:09.344867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:09.344867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:09.344867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:09.344867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:09.344867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:09.345769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:09.345769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:09.345769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:09.345769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:09.345769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:09.345769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:09.345769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:09.345769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:09.345769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:09.345769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:09.345769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:02:09.345769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:09.345769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 206/406] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 10 13:02:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:09.351602 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830d4e9-e3f6-4d5c-a9ab-b4db946a2640 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:09.403385 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:09.456225 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880382e3-3499-4930-9424-7f2b31178698 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:09.459923 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830d4e9-e3f6-4d5c-a9ab-b4db946a2640 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:09.496128 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be138c-ec83-45df-86da-d5b245741731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:09.496724 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be138c-ec83-45df-86da-d5b245741731 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:09.497004 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be138c-ec83-45df-86da-d5b245741731 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:09.497277 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be138c-ec83-45df-86da-d5b245741731 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:09.497940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be138c-ec83-45df-86da-d5b245741731 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:09.498246 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be138c-ec83-45df-86da-d5b245741731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:09.499665 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be138c-ec83-45df-86da-d5b245741731 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:09.511719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 207/407] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:02:09.514322 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be138c-ec83-45df-86da-d5b245741731 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:09.539865 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e211d-ba4e-4dba-b5b5-d87ca1219ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:09.540514 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e211d-ba4e-4dba-b5b5-d87ca1219ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:09.540790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e211d-ba4e-4dba-b5b5-d87ca1219ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:09.541057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e211d-ba4e-4dba-b5b5-d87ca1219ab5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:09.569753 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e211d-ba4e-4dba-b5b5-d87ca1219ab5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:09.574644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-240e211d-ba4e-4dba-b5b5-d87ca1219ab5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:02:09.574644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:09.574644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:09.574644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:09.574644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:09.574644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:09.574644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:09.574644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:09.574644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:09.574644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:09.574644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:09.574644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:09.574644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:09.574644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:09.574644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:09.574644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:09.575595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:09.575595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:09.575595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:09.575595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:09.575595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:09.575595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:09.575595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:09.575595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:09.575595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:09.575595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:09.575595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:09.575595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:09.575595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:09.575595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:09.575595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:09.575595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:09.576471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:09.576471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:09.576471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:09.576471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:09.576471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:09.576471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:09.576471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:09.576471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:09.576471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:09.576471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:09.576471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:02:09.576471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:09.579336 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 201/408] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:02:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:02:09.580897 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:09.582186 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e211d-ba4e-4dba-b5b5-d87ca1219ab5 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:09.627108 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be138c-ec83-45df-86da-d5b245741731 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:09.663479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf89d10-7c5e-4b6f-9b88-55d8e36130d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:09.664169 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf89d10-7c5e-4b6f-9b88-55d8e36130d1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:09.664451 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf89d10-7c5e-4b6f-9b88-55d8e36130d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:09.664775 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf89d10-7c5e-4b6f-9b88-55d8e36130d1 None admin] PATH_INFO: `/v3/groups/a295b2ec238e436f8f0ffaaf63111c43` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:09.665919 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf89d10-7c5e-4b6f-9b88-55d8e36130d1 None admin] RBAC: Authorizing `identity:get_group(group_id=a295b2ec238e436f8f0ffaaf63111c43)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:09.667451 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf89d10-7c5e-4b6f-9b88-55d8e36130d1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:09.673612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 208/409] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 10 13:02:09 2022] GET /identity/v3/groups/a295b2ec238e436f8f0ffaaf63111c43 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:02:09.674924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf89d10-7c5e-4b6f-9b88-55d8e36130d1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:09.782926 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf89d10-7c5e-4b6f-9b88-55d8e36130d1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:09.794153 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e211d-ba4e-4dba-b5b5-d87ca1219ab5 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:09.811383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:09.819812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b074c17-b57e-4296-8b75-ae450a753702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:09.820450 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b074c17-b57e-4296-8b75-ae450a753702 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:09.820851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b074c17-b57e-4296-8b75-ae450a753702 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:09.821130 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b074c17-b57e-4296-8b75-ae450a753702 None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:09.822914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b074c17-b57e-4296-8b75-ae450a753702 None admin] RBAC: Authorizing `identity:get_project(project_id=68df1934bba847eeaf81f0f154f6edd1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:09.824517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b074c17-b57e-4296-8b75-ae450a753702 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:09.831063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 209/410] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:02:09 2022] GET /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:09.832467 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b074c17-b57e-4296-8b75-ae450a753702 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:09.867731 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5c01f-7543-47a4-affb-2ab7b08da9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:09.868357 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5c01f-7543-47a4-affb-2ab7b08da9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:09.868637 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5c01f-7543-47a4-affb-2ab7b08da9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:09.868911 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5c01f-7543-47a4-affb-2ab7b08da9c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:09.869578 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5c01f-7543-47a4-affb-2ab7b08da9c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:09.869879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5c01f-7543-47a4-affb-2ab7b08da9c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:09.871273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5c01f-7543-47a4-affb-2ab7b08da9c8 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:09.876957 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:09.897863 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 202/411] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:02:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:09.907995 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5c01f-7543-47a4-affb-2ab7b08da9c8 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:09.948777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b074c17-b57e-4296-8b75-ae450a753702 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:09.986291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d549f69-b94c-46ac-a8bb-348288ff613d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:09.987367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d549f69-b94c-46ac-a8bb-348288ff613d None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:09.987924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d549f69-b94c-46ac-a8bb-348288ff613d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:09.988417 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d549f69-b94c-46ac-a8bb-348288ff613d None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1/groups/a295b2ec238e436f8f0ffaaf63111c43/roles/0a020d67ea4d4d62b1305fd0cd952779` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:09.990899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d549f69-b94c-46ac-a8bb-348288ff613d None admin] RBAC: Authorizing `identity:create_grant(project_id=68df1934bba847eeaf81f0f154f6edd1, group_id=a295b2ec238e436f8f0ffaaf63111c43, role_id=0a020d67ea4d4d62b1305fd0cd952779)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:09.992682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d549f69-b94c-46ac-a8bb-348288ff613d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:10.015534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 210/412] 10.222.0.46 () {58 vars in 1442 bytes} [Wed Aug 10 13:02:09 2022] PUT /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1/groups/a295b2ec238e436f8f0ffaaf63111c43/roles/0a020d67ea4d4d62b1305fd0cd952779 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:02:10.018037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b343fa-e070-4fbd-a8ea-044e3070b162 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:10.018321 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b343fa-e070-4fbd-a8ea-044e3070b162 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:10.019073 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b343fa-e070-4fbd-a8ea-044e3070b162 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:10.027369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 211/413] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:10 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:10.028763 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df983323-40ff-4d56-9b38-e31bb089bcce None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:10.029042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df983323-40ff-4d56-9b38-e31bb089bcce None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:10.029313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df983323-40ff-4d56-9b38-e31bb089bcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:10.067018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-df983323-40ff-4d56-9b38-e31bb089bcce None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:10.068852 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-df983323-40ff-4d56-9b38-e31bb089bcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:10.072562 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5c01f-7543-47a4-affb-2ab7b08da9c8 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:10.140016 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d47e68-9e2a-4137-96a4-a84bcea1dd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:10.141182 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d47e68-9e2a-4137-96a4-a84bcea1dd67 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:10.141457 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d47e68-9e2a-4137-96a4-a84bcea1dd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:10.142147 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d47e68-9e2a-4137-96a4-a84bcea1dd67 None admin] PATH_INFO: `/v3/groups/765a0aef22094393809c356dd4d83361` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:10.144954 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d47e68-9e2a-4137-96a4-a84bcea1dd67 None admin] RBAC: Authorizing `identity:get_group(group_id=765a0aef22094393809c356dd4d83361)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:10.147386 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d47e68-9e2a-4137-96a4-a84bcea1dd67 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:10.149123 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 203/414] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 10 13:02:09 2022] GET /identity/v3/groups/765a0aef22094393809c356dd4d83361 => generated 229 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:10.154622 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d47e68-9e2a-4137-96a4-a84bcea1dd67 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:10.187431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:10.212335 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 212/415] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:02:10.242789 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df983323-40ff-4d56-9b38-e31bb089bcce None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:10.261020 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:10.301611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d47e68-9e2a-4137-96a4-a84bcea1dd67 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:10.346756 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c74b06-fe98-4087-a975-40e7a468b44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:10.347789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c74b06-fe98-4087-a975-40e7a468b44c None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:10.348259 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c74b06-fe98-4087-a975-40e7a468b44c None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:10.348721 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c74b06-fe98-4087-a975-40e7a468b44c None admin] PATH_INFO: `/v3/projects/3a5ada6b0d15453089d18d03b8cafc46` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:10.350654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c74b06-fe98-4087-a975-40e7a468b44c None admin] RBAC: Authorizing `identity:get_project(project_id=3a5ada6b0d15453089d18d03b8cafc46)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:10.352362 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c74b06-fe98-4087-a975-40e7a468b44c None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:10.354511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 204/416] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:02:10 2022] GET /identity/v3/projects/3a5ada6b0d15453089d18d03b8cafc46 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:10.355892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee961f4c-b674-4a6b-b902-a15e6779ee26 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:10.356386 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee961f4c-b674-4a6b-b902-a15e6779ee26 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:10.356850 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee961f4c-b674-4a6b-b902-a15e6779ee26 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:10.357679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df983323-40ff-4d56-9b38-e31bb089bcce None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:10.358813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 205/417] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:10.363835 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee961f4c-b674-4a6b-b902-a15e6779ee26 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:10.394832 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1a153-fd31-44aa-8532-08c692c28e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:10.395533 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1a153-fd31-44aa-8532-08c692c28e61 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:10.395958 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1a153-fd31-44aa-8532-08c692c28e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:10.396227 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1a153-fd31-44aa-8532-08c692c28e61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:10.416420 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1a153-fd31-44aa-8532-08c692c28e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:10.421580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-95a1a153-fd31-44aa-8532-08c692c28e61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:02:10.421580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:10.421580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:10.421580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:10.421580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:10.421580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:10.421580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:10.421580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:10.421580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:10.421580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:10.421580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:10.421580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:10.421580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:10.421580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:10.421580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:10.421580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:10.422481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:10.422481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:10.422481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:10.422481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:10.422481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:10.422481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:10.422481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:10.422481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:10.422481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:10.422481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:10.422481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:10.422481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:10.422481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:10.422481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:10.422481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:10.422481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:10.423308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:10.423308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:10.423308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:10.423308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:10.423308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:10.423308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:10.423308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:10.423308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:10.423308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:10.423308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:10.423308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:02:10.423308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:10.427645 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 213/418] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:02:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:02:10.429116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45976e4b-6447-4d81-9494-808cb1b190ba None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:10.429406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45976e4b-6447-4d81-9494-808cb1b190ba None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:10.429680 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45976e4b-6447-4d81-9494-808cb1b190ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:10.449390 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-45976e4b-6447-4d81-9494-808cb1b190ba None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:10.450830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-45976e4b-6447-4d81-9494-808cb1b190ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:10.473311 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee961f4c-b674-4a6b-b902-a15e6779ee26 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:10.501390 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:10.510042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442faca7-bd10-4eae-9d6f-561a25ccd6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:10.510710 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442faca7-bd10-4eae-9d6f-561a25ccd6b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:10.510986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442faca7-bd10-4eae-9d6f-561a25ccd6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:10.511479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442faca7-bd10-4eae-9d6f-561a25ccd6b2 None admin] PATH_INFO: `/v3/projects/3a5ada6b0d15453089d18d03b8cafc46/groups/765a0aef22094393809c356dd4d83361/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:10.513501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442faca7-bd10-4eae-9d6f-561a25ccd6b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a5ada6b0d15453089d18d03b8cafc46, group_id=765a0aef22094393809c356dd4d83361, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:10.514926 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442faca7-bd10-4eae-9d6f-561a25ccd6b2 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:10.517346 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:10.532843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 206/420] 10.222.0.46 () {58 vars in 1442 bytes} [Wed Aug 10 13:02:10 2022] PUT /identity/v3/projects/3a5ada6b0d15453089d18d03b8cafc46/groups/765a0aef22094393809c356dd4d83361/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:02:10.533047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 214/420] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:10.533860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442faca7-bd10-4eae-9d6f-561a25ccd6b2 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:10.562069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45976e4b-6447-4d81-9494-808cb1b190ba None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:10.709893 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442faca7-bd10-4eae-9d6f-561a25ccd6b2 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:10.754127 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45976e4b-6447-4d81-9494-808cb1b190ba None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:10.758771 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43f75d-50d6-4c4e-9f08-88295b378a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:10.759622 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43f75d-50d6-4c4e-9f08-88295b378a44 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:10.760065 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43f75d-50d6-4c4e-9f08-88295b378a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:10.760493 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43f75d-50d6-4c4e-9f08-88295b378a44 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:10.761313 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43f75d-50d6-4c4e-9f08-88295b378a44 None admin] RBAC: Adding query filter params (name=member) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:10.761763 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43f75d-50d6-4c4e-9f08-88295b378a44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:10.763929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43f75d-50d6-4c4e-9f08-88295b378a44 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:10.776429 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 207/421] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:02:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:10.783053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43f75d-50d6-4c4e-9f08-88295b378a44 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:10.793442 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030da07-f6cd-4752-9a93-4cae0c9825e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:10.794108 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030da07-f6cd-4752-9a93-4cae0c9825e3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:10.794389 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030da07-f6cd-4752-9a93-4cae0c9825e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:10.794709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030da07-f6cd-4752-9a93-4cae0c9825e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:10.807134 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030da07-f6cd-4752-9a93-4cae0c9825e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:10.812502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-9030da07-f6cd-4752-9a93-4cae0c9825e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:02:10.812502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:10.812502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:10.812502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:10.812502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:10.812502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:10.812502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:10.812502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:10.812502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:10.812502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:10.812502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:10.812502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:10.812502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:10.812502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:10.812502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:10.812502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:10.813594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:10.813594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:10.813594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:10.813594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:10.813594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:10.813594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:10.813594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:10.813594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:10.813594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:10.813594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:10.813594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:10.813594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:10.813594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:10.813594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:10.813594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:10.813594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:10.814688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:10.814688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:10.814688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:10.814688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:10.814688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:10.814688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:10.814688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:10.814688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:10.814688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:10.814688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:10.814688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:02:10.814688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:10.814688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 215/422] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 10 13:02:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:02:10.824225 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030da07-f6cd-4752-9a93-4cae0c9825e3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:10.868665 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:10.875482 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:10.936475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43f75d-50d6-4c4e-9f08-88295b378a44 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:10.980260 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7363a3-70e5-4d7e-a2b9-7431457c6381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:10.980793 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7363a3-70e5-4d7e-a2b9-7431457c6381 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:10.981064 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7363a3-70e5-4d7e-a2b9-7431457c6381 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:10.986466 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7363a3-70e5-4d7e-a2b9-7431457c6381 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:11.016743 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030da07-f6cd-4752-9a93-4cae0c9825e3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:11.094906 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d0039-25e6-4282-a688-10e203de1c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:11.095912 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d0039-25e6-4282-a688-10e203de1c7a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:11.097561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d0039-25e6-4282-a688-10e203de1c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:11.098040 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d0039-25e6-4282-a688-10e203de1c7a None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:11.099686 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d0039-25e6-4282-a688-10e203de1c7a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:11.100847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d0039-25e6-4282-a688-10e203de1c7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:11.102447 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d0039-25e6-4282-a688-10e203de1c7a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:11.120817 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 216/423] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:11.128052 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d0039-25e6-4282-a688-10e203de1c7a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:11.129119 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7363a3-70e5-4d7e-a2b9-7431457c6381 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:11.131634 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7363a3-70e5-4d7e-a2b9-7431457c6381 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:11.209519 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:11.263366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 208/424] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:11.265432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7363a3-70e5-4d7e-a2b9-7431457c6381 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:11.357728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:11.366418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d0039-25e6-4282-a688-10e203de1c7a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:11.418327 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7363a3-70e5-4d7e-a2b9-7431457c6381 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:11.434077 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0d4ae-9585-45dc-a099-7cea506d9f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:11.435109 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0d4ae-9585-45dc-a099-7cea506d9f31 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:11.435644 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0d4ae-9585-45dc-a099-7cea506d9f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:11.436144 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0d4ae-9585-45dc-a099-7cea506d9f31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:11.482240 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f5400-b733-484f-ae7c-b6769397e8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:11.483635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f5400-b733-484f-ae7c-b6769397e8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:11.484118 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f5400-b733-484f-ae7c-b6769397e8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:11.484587 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f5400-b733-484f-ae7c-b6769397e8a3 None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:11.487128 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f5400-b733-484f-ae7c-b6769397e8a3 None admin] RBAC: Authorizing `identity:get_project(project_id=66166393e3e0490ea30d39e178525784)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:11.489770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f5400-b733-484f-ae7c-b6769397e8a3 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:11.491864 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 209/425] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:02:11 2022] GET /identity/v3/projects/66166393e3e0490ea30d39e178525784 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:11.493044 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ab21b-bc54-4a7a-b430-efcebd5b7efe None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:11.493324 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ab21b-bc54-4a7a-b430-efcebd5b7efe None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:11.493596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ab21b-bc54-4a7a-b430-efcebd5b7efe None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:11.494909 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 210/426] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:11.500271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ab21b-bc54-4a7a-b430-efcebd5b7efe None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:11.535156 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:11.540751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0d4ae-9585-45dc-a099-7cea506d9f31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:11.542218 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0d4ae-9585-45dc-a099-7cea506d9f31 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:11.649663 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ab21b-bc54-4a7a-b430-efcebd5b7efe None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:11.656172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:11.662211 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 217/427] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:11.663817 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44743478-22c6-4263-ace2-b24df135ce46 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:11.664511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44743478-22c6-4263-ace2-b24df135ce46 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:11.664857 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44743478-22c6-4263-ace2-b24df135ce46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:11.684667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-44743478-22c6-4263-ace2-b24df135ce46 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:11.685981 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-44743478-22c6-4263-ace2-b24df135ce46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:11.698380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c57f57-ccd6-48cd-83c5-f82fe8f4cbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:11.700329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c57f57-ccd6-48cd-83c5-f82fe8f4cbe4 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:11.700614 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c57f57-ccd6-48cd-83c5-f82fe8f4cbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:11.701151 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c57f57-ccd6-48cd-83c5-f82fe8f4cbe4 None admin] PATH_INFO: `/v3/groups/a295b2ec238e436f8f0ffaaf63111c43` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:11.703643 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c57f57-ccd6-48cd-83c5-f82fe8f4cbe4 None admin] RBAC: Authorizing `identity:get_group(group_id=a295b2ec238e436f8f0ffaaf63111c43)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:11.705076 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c57f57-ccd6-48cd-83c5-f82fe8f4cbe4 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:11.711889 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 211/428] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 10 13:02:11 2022] GET /identity/v3/groups/a295b2ec238e436f8f0ffaaf63111c43 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:11.711889 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c57f57-ccd6-48cd-83c5-f82fe8f4cbe4 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:11.770522 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 218/429] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:11.779634 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44743478-22c6-4263-ace2-b24df135ce46 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:11.808108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:11.819589 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c57f57-ccd6-48cd-83c5-f82fe8f4cbe4 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:11.857245 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dafba-3628-4a8d-a53a-043272af2a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:11.858260 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dafba-3628-4a8d-a53a-043272af2a4e None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:11.858749 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dafba-3628-4a8d-a53a-043272af2a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:11.859259 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dafba-3628-4a8d-a53a-043272af2a4e None admin] PATH_INFO: `/v3/projects/66166393e3e0490ea30d39e178525784` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:11.860638 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095dafba-3628-4a8d-a53a-043272af2a4e None admin] RBAC: Authorizing `identity:get_project(project_id=66166393e3e0490ea30d39e178525784)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:11.862266 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095dafba-3628-4a8d-a53a-043272af2a4e None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:11.864511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 212/430] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:02:11 2022] GET /identity/v3/projects/66166393e3e0490ea30d39e178525784 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:11.865661 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dafba-3628-4a8d-a53a-043272af2a4e None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:11.903886 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44743478-22c6-4263-ace2-b24df135ce46 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:11.934433 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:11.943907 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baf005-0418-4b19-9e24-f1145849e059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:11.944522 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baf005-0418-4b19-9e24-f1145849e059 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:11.944803 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baf005-0418-4b19-9e24-f1145849e059 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:11.945075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baf005-0418-4b19-9e24-f1145849e059 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:11.945807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3baf005-0418-4b19-9e24-f1145849e059 None admin] RBAC: Adding query filter params (group.id=a295b2ec238e436f8f0ffaaf63111c43, role.id=2223c0caa0c948abbe85384d16a465a2, scope.project.id=66166393e3e0490ea30d39e178525784) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:11.946115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3baf005-0418-4b19-9e24-f1145849e059 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:11.947580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3baf005-0418-4b19-9e24-f1145849e059 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:11.954165 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 219/431] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Aug 10 13:02:11 2022] GET /identity/v3/role_assignments?group.id=a295b2ec238e436f8f0ffaaf63111c43&scope.project.id=66166393e3e0490ea30d39e178525784&role.id=2223c0caa0c948abbe85384d16a465a2 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:11.954984 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baf005-0418-4b19-9e24-f1145849e059 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:11.992819 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dafba-3628-4a8d-a53a-043272af2a4e None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:12.061855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80c842-7c37-4ed4-8a35-6aeb6f65e50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:12.062422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80c842-7c37-4ed4-8a35-6aeb6f65e50c None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:12.062703 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80c842-7c37-4ed4-8a35-6aeb6f65e50c None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:12.062976 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80c842-7c37-4ed4-8a35-6aeb6f65e50c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:12.067816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baf005-0418-4b19-9e24-f1145849e059 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:12.085421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80c842-7c37-4ed4-8a35-6aeb6f65e50c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:12.090242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-9c80c842-7c37-4ed4-8a35-6aeb6f65e50c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:02:12.090242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:12.090242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:12.090242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:12.090242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:12.090242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:12.090242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:12.090242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:12.090242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:12.090242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:12.090242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:12.090242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:12.090242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:12.090242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:12.090242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:12.090242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:12.091154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:12.091154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:12.091154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:12.091154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:12.091154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:12.091154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:12.091154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:12.091154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:12.091154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:12.091154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:12.091154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:12.091154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:12.091154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:12.091154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:12.091154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:12.091154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:12.091970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:12.091970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:12.091970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:12.091970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:12.091970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:12.091970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:12.091970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:12.091970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:12.091970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:12.091970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:12.091970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 13:02:12.091970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:12.100453 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 213/432] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:02:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:12.106827 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80c842-7c37-4ed4-8a35-6aeb6f65e50c None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:12.116774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fdda7-acc1-48dc-801f-1e2fce826e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:12.117433 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fdda7-acc1-48dc-801f-1e2fce826e1a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:12.117718 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fdda7-acc1-48dc-801f-1e2fce826e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:12.117991 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fdda7-acc1-48dc-801f-1e2fce826e1a None admin] PATH_INFO: `/v3/groups/a295b2ec238e436f8f0ffaaf63111c43` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:12.119158 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fdda7-acc1-48dc-801f-1e2fce826e1a None admin] RBAC: Authorizing `identity:get_group(group_id=a295b2ec238e436f8f0ffaaf63111c43)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:12.120673 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fdda7-acc1-48dc-801f-1e2fce826e1a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:12.122563 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 220/433] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 10 13:02:11 2022] GET /identity/v3/groups/a295b2ec238e436f8f0ffaaf63111c43 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:12.128468 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fdda7-acc1-48dc-801f-1e2fce826e1a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:12.131264 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:12.224587 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80c842-7c37-4ed4-8a35-6aeb6f65e50c None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:12.233680 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:12.279781 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26997309-bcdb-44a4-aa68-d70d6e228f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:12.280689 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26997309-bcdb-44a4-aa68-d70d6e228f7c None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:12.281131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26997309-bcdb-44a4-aa68-d70d6e228f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:12.281556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26997309-bcdb-44a4-aa68-d70d6e228f7c None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:12.282381 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26997309-bcdb-44a4-aa68-d70d6e228f7c None admin] RBAC: Adding query filter params (name=member) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:12.282849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26997309-bcdb-44a4-aa68-d70d6e228f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:12.284411 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26997309-bcdb-44a4-aa68-d70d6e228f7c None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:12.296977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fdda7-acc1-48dc-801f-1e2fce826e1a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:12.301637 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 214/434] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:02:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:12.309292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26997309-bcdb-44a4-aa68-d70d6e228f7c None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:12.333728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e418bf4-bf34-432f-8f9e-6777b1cf9757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:12.334855 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e418bf4-bf34-432f-8f9e-6777b1cf9757 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:12.335830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e418bf4-bf34-432f-8f9e-6777b1cf9757 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:12.336141 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e418bf4-bf34-432f-8f9e-6777b1cf9757 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:12.337002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e418bf4-bf34-432f-8f9e-6777b1cf9757 None admin] RBAC: Adding query filter params (group.id=a295b2ec238e436f8f0ffaaf63111c43, role.id=0a020d67ea4d4d62b1305fd0cd952779, scope.project.id=66166393e3e0490ea30d39e178525784) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:12.337324 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e418bf4-bf34-432f-8f9e-6777b1cf9757 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:12.340501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e418bf4-bf34-432f-8f9e-6777b1cf9757 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:12.350188 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 221/435] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Aug 10 13:02:12 2022] GET /identity/v3/role_assignments?group.id=a295b2ec238e436f8f0ffaaf63111c43&scope.project.id=66166393e3e0490ea30d39e178525784&role.id=0a020d67ea4d4d62b1305fd0cd952779 => generated 611 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:02:12.351783 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760d660-e8fe-48f0-a531-e9c2c93f0bf7 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:12.352065 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760d660-e8fe-48f0-a531-e9c2c93f0bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:12.352337 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760d660-e8fe-48f0-a531-e9c2c93f0bf7 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:12.353784 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 222/436] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:12.359385 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f2bf7-768d-4b53-81a5-9a295e8dbf09 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:12.359998 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f2bf7-768d-4b53-81a5-9a295e8dbf09 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:12.359998 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f2bf7-768d-4b53-81a5-9a295e8dbf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:12.390077 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b18f2bf7-768d-4b53-81a5-9a295e8dbf09 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:12.391346 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b18f2bf7-768d-4b53-81a5-9a295e8dbf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:12.439526 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:12.468149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26997309-bcdb-44a4-aa68-d70d6e228f7c None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:12.494286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 223/437] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:02:12.520990 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a9477-936d-43d1-b144-41d2a2115a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:12.522218 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a9477-936d-43d1-b144-41d2a2115a10 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:12.522450 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a9477-936d-43d1-b144-41d2a2115a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:12.522718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a9477-936d-43d1-b144-41d2a2115a10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:12.528275 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f2bf7-768d-4b53-81a5-9a295e8dbf09 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:12.601639 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:12.613080 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a9477-936d-43d1-b144-41d2a2115a10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:12.614537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a9477-936d-43d1-b144-41d2a2115a10 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:12.669401 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f2bf7-768d-4b53-81a5-9a295e8dbf09 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:12.728286 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:12.728677 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec8a6d-beb7-4dd4-a4d6-6c5bbd02ca80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:12.729458 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec8a6d-beb7-4dd4-a4d6-6c5bbd02ca80 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:12.729642 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec8a6d-beb7-4dd4-a4d6-6c5bbd02ca80 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:12.729879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec8a6d-beb7-4dd4-a4d6-6c5bbd02ca80 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:12.748247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec8a6d-beb7-4dd4-a4d6-6c5bbd02ca80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:12.756661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-0aec8a6d-beb7-4dd4-a4d6-6c5bbd02ca80 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:02:12.756661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:12.756661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:12.756661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:12.756661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:12.756661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:12.756661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:12.756661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:12.756661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:12.756661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:12.756661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:12.756661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:12.756661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:12.756661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:12.756661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:12.756661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:12.757617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:12.757617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:12.757617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:12.757617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:12.757617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:12.757617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:12.757617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:12.757617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:12.757617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:12.757617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:12.757617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:12.757617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:12.757617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:12.757617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:12.757617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:12.757617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:12.758436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:12.758436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:12.758436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:12.758436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:12.758436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:12.758436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:12.758436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:12.758436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:12.758436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:12.758436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:12.758436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:02:12.758436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:12.759118 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 215/439] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:12.759189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 224/439] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 10 13:02:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:02:12.763539 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a9477-936d-43d1-b144-41d2a2115a10 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:12.763669 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec8a6d-beb7-4dd4-a4d6-6c5bbd02ca80 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:12.893956 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a9477-936d-43d1-b144-41d2a2115a10 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:12.902841 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec8a6d-beb7-4dd4-a4d6-6c5bbd02ca80 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:12.922345 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:12.938533 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bebc5-d5c6-484d-9fc3-764323468d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:12.939286 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bebc5-d5c6-484d-9fc3-764323468d25 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:12.939492 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bebc5-d5c6-484d-9fc3-764323468d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:12.939764 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bebc5-d5c6-484d-9fc3-764323468d25 None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:12.946240 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bebc5-d5c6-484d-9fc3-764323468d25 None admin] RBAC: Authorizing `identity:get_project(project_id=68df1934bba847eeaf81f0f154f6edd1)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:12.946240 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bebc5-d5c6-484d-9fc3-764323468d25 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:12.946905 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 216/440] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:02:12 2022] GET /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:12.952436 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bebc5-d5c6-484d-9fc3-764323468d25 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:12.956219 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d770f4-948c-4553-9ce9-46c17bd1d86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:12.957692 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d770f4-948c-4553-9ce9-46c17bd1d86b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:12.957970 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d770f4-948c-4553-9ce9-46c17bd1d86b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:12.958237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d770f4-948c-4553-9ce9-46c17bd1d86b None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:12.958987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d770f4-948c-4553-9ce9-46c17bd1d86b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:12.959341 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d770f4-948c-4553-9ce9-46c17bd1d86b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:12.960824 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d770f4-948c-4553-9ce9-46c17bd1d86b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:12.975429 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 225/441] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:02:12.976825 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef331342-a96e-4c0c-b149-eaf38a4e68af None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:12.977116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef331342-a96e-4c0c-b149-eaf38a4e68af None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:12.977391 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef331342-a96e-4c0c-b149-eaf38a4e68af None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:12.983276 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 226/442] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:12.984259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef331342-a96e-4c0c-b149-eaf38a4e68af None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:13.018314 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:13.096832 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bebc5-d5c6-484d-9fc3-764323468d25 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:13.124806 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef331342-a96e-4c0c-b149-eaf38a4e68af None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:13.136750 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa871d1d-1983-472f-9f49-f1ddc5970168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:13.138102 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa871d1d-1983-472f-9f49-f1ddc5970168 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:13.138385 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa871d1d-1983-472f-9f49-f1ddc5970168 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:13.138664 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa871d1d-1983-472f-9f49-f1ddc5970168 None admin] PATH_INFO: `/v3/groups/a295b2ec238e436f8f0ffaaf63111c43` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:13.139890 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa871d1d-1983-472f-9f49-f1ddc5970168 None admin] RBAC: Authorizing `identity:get_group(group_id=a295b2ec238e436f8f0ffaaf63111c43)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:13.141366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa871d1d-1983-472f-9f49-f1ddc5970168 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:13.142960 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 217/443] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 10 13:02:12 2022] GET /identity/v3/groups/a295b2ec238e436f8f0ffaaf63111c43 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:02:13.144171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4f327-175e-4d40-b275-9abdc60b815f None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:13.144482 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4f327-175e-4d40-b275-9abdc60b815f None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:13.144757 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4f327-175e-4d40-b275-9abdc60b815f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:13.163111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-21e4f327-175e-4d40-b275-9abdc60b815f None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:13.164323 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-21e4f327-175e-4d40-b275-9abdc60b815f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:13.169981 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f9d82-ee1b-480d-bf74-e93a39527ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:13.170585 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f9d82-ee1b-480d-bf74-e93a39527ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:13.170861 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f9d82-ee1b-480d-bf74-e93a39527ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:13.171160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f9d82-ee1b-480d-bf74-e93a39527ab0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:13.222830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:13.250981 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 218/444] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:13.250981 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4f327-175e-4d40-b275-9abdc60b815f None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:13.254605 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f9d82-ee1b-480d-bf74-e93a39527ab0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:13.256623 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f9d82-ee1b-480d-bf74-e93a39527ab0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:13.323079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:13.387702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 227/445] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:13.387702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f9d82-ee1b-480d-bf74-e93a39527ab0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:13.388300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4f327-175e-4d40-b275-9abdc60b815f None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:13.431920 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a2cc2-59f5-4078-90ec-cbca8c7f7af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:13.432501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a2cc2-59f5-4078-90ec-cbca8c7f7af9 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:13.432785 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a2cc2-59f5-4078-90ec-cbca8c7f7af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:13.433048 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a2cc2-59f5-4078-90ec-cbca8c7f7af9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:13.433769 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a2cc2-59f5-4078-90ec-cbca8c7f7af9 None admin] RBAC: Adding query filter params (group.id=a295b2ec238e436f8f0ffaaf63111c43, role.id=2223c0caa0c948abbe85384d16a465a2, scope.project.id=68df1934bba847eeaf81f0f154f6edd1) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:13.434068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a2cc2-59f5-4078-90ec-cbca8c7f7af9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:13.435524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a2cc2-59f5-4078-90ec-cbca8c7f7af9 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:13.441639 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 219/446] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Aug 10 13:02:13 2022] GET /identity/v3/role_assignments?group.id=a295b2ec238e436f8f0ffaaf63111c43&scope.project.id=68df1934bba847eeaf81f0f154f6edd1&role.id=2223c0caa0c948abbe85384d16a465a2 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:13.442451 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a2cc2-59f5-4078-90ec-cbca8c7f7af9 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:13.492314 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:13.519455 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f9d82-ee1b-480d-bf74-e93a39527ab0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:13.559995 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fd490-c666-4af9-b168-886fbf73d7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:13.560642 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fd490-c666-4af9-b168-886fbf73d7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:13.560977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fd490-c666-4af9-b168-886fbf73d7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:13.561181 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fd490-c666-4af9-b168-886fbf73d7a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:13.572106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a2cc2-59f5-4078-90ec-cbca8c7f7af9 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:13.573572 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6fd490-c666-4af9-b168-886fbf73d7a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:13.578453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-4d6fd490-c666-4af9-b168-886fbf73d7a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:02:13.578453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:13.578453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:13.578453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:13.578453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:13.578453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:13.578453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:13.578453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:13.578453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:13.578453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:13.578453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:13.578453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:13.578453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:13.578453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:13.578453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:13.578453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:13.579470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:13.579470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:13.579470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:13.579470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:13.579470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:13.579470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:13.579470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:13.579470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:13.579470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:13.579470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:13.579470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:13.579470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:13.579470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:13.579470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:13.579470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:13.579470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:13.581010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:13.581010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:13.581010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:13.581010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:13.581010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:13.581010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:13.581010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:13.581010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:13.581010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:13.581010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:13.581010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:02:13.581010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:13.581010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 228/447] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:02:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:13.586517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fd490-c666-4af9-b168-886fbf73d7a0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:13.590494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:13.621566 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6a574-87bb-462c-9c5f-3575543c278f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:13.623060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6a574-87bb-462c-9c5f-3575543c278f None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:13.623060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6a574-87bb-462c-9c5f-3575543c278f None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:13.623265 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6a574-87bb-462c-9c5f-3575543c278f None admin] PATH_INFO: `/v3/projects/68df1934bba847eeaf81f0f154f6edd1` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:13.631851 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6a574-87bb-462c-9c5f-3575543c278f None admin] RBAC: Authorizing `identity:get_project(project_id=68df1934bba847eeaf81f0f154f6edd1)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:13.632733 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6a574-87bb-462c-9c5f-3575543c278f None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:13.634873 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 220/448] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:02:13 2022] GET /identity/v3/projects/68df1934bba847eeaf81f0f154f6edd1 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:13.640672 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6a574-87bb-462c-9c5f-3575543c278f None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:13.725261 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fd490-c666-4af9-b168-886fbf73d7a0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:13.776405 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f57561-46d5-498d-8ef1-dc2d5c696fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:13.777028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f57561-46d5-498d-8ef1-dc2d5c696fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:13.777302 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f57561-46d5-498d-8ef1-dc2d5c696fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:13.777570 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f57561-46d5-498d-8ef1-dc2d5c696fb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:13.778251 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f57561-46d5-498d-8ef1-dc2d5c696fb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:13.778556 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f57561-46d5-498d-8ef1-dc2d5c696fb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:13.781154 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f57561-46d5-498d-8ef1-dc2d5c696fb9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:13.783735 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:13.795091 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 229/449] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:02:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:02:13.797971 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f57561-46d5-498d-8ef1-dc2d5c696fb9 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:13.804135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6a574-87bb-462c-9c5f-3575543c278f None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:13.853661 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d2530-7432-44df-9dfa-165d0c57ad79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:13.854301 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d2530-7432-44df-9dfa-165d0c57ad79 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:13.854585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d2530-7432-44df-9dfa-165d0c57ad79 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:13.854851 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d2530-7432-44df-9dfa-165d0c57ad79 None admin] PATH_INFO: `/v3/groups/a295b2ec238e436f8f0ffaaf63111c43` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:13.858381 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d2530-7432-44df-9dfa-165d0c57ad79 None admin] RBAC: Authorizing `identity:get_group(group_id=a295b2ec238e436f8f0ffaaf63111c43)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:13.860348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d2530-7432-44df-9dfa-165d0c57ad79 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:13.862624 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 221/450] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 10 13:02:13 2022] GET /identity/v3/groups/a295b2ec238e436f8f0ffaaf63111c43 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:02:13.882377 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d2530-7432-44df-9dfa-165d0c57ad79 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:13.926258 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f57561-46d5-498d-8ef1-dc2d5c696fb9 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:13.944424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:13.969530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e455a8-d7b1-4ee5-be50-e1023bdfe935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:13.970124 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e455a8-d7b1-4ee5-be50-e1023bdfe935 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:13.970392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e455a8-d7b1-4ee5-be50-e1023bdfe935 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:13.970658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e455a8-d7b1-4ee5-be50-e1023bdfe935 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:14.001717 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d2530-7432-44df-9dfa-165d0c57ad79 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:14.038705 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0603c-318d-4ae6-b350-b55f86133d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:14.039570 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0603c-318d-4ae6-b350-b55f86133d00 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:14.039855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0603c-318d-4ae6-b350-b55f86133d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:14.040134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0603c-318d-4ae6-b350-b55f86133d00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:14.040839 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0603c-318d-4ae6-b350-b55f86133d00 None admin] RBAC: Adding query filter params (group.id=a295b2ec238e436f8f0ffaaf63111c43, role.id=0a020d67ea4d4d62b1305fd0cd952779, scope.project.id=68df1934bba847eeaf81f0f154f6edd1) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:14.041146 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0603c-318d-4ae6-b350-b55f86133d00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:14.042579 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0603c-318d-4ae6-b350-b55f86133d00 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:14.044195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:14.048611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 222/451] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Aug 10 13:02:13 2022] GET /identity/v3/role_assignments?group.id=a295b2ec238e436f8f0ffaaf63111c43&scope.project.id=68df1934bba847eeaf81f0f154f6edd1&role.id=0a020d67ea4d4d62b1305fd0cd952779 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:02:14.049770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e455a8-d7b1-4ee5-be50-e1023bdfe935 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:14.051265 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e455a8-d7b1-4ee5-be50-e1023bdfe935 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:14.169576 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 230/452] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:14.178473 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0603c-318d-4ae6-b350-b55f86133d00 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:14.299830 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0603c-318d-4ae6-b350-b55f86133d00 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:14.315865 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:14.341123 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b686d4-877f-4ffc-a738-c6e588d98587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:14.341846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b686d4-877f-4ffc-a738-c6e588d98587 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:14.342131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b686d4-877f-4ffc-a738-c6e588d98587 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:14.342553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b686d4-877f-4ffc-a738-c6e588d98587 None admin] PATH_INFO: `/v3/projects/3a5ada6b0d15453089d18d03b8cafc46` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:14.344586 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b686d4-877f-4ffc-a738-c6e588d98587 None admin] RBAC: Authorizing `identity:get_project(project_id=3a5ada6b0d15453089d18d03b8cafc46)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:14.345996 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b686d4-877f-4ffc-a738-c6e588d98587 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:14.347842 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 223/453] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:02:14 2022] GET /identity/v3/projects/3a5ada6b0d15453089d18d03b8cafc46 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:14.355878 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e455a8-d7b1-4ee5-be50-e1023bdfe935 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:14.482113 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:14.485882 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e455a8-d7b1-4ee5-be50-e1023bdfe935 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:14.519922 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f362609-94f6-4129-b65e-75c9f5344fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:14.520519 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f362609-94f6-4129-b65e-75c9f5344fdf None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:14.520797 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f362609-94f6-4129-b65e-75c9f5344fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:14.521066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f362609-94f6-4129-b65e-75c9f5344fdf None admin] PATH_INFO: `/v3/groups/765a0aef22094393809c356dd4d83361` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:14.522782 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f362609-94f6-4129-b65e-75c9f5344fdf None admin] RBAC: Authorizing `identity:get_group(group_id=765a0aef22094393809c356dd4d83361)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:14.524234 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f362609-94f6-4129-b65e-75c9f5344fdf None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:14.525758 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 231/454] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 10 13:02:14 2022] GET /identity/v3/groups/765a0aef22094393809c356dd4d83361 => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:14.531660 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b686d4-877f-4ffc-a738-c6e588d98587 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:14.627953 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b686d4-877f-4ffc-a738-c6e588d98587 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:14.667870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbe2ff-9d69-474e-8514-84ca7887b745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:14.668467 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbe2ff-9d69-474e-8514-84ca7887b745 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:14.668744 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbe2ff-9d69-474e-8514-84ca7887b745 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:14.669008 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbe2ff-9d69-474e-8514-84ca7887b745 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:14.669716 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbe2ff-9d69-474e-8514-84ca7887b745 None admin] RBAC: Adding query filter params (group.id=765a0aef22094393809c356dd4d83361, role.id=d9c9200468cb4f7ab6a23882bfb1f062, scope.project.id=3a5ada6b0d15453089d18d03b8cafc46) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:14.670013 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbe2ff-9d69-474e-8514-84ca7887b745 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:14.671447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbe2ff-9d69-474e-8514-84ca7887b745 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:14.677820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 224/455] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Aug 10 13:02:14 2022] GET /identity/v3/role_assignments?group.id=765a0aef22094393809c356dd4d83361&scope.project.id=3a5ada6b0d15453089d18d03b8cafc46&role.id=d9c9200468cb4f7ab6a23882bfb1f062 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:17.191431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfca63-59ff-456d-be08-3028f031b6ac None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:17.191942 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfca63-59ff-456d-be08-3028f031b6ac None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:17.192208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfca63-59ff-456d-be08-3028f031b6ac None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:17.195050 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 232/456] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:17.205476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2985a-2ecf-44c5-8950-80e183e5fad4 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:17.205476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2985a-2ecf-44c5-8950-80e183e5fad4 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:17.205476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2985a-2ecf-44c5-8950-80e183e5fad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:17.229027 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-dde2985a-2ecf-44c5-8950-80e183e5fad4 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:17.230629 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-dde2985a-2ecf-44c5-8950-80e183e5fad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:17.292789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:17.331180 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 225/457] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:17.381225 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfca63-59ff-456d-be08-3028f031b6ac None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:17.545182 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfca63-59ff-456d-be08-3028f031b6ac None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:17.591970 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed32abd-7baa-4b80-b273-a1fa5e3b1244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:17.592883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed32abd-7baa-4b80-b273-a1fa5e3b1244 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:17.593309 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed32abd-7baa-4b80-b273-a1fa5e3b1244 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:17.593723 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed32abd-7baa-4b80-b273-a1fa5e3b1244 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:17.610010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed32abd-7baa-4b80-b273-a1fa5e3b1244 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:17.611754 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed32abd-7baa-4b80-b273-a1fa5e3b1244 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:17.637148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-6ed32abd-7baa-4b80-b273-a1fa5e3b1244 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:17.637148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:17.637148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:17.637148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:17.637148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:17.637148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:17.637148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:17.637148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:17.637148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:17.637148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:17.637148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:17.637148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:17.637148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:17.637148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:17.637148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:17.637148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:17.638334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:17.638334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:17.638334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:17.638334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:17.638334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:17.638334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:17.638334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:17.638334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:17.638334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:17.638334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:17.638334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:17.638334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:17.638334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:17.638334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:17.638334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:17.638334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:17.638334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:17.639466 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:17.639466 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:17.639466 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:17.641309 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 233/458] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:17.648056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2985a-2ecf-44c5-8950-80e183e5fad4 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:17.664904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4c91b-bb79-4e1d-aa61-04bdbac94f9a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:17.665268 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4c91b-bb79-4e1d-aa61-04bdbac94f9a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:17.665550 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4c91b-bb79-4e1d-aa61-04bdbac94f9a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:17.669063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 234/459] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:02:17.676569 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf7f37-264c-40e7-a751-b823af5e841c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:17.676856 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf7f37-264c-40e7-a751-b823af5e841c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:17.677271 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf7f37-264c-40e7-a751-b823af5e841c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:17.728097 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c4bf7f37-264c-40e7-a751-b823af5e841c None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:17.729896 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c4bf7f37-264c-40e7-a751-b823af5e841c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:17.758579 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:17.814498 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2985a-2ecf-44c5-8950-80e183e5fad4 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:17.860966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad435a58-0af0-466c-bef8-725140f2fad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:17.862205 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad435a58-0af0-466c-bef8-725140f2fad7 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:17.863030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad435a58-0af0-466c-bef8-725140f2fad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:17.863748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad435a58-0af0-466c-bef8-725140f2fad7 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:17.864625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad435a58-0af0-466c-bef8-725140f2fad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:17.865155 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad435a58-0af0-466c-bef8-725140f2fad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:17.866732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad435a58-0af0-466c-bef8-725140f2fad7 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:17.867285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 235/460] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:17.870823 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6a32d-cce6-45d3-a4c4-1bac4887d1fd None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:17.871303 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6a32d-cce6-45d3-a4c4-1bac4887d1fd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:17.871751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6a32d-cce6-45d3-a4c4-1bac4887d1fd None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:17.873508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 236/461] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:17.879793 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f904c-4e21-4cbe-848a-bdef9ba41c5d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:17.880418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f904c-4e21-4cbe-848a-bdef9ba41c5d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:17.881057 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f904c-4e21-4cbe-848a-bdef9ba41c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:17.886828 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 226/462] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:17.893089 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad435a58-0af0-466c-bef8-725140f2fad7 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:17.925585 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4f1f904c-4e21-4cbe-848a-bdef9ba41c5d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:17.926434 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4f1f904c-4e21-4cbe-848a-bdef9ba41c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:17.947941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:18.035024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 237/463] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:18.035024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f904c-4e21-4cbe-848a-bdef9ba41c5d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:18.070362 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad435a58-0af0-466c-bef8-725140f2fad7 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:18.115666 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de967043-1083-455a-a757-4db82e461a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:18.116281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de967043-1083-455a-a757-4db82e461a87 None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:18.117628 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de967043-1083-455a-a757-4db82e461a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:18.117628 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de967043-1083-455a-a757-4db82e461a87 None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:18.117628 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de967043-1083-455a-a757-4db82e461a87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:18.118858 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de967043-1083-455a-a757-4db82e461a87 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:18.141345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 227/464] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 10 13:02:17 2022] POST /identity/v3/users => generated 246 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:02:18.141930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de967043-1083-455a-a757-4db82e461a87 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:18.149284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:18.190239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f904c-4e21-4cbe-848a-bdef9ba41c5d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:18.244090 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589f5ae-5e16-4431-8347-b938055ee4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:18.245090 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589f5ae-5e16-4431-8347-b938055ee4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:18.245490 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589f5ae-5e16-4431-8347-b938055ee4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:18.245902 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589f5ae-5e16-4431-8347-b938055ee4b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:18.261304 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589f5ae-5e16-4431-8347-b938055ee4b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:18.263115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589f5ae-5e16-4431-8347-b938055ee4b9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:18.275840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:18.282764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-3589f5ae-5e16-4431-8347-b938055ee4b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:18.282764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:18.282764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:18.282764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:18.282764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:18.282764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:18.282764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:18.282764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:18.282764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:18.282764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:18.282764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:18.282764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:18.282764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:18.282764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:18.282764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:18.282764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:18.283980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:18.283980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:18.283980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:18.283980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:18.283980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:18.283980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:18.283980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:18.283980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:18.283980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:18.283980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:18.283980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:18.283980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:18.283980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:18.283980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:18.283980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:18.283980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:18.283980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:18.285098 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:18.285098 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:18.285098 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:18.291103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 238/465] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:18.292680 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cba4d-cf12-4323-b074-0ae2acb2bf6e None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:18.292936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cba4d-cf12-4323-b074-0ae2acb2bf6e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:18.293221 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cba4d-cf12-4323-b074-0ae2acb2bf6e None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:18.296075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 239/466] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:18.296407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de967043-1083-455a-a757-4db82e461a87 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:18.298545 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cba4d-cf12-4323-b074-0ae2acb2bf6e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:18.348504 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfcc33-dd05-41c9-ba32-d085aed6f9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:18.350346 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfcc33-dd05-41c9-ba32-d085aed6f9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:18.351338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfcc33-dd05-41c9-ba32-d085aed6f9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:18.351614 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfcc33-dd05-41c9-ba32-d085aed6f9c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:18.369280 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfcc33-dd05-41c9-ba32-d085aed6f9c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:18.371659 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfcc33-dd05-41c9-ba32-d085aed6f9c6 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:18.387891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-e3bfcc33-dd05-41c9-ba32-d085aed6f9c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:18.387891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:18.387891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:18.387891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:18.387891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:18.387891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:18.387891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:18.387891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:18.387891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:18.387891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:18.387891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:18.387891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:18.387891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:18.387891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:18.387891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:18.387891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:18.388833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:18.388833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:18.388833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:18.388833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:18.388833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:18.388833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:18.388833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:18.388833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:18.388833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:18.388833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:18.388833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:18.388833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:18.388833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:18.388833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:18.388833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:18.388833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:18.388833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:18.389694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:18.389694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:18.389694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:18.389694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 228/467] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:18.390669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c99b6-dc6a-440b-bba4-4293db632e32 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:18.390900 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c99b6-dc6a-440b-bba4-4293db632e32 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:18.391768 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c99b6-dc6a-440b-bba4-4293db632e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:18.410335 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-0c9c99b6-dc6a-440b-bba4-4293db632e32 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:18.412416 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-0c9c99b6-dc6a-440b-bba4-4293db632e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:18.465314 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cba4d-cf12-4323-b074-0ae2acb2bf6e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:18.508147 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:18.515754 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd42304-7314-4e99-9591-4eebedfe42f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:18.516366 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd42304-7314-4e99-9591-4eebedfe42f9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:18.516647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 229/468] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:18.516942 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd42304-7314-4e99-9591-4eebedfe42f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:18.517217 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd42304-7314-4e99-9591-4eebedfe42f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:18.517864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd42304-7314-4e99-9591-4eebedfe42f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:18.518017 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c99b6-dc6a-440b-bba4-4293db632e32 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:18.518146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd42304-7314-4e99-9591-4eebedfe42f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:18.519629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd42304-7314-4e99-9591-4eebedfe42f9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:18.541669 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 240/469] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:18.549511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd42304-7314-4e99-9591-4eebedfe42f9 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:18.630485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:18.667639 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd42304-7314-4e99-9591-4eebedfe42f9 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:18.677651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c99b6-dc6a-440b-bba4-4293db632e32 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:18.713567 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2d496-675a-4b69-9ce3-b421dc5d9512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:18.714186 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2d496-675a-4b69-9ce3-b421dc5d9512 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:18.714459 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2d496-675a-4b69-9ce3-b421dc5d9512 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:18.714744 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2d496-675a-4b69-9ce3-b421dc5d9512 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:18.715400 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2d496-675a-4b69-9ce3-b421dc5d9512 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:18.716844 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2d496-675a-4b69-9ce3-b421dc5d9512 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:18.720814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fc11e-af00-4ba9-b946-b4c1b671e4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:18.721429 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fc11e-af00-4ba9-b946-b4c1b671e4bc None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:18.721709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fc11e-af00-4ba9-b946-b4c1b671e4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:18.721986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fc11e-af00-4ba9-b946-b4c1b671e4bc None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:18.722632 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fc11e-af00-4ba9-b946-b4c1b671e4bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:18.722931 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fc11e-af00-4ba9-b946-b4c1b671e4bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:18.724898 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fc11e-af00-4ba9-b946-b4c1b671e4bc None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:18.738690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 230/470] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:18.739636 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fc11e-af00-4ba9-b946-b4c1b671e4bc None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:18.749978 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 241/471] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 10 13:02:18 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:02:18.751990 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c456c23-28f1-44be-82a4-5c99d976c850 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:18.752353 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c456c23-28f1-44be-82a4-5c99d976c850 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:18.752709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c456c23-28f1-44be-82a4-5c99d976c850 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:18.755085 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 242/472] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:18.756710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c456c23-28f1-44be-82a4-5c99d976c850 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:18.819871 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:18.876505 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fc11e-af00-4ba9-b946-b4c1b671e4bc None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:18.885961 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c456c23-28f1-44be-82a4-5c99d976c850 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:18.912843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:18.924460 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a743c-1741-49aa-b6e8-56e669afa3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:18.924460 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a743c-1741-49aa-b6e8-56e669afa3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:18.924718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a743c-1741-49aa-b6e8-56e669afa3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:18.925044 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a743c-1741-49aa-b6e8-56e669afa3c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:18.930365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab57c6d-4a6f-4d1e-b555-0b2643afc36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:18.930632 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab57c6d-4a6f-4d1e-b555-0b2643afc36d None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:18.930912 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab57c6d-4a6f-4d1e-b555-0b2643afc36d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:18.931223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab57c6d-4a6f-4d1e-b555-0b2643afc36d None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:18.931859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab57c6d-4a6f-4d1e-b555-0b2643afc36d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:18.933285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab57c6d-4a6f-4d1e-b555-0b2643afc36d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:18.939369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a743c-1741-49aa-b6e8-56e669afa3c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:18.941370 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a743c-1741-49aa-b6e8-56e669afa3c3 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:18.959138 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 243/473] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 10 13:02:18 2022] POST /identity/v3/users => generated 248 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:02:18.960551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-ac7a743c-1741-49aa-b6e8-56e669afa3c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:18.960551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:18.960551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:18.960551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:18.960551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:18.960551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:18.960551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:18.960551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:18.960551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:18.960551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:18.960551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:18.960551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:18.960551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:18.960551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:18.960551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:18.960551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:18.961447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:18.961447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:18.961447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:18.961447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:18.961447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:18.961447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:18.961447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:18.961447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:18.961447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:18.961447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:18.961447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:18.961447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:18.961447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:18.961447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:18.961447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:18.961447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:18.961447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:18.962310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:18.962310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:18.962310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:18.962478 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a235cd-1797-4e09-bf55-6af62e4ee5ec None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:18.962478 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a235cd-1797-4e09-bf55-6af62e4ee5ec None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:18.962478 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a235cd-1797-4e09-bf55-6af62e4ee5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:18.964665 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 231/474] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:18.972989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a743c-1741-49aa-b6e8-56e669afa3c3 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:18.991373 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-08a235cd-1797-4e09-bf55-6af62e4ee5ec None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:18.992769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-08a235cd-1797-4e09-bf55-6af62e4ee5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:19.119265 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 244/475] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:19.138148 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a743c-1741-49aa-b6e8-56e669afa3c3 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:19.141213 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a235cd-1797-4e09-bf55-6af62e4ee5ec None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:19.190576 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:19.202816 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13292380-3bc5-4002-a5ca-3e14f301f016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:19.203233 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13292380-3bc5-4002-a5ca-3e14f301f016 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:19.203567 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13292380-3bc5-4002-a5ca-3e14f301f016 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:19.203842 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13292380-3bc5-4002-a5ca-3e14f301f016 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:19.204482 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13292380-3bc5-4002-a5ca-3e14f301f016 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:19.204782 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13292380-3bc5-4002-a5ca-3e14f301f016 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:19.206307 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13292380-3bc5-4002-a5ca-3e14f301f016 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:19.220023 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 232/476] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:19.226324 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13292380-3bc5-4002-a5ca-3e14f301f016 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:19.285950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:19.287920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a235cd-1797-4e09-bf55-6af62e4ee5ec None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:19.330722 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab122f-72c5-4b2c-beb4-da9f69e66e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:19.331561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab122f-72c5-4b2c-beb4-da9f69e66e3c None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:19.331940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab122f-72c5-4b2c-beb4-da9f69e66e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:19.332310 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab122f-72c5-4b2c-beb4-da9f69e66e3c None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:19.333073 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab122f-72c5-4b2c-beb4-da9f69e66e3c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:19.335328 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab122f-72c5-4b2c-beb4-da9f69e66e3c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:19.345388 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.sql.core [None req-94ab122f-72c5-4b2c-beb4-da9f69e66e3c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 13:02:19.345388 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 10 13:02:19.345388 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [parameters: {'id': 'f985dcebd9934598aa2e03bda8ec77d8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 10 13:02:19.345388 dv-cinder-836027-5-smb devstack@keystone.service[80296]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80296) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 13:02:19.354275 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13292380-3bc5-4002-a5ca-3e14f301f016 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:19.372099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-94ab122f-72c5-4b2c-beb4-da9f69e66e3c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 10 13:02:19.372099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:19.372099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 13:02:19.372099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 13:02:19.372099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 13:02:19.372099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 13:02:19.372099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 13:02:19.372099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 13:02:19.372099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 13:02:19.372099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application conn.query(q) Aug 10 13:02:19.372099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 13:02:19.372099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 13:02:19.372099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 13:02:19.372099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application result.read() Aug 10 13:02:19.372099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 13:02:19.373174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 13:02:19.373174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 13:02:19.373174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 13:02:19.373174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 13:02:19.373174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 13:02:19.373174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 13:02:19.373174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 13:02:19.373174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 13:02:19.373174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:19.373174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 13:02:19.373174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:19.373174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:19.373174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 13:02:19.373174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 13:02:19.373174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 10 13:02:19.373174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return ref.to_dict() Aug 10 13:02:19.373174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 13:02:19.373174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application next(self.gen) Aug 10 13:02:19.374102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 13:02:19.374102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application yield resource Aug 10 13:02:19.374102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 13:02:19.374102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application next(self.gen) Aug 10 13:02:19.374102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 13:02:19.374102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 13:02:19.374102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 13:02:19.374102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 13:02:19.374102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 13:02:19.374102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise self.value Aug 10 13:02:19.374102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 13:02:19.374102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 13:02:19.374102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 13:02:19.374102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application session.commit() Aug 10 13:02:19.374102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 13:02:19.374102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 13:02:19.374102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 13:02:19.374975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 13:02:19.374975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 13:02:19.374975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self.session.flush() Aug 10 13:02:19.374975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 13:02:19.374975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 13:02:19.374975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 13:02:19.374975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 13:02:19.374975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 13:02:19.374975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application compat.raise_( Aug 10 13:02:19.374975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 13:02:19.374975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception Aug 10 13:02:19.374975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 13:02:19.374975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 13:02:19.374975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 13:02:19.374975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 13:02:19.374975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 13:02:19.374975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 13:02:19.375883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 13:02:19.375883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 13:02:19.375883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 10 13:02:19.375883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 10 13:02:19.375883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 13:02:19.375883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 13:02:19.375883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 13:02:19.375883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 13:02:19.375883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 13:02:19.375883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 13:02:19.375883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 13:02:19.375883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 13:02:19.375883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 13:02:19.375883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 13:02:19.375883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 13:02:19.375883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception Aug 10 13:02:19.378859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 13:02:19.378859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 13:02:19.378859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 13:02:19.378859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 13:02:19.378859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 13:02:19.378859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 13:02:19.378859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 13:02:19.378859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application conn.query(q) Aug 10 13:02:19.378859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 13:02:19.378859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 13:02:19.378859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 13:02:19.378859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application result.read() Aug 10 13:02:19.378859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 13:02:19.378859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 13:02:19.378859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 13:02:19.378859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 13:02:19.380864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 13:02:19.380864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 13:02:19.380864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 13:02:19.380864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 13:02:19.380864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 13:02:19.380864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 10 13:02:19.380864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [parameters: {'id': 'f985dcebd9934598aa2e03bda8ec77d8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 10 13:02:19.380864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 13:02:19.380864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:19.380864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:02:19.380864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:19.380864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:19.380864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:19.380864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:19.380864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:19.380864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:19.385068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:19.385068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:19.385068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:19.385068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:19.385068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:19.385068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:19.385068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 10 13:02:19.385068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 10 13:02:19.385068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:19.385068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:19.385068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 10 13:02:19.385068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 10 13:02:19.385068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 13:02:19.385068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 13:02:19.385068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 10 13:02:19.385068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:19.387254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 245/477] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Aug 10 13:02:19 2022] POST /identity/v3/roles => generated 144 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:02:19.387254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab122f-72c5-4b2c-beb4-da9f69e66e3c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:19.413192 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb8425-f051-4ef2-b650-3ddf6cce6bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:19.413789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb8425-f051-4ef2-b650-3ddf6cce6bdf None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:19.414066 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb8425-f051-4ef2-b650-3ddf6cce6bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:19.414376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb8425-f051-4ef2-b650-3ddf6cce6bdf None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:19.415081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb8425-f051-4ef2-b650-3ddf6cce6bdf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:19.416585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb8425-f051-4ef2-b650-3ddf6cce6bdf None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:19.447323 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 233/478] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 10 13:02:19 2022] POST /identity/v3/users => generated 249 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:02:19.507510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:19.511248 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab122f-72c5-4b2c-beb4-da9f69e66e3c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:19.553320 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ff4c2-0604-499a-8189-3a7654e58377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:19.553985 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ff4c2-0604-499a-8189-3a7654e58377 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:19.554257 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ff4c2-0604-499a-8189-3a7654e58377 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:19.554523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ff4c2-0604-499a-8189-3a7654e58377 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:19.567161 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ff4c2-0604-499a-8189-3a7654e58377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:19.572895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-f90ff4c2-0604-499a-8189-3a7654e58377 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:02:19.572895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:19.572895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:19.572895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:19.572895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:19.572895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:19.572895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:19.572895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:19.572895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:19.572895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:19.572895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:19.572895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:19.572895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:19.572895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:19.572895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:19.572895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:19.574136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:19.574136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:19.574136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:19.574136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:19.574136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:19.574136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:19.574136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:19.574136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:19.574136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:19.574136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:19.574136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:19.574136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:19.574136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:19.574136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:19.574136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:19.574136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:19.574941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:19.574941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:19.574941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:19.574941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:19.574941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:19.574941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:19.574941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:19.574941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:19.574941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:19.574941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:19.574941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 13:02:19.574941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:19.581015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 246/479] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 10 13:02:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:19.581430 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb8425-f051-4ef2-b650-3ddf6cce6bdf None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:19.703063 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb8425-f051-4ef2-b650-3ddf6cce6bdf None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:19.704651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:19.741887 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636d671-f938-4317-9681-274380c21509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:19.742501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636d671-f938-4317-9681-274380c21509 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:19.742779 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636d671-f938-4317-9681-274380c21509 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:19.743138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636d671-f938-4317-9681-274380c21509 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:19.743810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636d671-f938-4317-9681-274380c21509 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:19.744109 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636d671-f938-4317-9681-274380c21509 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:19.745487 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636d671-f938-4317-9681-274380c21509 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:19.758743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 234/480] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:20.611804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bbf64-46d4-4a26-905b-603e6d547edd None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:20.612325 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bbf64-46d4-4a26-905b-603e6d547edd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:20.612433 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bbf64-46d4-4a26-905b-603e6d547edd None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:20.614071 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 247/481] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:20.619291 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45422fe-9884-40a5-b126-33578fdbfee5 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:20.619766 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45422fe-9884-40a5-b126-33578fdbfee5 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:20.619837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45422fe-9884-40a5-b126-33578fdbfee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:20.652138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-b45422fe-9884-40a5-b126-33578fdbfee5 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:20.653521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-b45422fe-9884-40a5-b126-33578fdbfee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:20.737495 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 235/482] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:02:20.773890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bbf64-46d4-4a26-905b-603e6d547edd None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:20.911787 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bbf64-46d4-4a26-905b-603e6d547edd None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:20.961824 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b104d3-8bc1-4579-9a5f-ca6740c7b037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:20.962455 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b104d3-8bc1-4579-9a5f-ca6740c7b037 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:20.962736 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b104d3-8bc1-4579-9a5f-ca6740c7b037 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:20.963028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b104d3-8bc1-4579-9a5f-ca6740c7b037 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:20.973896 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b104d3-8bc1-4579-9a5f-ca6740c7b037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:20.979840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-30b104d3-8bc1-4579-9a5f-ca6740c7b037 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:20.979840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:20.979840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:20.979840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:20.979840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:20.979840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:20.979840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:20.979840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:20.979840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:20.979840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:20.979840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:20.979840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:20.979840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:20.979840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:20.979840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:20.979840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:20.980728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:20.980728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:20.980728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:20.980728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:20.980728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:20.980728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:20.980728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:20.980728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:20.980728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:20.980728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:20.980728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:20.980728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:20.980728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:20.980728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:20.980728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:20.980728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:20.981649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:20.981649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:20.981649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:20.981649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:20.981649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:20.981649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:20.981649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:20.981649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:20.981649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:20.981649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:20.981649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:20.981649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:20.981649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 248/483] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:02:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:20.997884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45422fe-9884-40a5-b126-33578fdbfee5 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:21.129288 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:21.137371 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45422fe-9884-40a5-b126-33578fdbfee5 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:21.187608 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411a8c4-cf2b-4712-abb4-07a1722c895d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:21.188129 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411a8c4-cf2b-4712-abb4-07a1722c895d None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:21.188405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411a8c4-cf2b-4712-abb4-07a1722c895d None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:21.188674 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411a8c4-cf2b-4712-abb4-07a1722c895d None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:21.189331 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411a8c4-cf2b-4712-abb4-07a1722c895d None admin] RBAC: Adding query filter params (name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:21.189628 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411a8c4-cf2b-4712-abb4-07a1722c895d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:21.190980 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411a8c4-cf2b-4712-abb4-07a1722c895d None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:21.202290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 236/484] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 10 13:02:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:21.207866 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b104d3-8bc1-4579-9a5f-ca6740c7b037 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:21.243548 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:21.363236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b104d3-8bc1-4579-9a5f-ca6740c7b037 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:21.424666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a29cc-0627-4004-8fc8-fbe6443af4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:21.425727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a29cc-0627-4004-8fc8-fbe6443af4ee None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:21.426213 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a29cc-0627-4004-8fc8-fbe6443af4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:21.426753 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a29cc-0627-4004-8fc8-fbe6443af4ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:21.448067 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a29cc-0627-4004-8fc8-fbe6443af4ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:21.449927 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a29cc-0627-4004-8fc8-fbe6443af4ee None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:21.468184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-552a29cc-0627-4004-8fc8-fbe6443af4ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:21.468184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:21.468184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:21.468184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:21.468184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:21.468184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:21.468184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:21.468184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:21.468184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:21.468184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:21.468184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:21.468184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:21.468184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:21.468184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:21.468184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:21.468184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:21.469435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:21.469435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:21.469435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:21.469435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:21.469435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:21.469435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:21.469435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:21.469435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:21.469435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:21.469435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:21.469435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:21.469435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:21.469435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:21.469435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:21.469435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:21.469435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:21.469435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:21.470331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:21.470331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:21.470331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:21.472513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 249/485] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:21.480203 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411a8c4-cf2b-4712-abb4-07a1722c895d None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:21.635513 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411a8c4-cf2b-4712-abb4-07a1722c895d None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:21.684007 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e91df-054b-484e-8bb7-24d8f04723d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:21.684630 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e91df-054b-484e-8bb7-24d8f04723d7 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:21.684912 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e91df-054b-484e-8bb7-24d8f04723d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:21.685185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e91df-054b-484e-8bb7-24d8f04723d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:21.685836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e91df-054b-484e-8bb7-24d8f04723d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:21.686140 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e91df-054b-484e-8bb7-24d8f04723d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:21.687554 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e91df-054b-484e-8bb7-24d8f04723d7 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:21.706459 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 237/486] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:21.712701 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a29cc-0627-4004-8fc8-fbe6443af4ee None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:21.717758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730f208-7b94-4213-8be6-26684aed7eae None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:21.718035 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730f208-7b94-4213-8be6-26684aed7eae None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:21.718408 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730f208-7b94-4213-8be6-26684aed7eae None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:21.720180 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 238/487] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:21.725216 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8117f-bf5b-4d39-b45a-f0d95a2e007d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:21.725498 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8117f-bf5b-4d39-b45a-f0d95a2e007d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:21.725770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8117f-bf5b-4d39-b45a-f0d95a2e007d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:21.755153 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-9db8117f-bf5b-4d39-b45a-f0d95a2e007d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:21.755153 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-9db8117f-bf5b-4d39-b45a-f0d95a2e007d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:21.768483 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:21.821415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:21.865696 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 239/488] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:02:21.867099 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675872f2-8d3e-4288-8a62-a2798a50b04a None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:21.867385 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675872f2-8d3e-4288-8a62-a2798a50b04a None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:21.867657 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675872f2-8d3e-4288-8a62-a2798a50b04a None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:21.869213 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 240/489] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:21.875153 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0df49-3387-4faf-a250-851f0223f01b None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:21.875438 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0df49-3387-4faf-a250-851f0223f01b None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:21.875715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0df49-3387-4faf-a250-851f0223f01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:21.885269 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a29cc-0627-4004-8fc8-fbe6443af4ee None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:21.900413 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-9af0df49-3387-4faf-a250-851f0223f01b None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:21.901603 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-9af0df49-3387-4faf-a250-851f0223f01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:21.927816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36607eda-868c-491e-9656-0ac92085c1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:21.928832 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36607eda-868c-491e-9656-0ac92085c1aa None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:21.929381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36607eda-868c-491e-9656-0ac92085c1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:21.929658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36607eda-868c-491e-9656-0ac92085c1aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:21.939264 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36607eda-868c-491e-9656-0ac92085c1aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:21.941566 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36607eda-868c-491e-9656-0ac92085c1aa None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:21.958193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-36607eda-868c-491e-9656-0ac92085c1aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 13:02:21.958193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:21.958193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:21.958193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:21.958193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:21.958193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:21.958193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:21.958193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:21.958193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:21.958193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:21.958193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:21.958193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:21.958193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:21.958193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:21.958193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:21.958193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:21.959925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:21.959925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:21.959925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:21.959925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:21.959925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:21.959925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:21.959925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:21.959925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:21.959925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:21.959925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:21.959925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:21.959925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:21.959925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:21.959925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:21.959925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:21.959925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:21.959925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:21.959925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:21.960865 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:21.960865 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:21.960865 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:21.960865 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:21.960865 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:21.960865 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:21.960865 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:21.960865 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:21.960865 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 13:02:21.960865 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:21.960865 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 250/490] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Aug 10 13:02:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:21.961721 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36607eda-868c-491e-9656-0ac92085c1aa None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:21.975460 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 241/491] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:21.984091 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0df49-3387-4faf-a250-851f0223f01b None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:22.084111 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36607eda-868c-491e-9656-0ac92085c1aa None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:22.101026 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:22.113196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:22.122526 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355c212-1902-44a1-862b-e40e163444cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:22.123220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355c212-1902-44a1-862b-e40e163444cb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:22.123503 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355c212-1902-44a1-862b-e40e163444cb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:22.123776 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355c212-1902-44a1-862b-e40e163444cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:22.135505 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355c212-1902-44a1-862b-e40e163444cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:22.139406 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0df49-3387-4faf-a250-851f0223f01b None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:22.141681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-4355c212-1902-44a1-862b-e40e163444cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:22.141681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:22.141681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:22.141681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:22.141681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:22.141681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:22.141681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:22.141681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:22.141681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:22.141681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:22.141681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:22.141681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:22.141681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:22.141681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:22.141681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:22.141681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:22.142756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:22.142756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:22.142756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:22.142756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:22.142756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:22.142756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:22.142756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:22.142756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:22.142756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:22.142756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:22.142756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:22.142756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:22.142756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:22.142756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:22.142756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:22.142756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:22.143621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:22.143621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:22.143621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:22.143621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:22.143621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:22.143621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:22.143621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:22.143621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:22.143621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:22.143621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:22.143621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:22.143621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:22.143621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 251/492] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:02:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:22.144284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355c212-1902-44a1-862b-e40e163444cb None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:22.179058 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500042c-07fc-4119-bbbb-ba5c33830850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:22.179653 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500042c-07fc-4119-bbbb-ba5c33830850 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:22.179930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500042c-07fc-4119-bbbb-ba5c33830850 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:22.180204 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500042c-07fc-4119-bbbb-ba5c33830850 None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:22.180990 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500042c-07fc-4119-bbbb-ba5c33830850 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:22.181295 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500042c-07fc-4119-bbbb-ba5c33830850 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:22.182763 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500042c-07fc-4119-bbbb-ba5c33830850 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:22.226467 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 242/493] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Aug 10 13:02:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:22.226467 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815d350-ea64-4c16-9fc3-2e2f5a932e09 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:22.226467 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815d350-ea64-4c16-9fc3-2e2f5a932e09 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:22.226467 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815d350-ea64-4c16-9fc3-2e2f5a932e09 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:22.226467 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 243/494] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:22.226467 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815d350-ea64-4c16-9fc3-2e2f5a932e09 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:22.256132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355c212-1902-44a1-862b-e40e163444cb None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:22.293560 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee14141-5295-4da8-9306-868e450860b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:22.294187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee14141-5295-4da8-9306-868e450860b2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:22.294468 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee14141-5295-4da8-9306-868e450860b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:22.294738 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee14141-5295-4da8-9306-868e450860b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:22.306534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee14141-5295-4da8-9306-868e450860b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:22.311708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-dee14141-5295-4da8-9306-868e450860b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:22.311708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:22.311708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:22.311708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:22.311708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:22.311708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:22.311708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:22.311708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:22.311708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:22.311708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:22.311708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:22.311708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:22.311708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:22.311708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:22.311708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:22.311708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:22.312629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:22.312629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:22.312629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:22.312629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:22.312629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:22.312629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:22.312629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:22.312629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:22.312629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:22.312629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:22.312629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:22.312629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:22.312629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:22.312629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:22.312629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:22.312629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:22.313449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:22.313449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:22.313449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:22.313449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:22.313449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:22.313449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:22.313449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:22.313449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:22.313449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:22.313449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:22.313449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:22.313449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:22.317732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 252/495] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:02:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:22.319249 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee14141-5295-4da8-9306-868e450860b2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:22.341715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815d350-ea64-4c16-9fc3-2e2f5a932e09 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:22.374516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:22.376768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:22.381028 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca1e8a-23fe-42a4-873b-9211e52f3db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:22.381580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca1e8a-23fe-42a4-873b-9211e52f3db1 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:22.381992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca1e8a-23fe-42a4-873b-9211e52f3db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:22.382288 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca1e8a-23fe-42a4-873b-9211e52f3db1 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:22.382937 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca1e8a-23fe-42a4-873b-9211e52f3db1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:22.383283 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca1e8a-23fe-42a4-873b-9211e52f3db1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:22.384650 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca1e8a-23fe-42a4-873b-9211e52f3db1 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:22.392848 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 244/496] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 10 13:02:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:22.394029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279e5be-9aaf-47f3-ba30-903aee2023a4 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:22.394304 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279e5be-9aaf-47f3-ba30-903aee2023a4 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:22.394569 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279e5be-9aaf-47f3-ba30-903aee2023a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:22.415424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-a279e5be-9aaf-47f3-ba30-903aee2023a4 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:22.416667 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-a279e5be-9aaf-47f3-ba30-903aee2023a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:22.443488 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee14141-5295-4da8-9306-868e450860b2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:22.483694 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109297d5-02f5-4d54-a870-f8a01d53aec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:22.484225 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109297d5-02f5-4d54-a870-f8a01d53aec0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:22.484512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109297d5-02f5-4d54-a870-f8a01d53aec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:22.484794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109297d5-02f5-4d54-a870-f8a01d53aec0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:22.507053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 245/497] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:22.507053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279e5be-9aaf-47f3-ba30-903aee2023a4 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:22.574634 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109297d5-02f5-4d54-a870-f8a01d53aec0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:22.576116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109297d5-02f5-4d54-a870-f8a01d53aec0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:22.609586 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279e5be-9aaf-47f3-ba30-903aee2023a4 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:22.625938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:22.633760 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:22.645256 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c4129-a098-49fe-ba7a-4e531db66fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:22.645897 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c4129-a098-49fe-ba7a-4e531db66fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:22.646165 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c4129-a098-49fe-ba7a-4e531db66fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:22.646437 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c4129-a098-49fe-ba7a-4e531db66fa3 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:22.647156 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c4129-a098-49fe-ba7a-4e531db66fa3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:22.647447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c4129-a098-49fe-ba7a-4e531db66fa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:22.648826 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c4129-a098-49fe-ba7a-4e531db66fa3 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:22.657273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 246/498] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 10 13:02:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:22.658010 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c4129-a098-49fe-ba7a-4e531db66fa3 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:22.683279 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 253/499] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:22.684586 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4e05e-b6ef-4b89-8ecd-a7c2538c966f None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:22.684824 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4e05e-b6ef-4b89-8ecd-a7c2538c966f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:22.685099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4e05e-b6ef-4b89-8ecd-a7c2538c966f None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:22.686355 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 254/500] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:22.687079 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4e05e-b6ef-4b89-8ecd-a7c2538c966f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:22.762646 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c4129-a098-49fe-ba7a-4e531db66fa3 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:22.791632 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4e05e-b6ef-4b89-8ecd-a7c2538c966f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:22.797811 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced15f8-056b-4b21-90bc-80ae3abbe7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:22.798435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced15f8-056b-4b21-90bc-80ae3abbe7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:22.798715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced15f8-056b-4b21-90bc-80ae3abbe7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:22.798988 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced15f8-056b-4b21-90bc-80ae3abbe7a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:22.809538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced15f8-056b-4b21-90bc-80ae3abbe7a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:22.810879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced15f8-056b-4b21-90bc-80ae3abbe7a5 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:22.824994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-eced15f8-056b-4b21-90bc-80ae3abbe7a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:22.824994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:22.824994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:22.824994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:22.824994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:22.824994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:22.824994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:22.824994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:22.824994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:22.824994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:22.824994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:22.824994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:22.824994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:22.824994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:22.824994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:22.824994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:22.825979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:22.825979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:22.825979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:22.825979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:22.825979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:22.825979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:22.825979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:22.825979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:22.825979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:22.825979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:22.825979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:22.825979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:22.825979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:22.825979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:22.825979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:22.825979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:22.825979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:22.826848 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:22.826848 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:22.826848 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:22.827059 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd34b6-1dc5-4260-92b4-6bb56c10c279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:22.827149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 247/501] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:22.827216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd34b6-1dc5-4260-92b4-6bb56c10c279 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:22.827216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd34b6-1dc5-4260-92b4-6bb56c10c279 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:22.827216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd34b6-1dc5-4260-92b4-6bb56c10c279 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:22.827417 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced15f8-056b-4b21-90bc-80ae3abbe7a5 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:22.842037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd34b6-1dc5-4260-92b4-6bb56c10c279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:22.847063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-39bd34b6-1dc5-4260-92b4-6bb56c10c279 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:22.847063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:22.847063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:22.847063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:22.847063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:22.847063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:22.847063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:22.847063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:22.847063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:22.847063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:22.847063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:22.847063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:22.847063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:22.847063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:22.847063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:22.847063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:22.847992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:22.847992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:22.847992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:22.847992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:22.847992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:22.847992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:22.847992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:22.847992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:22.847992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:22.847992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:22.847992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:22.847992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:22.847992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:22.847992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:22.847992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:22.847992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:22.848812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:22.848812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:22.848812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:22.848812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:22.848812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:22.848812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:22.848812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:22.848812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:22.848812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:22.848812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:22.848812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:22.848812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:22.848812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 255/502] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:02:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:22.850067 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd34b6-1dc5-4260-92b4-6bb56c10c279 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:22.863183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:22.875390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:22.936466 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced15f8-056b-4b21-90bc-80ae3abbe7a5 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:22.956597 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd34b6-1dc5-4260-92b4-6bb56c10c279 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:22.970077 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612a076-7bbe-4276-912e-945545795185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:22.970696 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612a076-7bbe-4276-912e-945545795185 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:22.970971 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612a076-7bbe-4276-912e-945545795185 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:22.971275 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612a076-7bbe-4276-912e-945545795185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:22.981673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612a076-7bbe-4276-912e-945545795185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:22.984484 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612a076-7bbe-4276-912e-945545795185 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:22.992009 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0802c-7254-4c50-9e10-a711688e9742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:22.992640 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0802c-7254-4c50-9e10-a711688e9742 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:22.992925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0802c-7254-4c50-9e10-a711688e9742 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:22.993227 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0802c-7254-4c50-9e10-a711688e9742 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:22.998348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-3612a076-7bbe-4276-912e-945545795185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:22.998348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:22.998348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:22.998348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:22.998348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:22.998348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:22.998348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:22.998348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:22.998348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:22.998348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:22.998348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:22.998348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:22.998348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:22.998348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:22.998348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:22.998348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:22.999432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:22.999432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:22.999432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:22.999432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:22.999432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:22.999432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:22.999432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:22.999432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:22.999432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:22.999432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:22.999432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:22.999432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:22.999432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:22.999432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:22.999432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:22.999432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:22.999432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:23.000483 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:23.000483 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:23.000483 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:23.003948 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 248/503] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:23.004213 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0802c-7254-4c50-9e10-a711688e9742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:23.005230 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfb09a-70ca-4d91-94e6-a08c05713528 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:23.005534 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfb09a-70ca-4d91-94e6-a08c05713528 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:23.005735 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0802c-7254-4c50-9e10-a711688e9742 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:23.005821 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfb09a-70ca-4d91-94e6-a08c05713528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:23.020697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-6cb0802c-7254-4c50-9e10-a711688e9742 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:23.020697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:23.020697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:23.020697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:23.020697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:23.020697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:23.020697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:23.020697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:23.020697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:23.020697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:23.020697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:23.020697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:23.020697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:23.020697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:23.020697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:23.020697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:23.022734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:23.022734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:23.022734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:23.022734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:23.022734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:23.022734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:23.022734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:23.022734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:23.022734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:23.022734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:23.022734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:23.022734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:23.022734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:23.022734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:23.022734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:23.022734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:23.022734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:23.024049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:23.024049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:23.024049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:23.024049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 256/504] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:23.024049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0802c-7254-4c50-9e10-a711688e9742 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:23.025410 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-6edfb09a-70ca-4d91-94e6-a08c05713528 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:23.026760 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-6edfb09a-70ca-4d91-94e6-a08c05713528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:23.084919 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:23.095246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 249/505] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:23.096097 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfb09a-70ca-4d91-94e6-a08c05713528 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:23.122954 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:23.130163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0802c-7254-4c50-9e10-a711688e9742 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:23.166174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09fe23-43e6-481d-a4b9-f276ca0c7893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:23.166785 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09fe23-43e6-481d-a4b9-f276ca0c7893 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:23.167093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09fe23-43e6-481d-a4b9-f276ca0c7893 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:23.167368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09fe23-43e6-481d-a4b9-f276ca0c7893 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:23.168012 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09fe23-43e6-481d-a4b9-f276ca0c7893 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:23.168316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09fe23-43e6-481d-a4b9-f276ca0c7893 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:23.169689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09fe23-43e6-481d-a4b9-f276ca0c7893 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:23.181598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 257/506] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:23.182431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09fe23-43e6-481d-a4b9-f276ca0c7893 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:23.204464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfb09a-70ca-4d91-94e6-a08c05713528 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:23.242518 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a6193-c900-4121-b61a-321b633049d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:23.243163 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a6193-c900-4121-b61a-321b633049d7 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:23.243441 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a6193-c900-4121-b61a-321b633049d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:23.243714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a6193-c900-4121-b61a-321b633049d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:23.244376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a6193-c900-4121-b61a-321b633049d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:23.244673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a6193-c900-4121-b61a-321b633049d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:23.246074 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a6193-c900-4121-b61a-321b633049d7 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:23.256854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 250/507] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 10 13:02:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:23.257912 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a6193-c900-4121-b61a-321b633049d7 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:23.304371 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09fe23-43e6-481d-a4b9-f276ca0c7893 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:23.328149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:23.348248 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5e578-0037-403c-ba89-336ab30ec75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:23.348875 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5e578-0037-403c-ba89-336ab30ec75b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:23.349188 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5e578-0037-403c-ba89-336ab30ec75b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:23.349464 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5e578-0037-403c-ba89-336ab30ec75b None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:23.350128 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5e578-0037-403c-ba89-336ab30ec75b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:23.350433 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5e578-0037-403c-ba89-336ab30ec75b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:23.351896 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5e578-0037-403c-ba89-336ab30ec75b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:23.353684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:23.364826 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 258/508] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:23.365680 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5e578-0037-403c-ba89-336ab30ec75b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:23.373127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a6193-c900-4121-b61a-321b633049d7 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:23.407583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9942f30-19c2-4a9e-a7eb-f825e710d1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:23.408191 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9942f30-19c2-4a9e-a7eb-f825e710d1ef None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:23.408481 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9942f30-19c2-4a9e-a7eb-f825e710d1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:23.408741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9942f30-19c2-4a9e-a7eb-f825e710d1ef None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:23.409386 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9942f30-19c2-4a9e-a7eb-f825e710d1ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:23.409688 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9942f30-19c2-4a9e-a7eb-f825e710d1ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:23.411075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9942f30-19c2-4a9e-a7eb-f825e710d1ef None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:23.423082 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 251/509] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:23.423936 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9942f30-19c2-4a9e-a7eb-f825e710d1ef None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:23.474531 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5e578-0037-403c-ba89-336ab30ec75b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:23.508626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fa593-3c5c-4f2d-9077-447d5949c6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:23.509265 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fa593-3c5c-4f2d-9077-447d5949c6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:23.509542 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fa593-3c5c-4f2d-9077-447d5949c6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:23.509817 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fa593-3c5c-4f2d-9077-447d5949c6b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:23.520581 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fa593-3c5c-4f2d-9077-447d5949c6b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:23.522894 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fa593-3c5c-4f2d-9077-447d5949c6b6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:23.531540 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9942f30-19c2-4a9e-a7eb-f825e710d1ef None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:23.538987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-275fa593-3c5c-4f2d-9077-447d5949c6b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:23.538987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:23.538987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:23.538987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:23.538987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:23.538987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:23.538987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:23.538987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:23.538987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:23.538987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:23.538987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:23.538987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:23.538987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:23.538987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:23.538987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:23.538987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:23.540162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:23.540162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:23.540162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:23.540162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:23.540162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:23.540162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:23.540162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:23.540162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:23.540162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:23.540162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:23.540162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:23.540162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:23.540162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:23.540162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:23.540162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:23.540162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:23.540162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:23.541066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:23.541066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:23.541066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:23.541066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 259/510] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:23.541066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fa593-3c5c-4f2d-9077-447d5949c6b6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:23.574193 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f257c-fbd4-4b59-a7a0-099e6edcbca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:23.574748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f257c-fbd4-4b59-a7a0-099e6edcbca9 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:23.575054 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f257c-fbd4-4b59-a7a0-099e6edcbca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:23.575332 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f257c-fbd4-4b59-a7a0-099e6edcbca9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:23.577437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:23.584394 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f257c-fbd4-4b59-a7a0-099e6edcbca9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:23.585867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f257c-fbd4-4b59-a7a0-099e6edcbca9 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:23.600409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-6b0f257c-fbd4-4b59-a7a0-099e6edcbca9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 13:02:23.600409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:23.600409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:23.600409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:23.600409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:23.600409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:23.600409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:23.600409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:23.600409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:23.600409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:23.600409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:23.600409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:23.600409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:23.600409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:23.600409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:23.600409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:23.601613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:23.601613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:23.601613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:23.601613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:23.601613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:23.601613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:23.601613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:23.601613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:23.601613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:23.601613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:23.601613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:23.601613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:23.601613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:23.601613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:23.601613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:23.601613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:23.601613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:23.601613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:23.602615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:23.602615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:23.602615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:23.602615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:23.602615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:23.602615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:23.602615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:23.602615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:23.602615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 13:02:23.602615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:23.602615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 252/511] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:02:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:23.603676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f257c-fbd4-4b59-a7a0-099e6edcbca9 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:23.605635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:23.659775 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fa593-3c5c-4f2d-9077-447d5949c6b6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:23.694373 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a74309-4dd8-4d5f-803d-3d12e3548730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:23.694995 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a74309-4dd8-4d5f-803d-3d12e3548730 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:23.695301 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a74309-4dd8-4d5f-803d-3d12e3548730 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:23.695571 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a74309-4dd8-4d5f-803d-3d12e3548730 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:23.705972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a74309-4dd8-4d5f-803d-3d12e3548730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:23.707489 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a74309-4dd8-4d5f-803d-3d12e3548730 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:23.712495 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f257c-fbd4-4b59-a7a0-099e6edcbca9 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:23.721336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-62a74309-4dd8-4d5f-803d-3d12e3548730 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:23.721336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:23.721336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:23.721336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:23.721336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:23.721336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:23.721336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:23.721336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:23.721336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:23.721336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:23.721336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:23.721336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:23.721336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:23.721336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:23.721336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:23.721336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:23.722510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:23.722510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:23.722510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:23.722510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:23.722510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:23.722510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:23.722510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:23.722510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:23.722510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:23.722510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:23.722510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:23.722510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:23.722510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:23.722510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:23.722510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:23.722510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:23.722510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:23.723605 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:23.723605 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:23.723605 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:23.723605 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 260/512] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:23.723605 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a74309-4dd8-4d5f-803d-3d12e3548730 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:23.750604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47553cf3-8c14-4755-88e9-45a47e5871cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:23.751266 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47553cf3-8c14-4755-88e9-45a47e5871cd None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:23.751543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47553cf3-8c14-4755-88e9-45a47e5871cd None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:23.751814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47553cf3-8c14-4755-88e9-45a47e5871cd None admin] PATH_INFO: `/v3/users/glance` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:23.759701 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47553cf3-8c14-4755-88e9-45a47e5871cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:23.761165 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47553cf3-8c14-4755-88e9-45a47e5871cd None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:23.772748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-47553cf3-8c14-4755-88e9-45a47e5871cd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 13:02:23.772748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:23.772748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:23.772748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:23.772748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:23.772748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:23.772748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:23.772748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:23.772748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:23.772748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:23.772748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:23.772748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:23.772748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:23.772748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:23.772748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:23.772748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:23.773654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:23.773654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:23.773654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:23.773654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:23.773654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:23.773654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:23.773654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:23.773654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:23.773654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:23.773654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:23.773654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:23.773654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:23.773654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:23.773654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:23.773654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:23.773654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:23.773654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:23.773654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:23.774568 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:23.774568 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:23.774568 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:23.774568 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:23.774568 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:23.774568 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:23.774568 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:23.774568 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:23.774568 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 13:02:23.774568 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:23.774568 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 253/513] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:02:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:23.774568 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47553cf3-8c14-4755-88e9-45a47e5871cd None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:23.811111 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:23.828749 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a74309-4dd8-4d5f-803d-3d12e3548730 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:23.835685 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:23.863568 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868e8fc-80de-42c8-80ad-5ac376fde6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:23.864192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868e8fc-80de-42c8-80ad-5ac376fde6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:23.864474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868e8fc-80de-42c8-80ad-5ac376fde6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:23.864806 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868e8fc-80de-42c8-80ad-5ac376fde6e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:23.871352 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868e8fc-80de-42c8-80ad-5ac376fde6e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:23.872819 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868e8fc-80de-42c8-80ad-5ac376fde6e9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:23.875016 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47553cf3-8c14-4755-88e9-45a47e5871cd None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:23.885001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-0868e8fc-80de-42c8-80ad-5ac376fde6e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:23.885001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:23.885001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:23.885001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:23.885001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:23.885001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:23.885001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:23.885001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:23.885001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:23.885001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:23.885001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:23.885001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:23.885001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:02:23.885001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:02:23.885001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:02:23.885910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:02:23.885910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:23.885910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:23.885910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:23.885910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:23.885910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:23.885910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:23.885910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:23.885910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:23.885910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:23.885910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:23.885910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:23.885910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:23.885910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:23.885910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:23.885910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:23.885910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:23.886794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:02:23.886794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:02:23.886794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:02:23.886794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:02:23.886794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:02:23.886794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:02:23.886794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:23.886794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:23.886794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 261/514] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:23.887311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868e8fc-80de-42c8-80ad-5ac376fde6e9 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:23.909190 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa1ce7-6077-4240-b237-2058501db9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:23.909789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa1ce7-6077-4240-b237-2058501db9bb None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:23.910066 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa1ce7-6077-4240-b237-2058501db9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:23.910334 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa1ce7-6077-4240-b237-2058501db9bb None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:23.910960 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa1ce7-6077-4240-b237-2058501db9bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:23.911290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa1ce7-6077-4240-b237-2058501db9bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:23.912684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa1ce7-6077-4240-b237-2058501db9bb None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:23.924003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 254/515] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:23.924801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa1ce7-6077-4240-b237-2058501db9bb None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:23.996575 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868e8fc-80de-42c8-80ad-5ac376fde6e9 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:24.021695 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa1ce7-6077-4240-b237-2058501db9bb None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:24.030163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae3d0c-a410-453c-89ed-dfb8754dd0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:24.030764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae3d0c-a410-453c-89ed-dfb8754dd0ce None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:24.031092 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae3d0c-a410-453c-89ed-dfb8754dd0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:24.031371 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae3d0c-a410-453c-89ed-dfb8754dd0ce None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:24.032096 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae3d0c-a410-453c-89ed-dfb8754dd0ce None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:24.032400 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae3d0c-a410-453c-89ed-dfb8754dd0ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:24.033824 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae3d0c-a410-453c-89ed-dfb8754dd0ce None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:24.043892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:24.055964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096c674-448c-4852-a48d-6231153cfff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:24.056557 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096c674-448c-4852-a48d-6231153cfff7 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:24.056861 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096c674-448c-4852-a48d-6231153cfff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:24.057091 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096c674-448c-4852-a48d-6231153cfff7 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:24.057782 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096c674-448c-4852-a48d-6231153cfff7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:24.058085 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096c674-448c-4852-a48d-6231153cfff7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:24.059469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096c674-448c-4852-a48d-6231153cfff7 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:24.075058 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 255/517] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:24.075229 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 262/517] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Aug 10 13:02:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:24.075344 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096c674-448c-4852-a48d-6231153cfff7 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:24.075430 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae3d0c-a410-453c-89ed-dfb8754dd0ce None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:24.079174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:24.173346 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096c674-448c-4852-a48d-6231153cfff7 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:24.177082 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae3d0c-a410-453c-89ed-dfb8754dd0ce None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:24.206716 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a077309-5dce-4c0e-830a-183260baf5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:24.207362 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a077309-5dce-4c0e-830a-183260baf5ee None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:24.207633 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a077309-5dce-4c0e-830a-183260baf5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:24.207910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a077309-5dce-4c0e-830a-183260baf5ee None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:24.209158 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a077309-5dce-4c0e-830a-183260baf5ee None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:24.209462 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a077309-5dce-4c0e-830a-183260baf5ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:24.210872 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a077309-5dce-4c0e-830a-183260baf5ee None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:24.211336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db08b0a-7d13-4645-910b-f6dc7648cde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:24.211937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db08b0a-7d13-4645-910b-f6dc7648cde8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:24.212220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db08b0a-7d13-4645-910b-f6dc7648cde8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:24.212667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db08b0a-7d13-4645-910b-f6dc7648cde8 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:24.213363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db08b0a-7d13-4645-910b-f6dc7648cde8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:24.213671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db08b0a-7d13-4645-910b-f6dc7648cde8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:24.215127 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db08b0a-7d13-4645-910b-f6dc7648cde8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:24.228006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 256/518] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Aug 10 13:02:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:24.228793 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a077309-5dce-4c0e-830a-183260baf5ee None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:24.232701 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 263/519] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:02:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:24.233431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db08b0a-7d13-4645-910b-f6dc7648cde8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:24.276413 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:24.299793 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:24.334137 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a077309-5dce-4c0e-830a-183260baf5ee None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:24.338646 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db08b0a-7d13-4645-910b-f6dc7648cde8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:24.367186 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b72048-0ebb-4893-8e7d-81d0e1430864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:24.367775 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b72048-0ebb-4893-8e7d-81d0e1430864 None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:24.368045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b72048-0ebb-4893-8e7d-81d0e1430864 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:24.368317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b72048-0ebb-4893-8e7d-81d0e1430864 None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:24.368930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b72048-0ebb-4893-8e7d-81d0e1430864 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:24.370364 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b72048-0ebb-4893-8e7d-81d0e1430864 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:24.372083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa39441-7344-4a53-abf3-bf6baf62a968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:24.372732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa39441-7344-4a53-abf3-bf6baf62a968 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:24.372960 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa39441-7344-4a53-abf3-bf6baf62a968 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:24.373235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa39441-7344-4a53-abf3-bf6baf62a968 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:24.391649 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 257/520] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 10 13:02:24 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:02:24.392324 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b72048-0ebb-4893-8e7d-81d0e1430864 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:24.459128 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa39441-7344-4a53-abf3-bf6baf62a968 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:24.461340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa39441-7344-4a53-abf3-bf6baf62a968 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:24.505025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:24.513669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b72048-0ebb-4893-8e7d-81d0e1430864 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:24.531831 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:24.557705 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d518c-2478-4f98-9261-e9ffcc752ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:24.558346 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d518c-2478-4f98-9261-e9ffcc752ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:24.558627 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d518c-2478-4f98-9261-e9ffcc752ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:24.558900 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d518c-2478-4f98-9261-e9ffcc752ac5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:24.568639 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d518c-2478-4f98-9261-e9ffcc752ac5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:24.570131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d518c-2478-4f98-9261-e9ffcc752ac5 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:24.579660 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 264/521] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:24.580510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa39441-7344-4a53-abf3-bf6baf62a968 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:24.582162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-677d518c-2478-4f98-9261-e9ffcc752ac5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 13:02:24.582162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:24.582162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:24.582162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:24.582162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:24.582162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:24.582162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:24.582162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:24.582162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:24.582162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:24.582162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:24.582162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:24.582162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:24.582162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:24.582162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:24.582162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:24.583057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:24.583057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:24.583057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:24.583057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:24.583057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:24.583057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:24.583057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:24.583057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:24.583057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:24.583057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:24.583057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:24.583057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:24.583057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:24.583057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:24.583057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:24.583057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:24.583057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:24.583057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:24.584087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:24.584087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:24.584087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:24.584087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:24.584087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:24.584087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:24.584087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:24.584087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:24.584087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 13:02:24.584087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:24.587444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 258/522] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:02:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:24.588259 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d518c-2478-4f98-9261-e9ffcc752ac5 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:24.713555 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa39441-7344-4a53-abf3-bf6baf62a968 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:24.715284 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d518c-2478-4f98-9261-e9ffcc752ac5 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:24.755035 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d44a3-398c-4f4a-b367-0527fb1059f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:24.755035 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d44a3-398c-4f4a-b367-0527fb1059f2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:24.755035 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d44a3-398c-4f4a-b367-0527fb1059f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:24.755035 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d44a3-398c-4f4a-b367-0527fb1059f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:24.756034 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d44a3-398c-4f4a-b367-0527fb1059f2 None admin] RBAC: Adding query filter params (role.id=434a1fd874d24b959bf48fe61633f240, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=7fd0f76f24ea481191dfd65fff2376af) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:24.756034 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d44a3-398c-4f4a-b367-0527fb1059f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:24.756034 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d44a3-398c-4f4a-b367-0527fb1059f2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:24.759381 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aeceb7-ef9b-422f-b90c-6cc6e9aceae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:24.759381 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeceb7-ef9b-422f-b90c-6cc6e9aceae1 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:24.759381 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeceb7-ef9b-422f-b90c-6cc6e9aceae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:24.759381 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeceb7-ef9b-422f-b90c-6cc6e9aceae1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:24.767035 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 265/523] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:02:24 2022] GET /identity/v3/role_assignments?user.id=7fd0f76f24ea481191dfd65fff2376af&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=434a1fd874d24b959bf48fe61633f240 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:24.775042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d44a3-398c-4f4a-b367-0527fb1059f2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:24.798374 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:24.833918 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:24.855850 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aeceb7-ef9b-422f-b90c-6cc6e9aceae1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:24.857269 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aeceb7-ef9b-422f-b90c-6cc6e9aceae1 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:24.981421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 259/524] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:24.982299 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aeceb7-ef9b-422f-b90c-6cc6e9aceae1 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:25.012030 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d44a3-398c-4f4a-b367-0527fb1059f2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:25.042915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:25.088243 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66bdb2-892d-4dd3-ada2-d48aab5c82a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:25.089387 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66bdb2-892d-4dd3-ada2-d48aab5c82a6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:25.089880 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66bdb2-892d-4dd3-ada2-d48aab5c82a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:25.090352 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66bdb2-892d-4dd3-ada2-d48aab5c82a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:25.106968 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66bdb2-892d-4dd3-ada2-d48aab5c82a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:25.112155 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66bdb2-892d-4dd3-ada2-d48aab5c82a6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:25.137247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-cf66bdb2-892d-4dd3-ada2-d48aab5c82a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:25.137247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:25.137247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:25.137247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:25.137247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:25.137247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:25.137247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:25.137247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:25.137247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:25.137247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:25.137247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:25.137247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:25.137247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:25.137247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:25.137247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:25.137247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:25.138198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:25.138198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:25.138198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:25.138198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:25.138198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:25.138198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:25.138198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:25.138198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:25.138198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:25.138198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:25.138198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:25.138198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:25.138198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:25.138198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:25.138198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:25.138198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:25.138198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:25.139107 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:25.139107 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:25.139107 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:25.141825 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 266/525] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:25.142857 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66bdb2-892d-4dd3-ada2-d48aab5c82a6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:25.150340 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aeceb7-ef9b-422f-b90c-6cc6e9aceae1 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:25.231411 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8803a-282e-4e3c-b0bc-8ab57be1a49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:25.232027 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8803a-282e-4e3c-b0bc-8ab57be1a49f None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:25.232307 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8803a-282e-4e3c-b0bc-8ab57be1a49f None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:25.232581 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8803a-282e-4e3c-b0bc-8ab57be1a49f None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:25.233554 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8803a-282e-4e3c-b0bc-8ab57be1a49f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:25.233742 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8803a-282e-4e3c-b0bc-8ab57be1a49f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:25.235223 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8803a-282e-4e3c-b0bc-8ab57be1a49f None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:25.247685 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:25.261199 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 260/526] 10.222.0.46 () {56 vars in 1139 bytes} [Wed Aug 10 13:02:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:25.262218 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8803a-282e-4e3c-b0bc-8ab57be1a49f None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:25.273782 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66bdb2-892d-4dd3-ada2-d48aab5c82a6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:25.311112 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d96fd-9e19-4c6c-a169-f3d05bb67cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:25.312106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d96fd-9e19-4c6c-a169-f3d05bb67cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:25.312585 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d96fd-9e19-4c6c-a169-f3d05bb67cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:25.313161 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d96fd-9e19-4c6c-a169-f3d05bb67cb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:25.326545 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d96fd-9e19-4c6c-a169-f3d05bb67cb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:25.328460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d96fd-9e19-4c6c-a169-f3d05bb67cb7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:25.344463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-577d96fd-9e19-4c6c-a169-f3d05bb67cb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:25.344463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:25.344463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:25.344463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:25.344463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:25.344463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:25.344463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:25.344463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:25.344463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:25.344463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:25.344463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:25.344463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:25.344463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:25.344463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:25.344463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:25.344463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:25.345508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:25.345508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:25.345508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:25.345508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:25.345508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:25.345508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:25.345508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:25.345508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:25.345508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:25.345508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:25.345508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:25.345508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:25.345508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:25.345508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:25.345508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:25.345508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:25.345508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:25.346390 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:25.346390 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:25.346390 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:25.348436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 267/527] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:25.350211 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d96fd-9e19-4c6c-a169-f3d05bb67cb7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:25.383952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8803a-282e-4e3c-b0bc-8ab57be1a49f None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:25.399117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:25.421483 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fae58e-65a3-4167-8b55-655e089bd6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:25.422094 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fae58e-65a3-4167-8b55-655e089bd6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:25.422372 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fae58e-65a3-4167-8b55-655e089bd6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:25.422644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fae58e-65a3-4167-8b55-655e089bd6a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:25.423310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fae58e-65a3-4167-8b55-655e089bd6a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:25.423611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fae58e-65a3-4167-8b55-655e089bd6a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:25.424982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fae58e-65a3-4167-8b55-655e089bd6a0 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:25.438507 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 261/528] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:25.439297 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fae58e-65a3-4167-8b55-655e089bd6a0 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:25.464679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d96fd-9e19-4c6c-a169-f3d05bb67cb7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:25.495747 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:25.504218 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf73d16-5783-4e80-a16b-d60f855ecf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:25.505807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf73d16-5783-4e80-a16b-d60f855ecf54 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:25.506295 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf73d16-5783-4e80-a16b-d60f855ecf54 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:25.506913 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf73d16-5783-4e80-a16b-d60f855ecf54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:25.553353 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fae58e-65a3-4167-8b55-655e089bd6a0 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:25.582645 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf73d16-5783-4e80-a16b-d60f855ecf54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:25.585347 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf73d16-5783-4e80-a16b-d60f855ecf54 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:25.590594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1c31f-14e6-4d1f-99e5-ce7386e05ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:25.591264 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1c31f-14e6-4d1f-99e5-ce7386e05ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:25.591546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1c31f-14e6-4d1f-99e5-ce7386e05ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:25.591820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1c31f-14e6-4d1f-99e5-ce7386e05ef7 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:25.592555 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1c31f-14e6-4d1f-99e5-ce7386e05ef7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:25.592866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1c31f-14e6-4d1f-99e5-ce7386e05ef7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:25.594538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1c31f-14e6-4d1f-99e5-ce7386e05ef7 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:25.608604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 262/529] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:25.609400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1c31f-14e6-4d1f-99e5-ce7386e05ef7 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:25.644104 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:25.699918 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 268/530] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:25.701173 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf73d16-5783-4e80-a16b-d60f855ecf54 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:25.730251 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1c31f-14e6-4d1f-99e5-ce7386e05ef7 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:25.734138 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:25.768641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84a4e9-f955-45a0-a798-6a6f17eb8a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:25.769371 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84a4e9-f955-45a0-a798-6a6f17eb8a28 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:25.769752 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84a4e9-f955-45a0-a798-6a6f17eb8a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:25.770030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84a4e9-f955-45a0-a798-6a6f17eb8a28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:25.779963 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84a4e9-f955-45a0-a798-6a6f17eb8a28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:25.781398 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84a4e9-f955-45a0-a798-6a6f17eb8a28 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:25.794400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-ad84a4e9-f955-45a0-a798-6a6f17eb8a28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:25.794400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:25.794400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:25.794400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:25.794400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:25.794400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:25.794400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:25.794400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:25.794400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:25.794400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:25.794400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:25.794400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:25.794400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:02:25.794400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:02:25.794400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:02:25.795322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:02:25.795322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:25.795322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:25.795322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:25.795322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:25.795322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:25.795322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:25.795322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:25.795322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:25.795322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:25.795322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:25.795322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:25.795322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:25.795322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:25.795322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:25.795322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:25.795322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:25.796166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:02:25.796166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:02:25.796166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:02:25.796166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:02:25.796166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:02:25.796166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:02:25.796166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:25.796166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:25.800420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 263/531] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:25.801362 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84a4e9-f955-45a0-a798-6a6f17eb8a28 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:25.812202 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf73d16-5783-4e80-a16b-d60f855ecf54 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:25.849511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e766510-9067-4d46-aa2f-ba71d92412d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:25.850242 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e766510-9067-4d46-aa2f-ba71d92412d7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:25.850447 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e766510-9067-4d46-aa2f-ba71d92412d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:25.850792 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e766510-9067-4d46-aa2f-ba71d92412d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:25.858087 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e766510-9067-4d46-aa2f-ba71d92412d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:25.859727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e766510-9067-4d46-aa2f-ba71d92412d7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:25.872506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-9e766510-9067-4d46-aa2f-ba71d92412d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:25.872506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:25.872506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:25.872506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:25.872506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:25.872506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:25.872506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:25.872506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:25.872506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:25.872506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:25.872506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:25.872506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:25.872506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:02:25.872506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:02:25.872506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:02:25.874462 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:02:25.874462 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:25.874462 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:25.874462 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:25.874462 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:25.874462 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:25.874462 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:25.874462 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:25.874462 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:25.874462 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:25.874462 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:25.874462 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:25.874462 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:25.874462 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:25.874462 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:25.874462 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:25.874462 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:25.876539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:02:25.876539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:02:25.876539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:02:25.876539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:02:25.876539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:02:25.876539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:02:25.876539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:25.876539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:25.876539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 269/532] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:25.876539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e766510-9067-4d46-aa2f-ba71d92412d7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:25.902654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:25.909706 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84a4e9-f955-45a0-a798-6a6f17eb8a28 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:25.945176 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd5cc2-9c97-4311-a7d1-17ebb3818398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:25.945825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd5cc2-9c97-4311-a7d1-17ebb3818398 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:25.946104 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd5cc2-9c97-4311-a7d1-17ebb3818398 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:25.946377 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd5cc2-9c97-4311-a7d1-17ebb3818398 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:25.959297 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd5cc2-9c97-4311-a7d1-17ebb3818398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:25.960977 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd5cc2-9c97-4311-a7d1-17ebb3818398 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:25.976985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-64bd5cc2-9c97-4311-a7d1-17ebb3818398 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:25.976985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:25.976985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:25.976985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:25.976985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:25.976985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:25.976985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:25.976985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:25.976985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:25.976985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:25.976985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:25.976985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:25.976985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:25.976985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:25.976985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:25.976985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:25.978135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:25.978135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:25.978135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:25.978135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:25.978135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:25.978135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:25.978135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:25.978135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:25.978135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:25.978135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:25.978135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:25.978135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:25.978135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:25.978135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:25.978135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:25.978135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:25.978135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:25.979222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:25.979222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:25.979222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:25.982825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 264/533] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:25.983764 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd5cc2-9c97-4311-a7d1-17ebb3818398 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:25.986396 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:25.992409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e766510-9067-4d46-aa2f-ba71d92412d7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:26.034473 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c19fc-7310-4646-89fa-ebd51aa9966c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:26.035461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c19fc-7310-4646-89fa-ebd51aa9966c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:26.035970 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c19fc-7310-4646-89fa-ebd51aa9966c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:26.036496 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c19fc-7310-4646-89fa-ebd51aa9966c None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:26.037890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c19fc-7310-4646-89fa-ebd51aa9966c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:26.038415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c19fc-7310-4646-89fa-ebd51aa9966c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:26.040225 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c19fc-7310-4646-89fa-ebd51aa9966c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:26.053840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 270/534] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:02:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:26.054910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c19fc-7310-4646-89fa-ebd51aa9966c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:26.093371 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd5cc2-9c97-4311-a7d1-17ebb3818398 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:26.127867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af7930-aa3c-41a0-8752-5e9c7312c035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:26.128477 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af7930-aa3c-41a0-8752-5e9c7312c035 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:26.128752 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af7930-aa3c-41a0-8752-5e9c7312c035 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:26.129023 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af7930-aa3c-41a0-8752-5e9c7312c035 None admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:26.129931 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af7930-aa3c-41a0-8752-5e9c7312c035 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:26.130038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af7930-aa3c-41a0-8752-5e9c7312c035 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:26.132053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af7930-aa3c-41a0-8752-5e9c7312c035 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:26.151189 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 265/535] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:02:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:26.152139 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af7930-aa3c-41a0-8752-5e9c7312c035 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:26.161327 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:26.170695 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c19fc-7310-4646-89fa-ebd51aa9966c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:26.210381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebaff23-1e99-4e6e-b09e-e2e1a09eee91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:26.211585 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebaff23-1e99-4e6e-b09e-e2e1a09eee91 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:26.212095 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebaff23-1e99-4e6e-b09e-e2e1a09eee91 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:26.212661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebaff23-1e99-4e6e-b09e-e2e1a09eee91 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:26.213497 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebaff23-1e99-4e6e-b09e-e2e1a09eee91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:26.213983 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebaff23-1e99-4e6e-b09e-e2e1a09eee91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:26.215785 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebaff23-1e99-4e6e-b09e-e2e1a09eee91 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:26.229806 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 271/536] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:26.230937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebaff23-1e99-4e6e-b09e-e2e1a09eee91 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:26.243852 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:26.264226 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af7930-aa3c-41a0-8752-5e9c7312c035 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:26.302522 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e101bf-cce3-4bc0-a100-69ef058309eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:26.303170 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e101bf-cce3-4bc0-a100-69ef058309eb None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:26.303449 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e101bf-cce3-4bc0-a100-69ef058309eb None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:26.303719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e101bf-cce3-4bc0-a100-69ef058309eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:26.304436 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e101bf-cce3-4bc0-a100-69ef058309eb None admin] RBAC: Adding query filter params (role.id=434a1fd874d24b959bf48fe61633f240, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=ad44decbbaee4d11ac076220bb9c7f40) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:26.304740 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e101bf-cce3-4bc0-a100-69ef058309eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:26.306287 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e101bf-cce3-4bc0-a100-69ef058309eb None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:26.319454 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 266/537] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:02:26 2022] GET /identity/v3/role_assignments?user.id=ad44decbbaee4d11ac076220bb9c7f40&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=434a1fd874d24b959bf48fe61633f240 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:26.320444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e101bf-cce3-4bc0-a100-69ef058309eb None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:26.352361 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebaff23-1e99-4e6e-b09e-e2e1a09eee91 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:26.392149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a21bd-f674-4ee7-bbac-9f72aa95fd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:26.393073 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a21bd-f674-4ee7-bbac-9f72aa95fd8e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:26.393636 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a21bd-f674-4ee7-bbac-9f72aa95fd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:26.394741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a21bd-f674-4ee7-bbac-9f72aa95fd8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:26.395917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a21bd-f674-4ee7-bbac-9f72aa95fd8e None admin] RBAC: Adding query filter params (role.id=434a1fd874d24b959bf48fe61633f240, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=5979be13ad31421b886069faf0dcc915) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:26.396966 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a21bd-f674-4ee7-bbac-9f72aa95fd8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:26.398851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a21bd-f674-4ee7-bbac-9f72aa95fd8e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:26.406077 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 272/538] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:02:26 2022] GET /identity/v3/role_assignments?user.id=5979be13ad31421b886069faf0dcc915&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=434a1fd874d24b959bf48fe61633f240 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:26.444935 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:26.499527 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e101bf-cce3-4bc0-a100-69ef058309eb None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:26.548695 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5aa19-5897-445c-a874-6d6d221d724d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:26.549356 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5aa19-5897-445c-a874-6d6d221d724d None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:26.549628 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5aa19-5897-445c-a874-6d6d221d724d None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:26.549894 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5aa19-5897-445c-a874-6d6d221d724d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:26.557833 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c108cf-1b9e-427f-b760-2d400789b826 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:26.558113 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c108cf-1b9e-427f-b760-2d400789b826 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:26.558390 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c108cf-1b9e-427f-b760-2d400789b826 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:26.559774 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5aa19-5897-445c-a874-6d6d221d724d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:26.560194 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 273/539] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:02:26.561251 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5aa19-5897-445c-a874-6d6d221d724d None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:26.566336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc383c3-f4ef-42ab-a9fa-03c3e8a90458 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:26.566746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc383c3-f4ef-42ab-a9fa-03c3e8a90458 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:26.567096 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc383c3-f4ef-42ab-a9fa-03c3e8a90458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:26.574060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-23c5aa19-5897-445c-a874-6d6d221d724d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:26.574060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:26.574060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:26.574060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:26.574060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:26.574060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:26.574060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:26.574060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:26.574060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:26.574060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:26.574060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:26.574060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:26.574060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:02:26.574060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:02:26.574060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:02:26.574983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:02:26.574983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:26.574983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:26.574983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:26.574983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:26.574983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:26.574983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:26.574983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:26.574983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:26.574983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:26.574983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:26.574983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:26.574983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:26.574983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:26.574983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:26.574983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:26.574983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:26.575876 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:02:26.575876 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:02:26.575876 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:02:26.575876 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:02:26.575876 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:02:26.575876 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:02:26.575876 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:26.575876 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:26.575876 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 267/540] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:26.585009 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5aa19-5897-445c-a874-6d6d221d724d None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:26.589768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-afc383c3-f4ef-42ab-a9fa-03c3e8a90458 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:26.590978 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-afc383c3-f4ef-42ab-a9fa-03c3e8a90458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:26.708964 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 274/541] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:02:26.723724 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5aa19-5897-445c-a874-6d6d221d724d None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:26.747260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc383c3-f4ef-42ab-a9fa-03c3e8a90458 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:26.758304 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:26.772267 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:26.785043 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4cc6e-27b5-4709-bd4b-8a8c2b144b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:26.785651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4cc6e-27b5-4709-bd4b-8a8c2b144b59 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:26.785923 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4cc6e-27b5-4709-bd4b-8a8c2b144b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:26.787175 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4cc6e-27b5-4709-bd4b-8a8c2b144b59 None admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:26.787926 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4cc6e-27b5-4709-bd4b-8a8c2b144b59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:26.788234 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4cc6e-27b5-4709-bd4b-8a8c2b144b59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:26.789657 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4cc6e-27b5-4709-bd4b-8a8c2b144b59 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:26.806376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 268/542] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:02:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:26.816178 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4cc6e-27b5-4709-bd4b-8a8c2b144b59 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:26.909695 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc383c3-f4ef-42ab-a9fa-03c3e8a90458 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:26.945890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891aa8ab-5cb0-4d07-a7ea-5509287d4c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:26.946879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aa8ab-5cb0-4d07-a7ea-5509287d4c24 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:26.947427 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aa8ab-5cb0-4d07-a7ea-5509287d4c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:26.947898 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aa8ab-5cb0-4d07-a7ea-5509287d4c24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:26.959432 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891aa8ab-5cb0-4d07-a7ea-5509287d4c24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:26.964546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-891aa8ab-5cb0-4d07-a7ea-5509287d4c24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:26.964546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:26.964546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:26.964546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:26.964546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:26.964546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:26.964546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:26.964546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:26.964546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:26.964546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:26.964546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:26.964546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:26.964546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:26.964546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:26.964546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:26.964546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:26.965469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:26.965469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:26.965469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:26.965469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:26.965469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:26.965469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:26.965469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:26.965469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:26.965469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:26.965469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:26.965469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:26.965469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:26.965469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:26.965469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:26.965469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:26.965469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:26.966274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:26.966274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:26.966274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:26.966274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:26.966274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:26.966274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:26.966274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:26.966274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:26.966274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:26.966274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:26.966274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:26.966274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:26.969112 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 275/543] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:02:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:26.974545 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891aa8ab-5cb0-4d07-a7ea-5509287d4c24 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:27.030710 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4cc6e-27b5-4709-bd4b-8a8c2b144b59 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:27.042765 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:27.070027 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3016ea-229b-47eb-aaed-42157c7b4df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:27.071070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3016ea-229b-47eb-aaed-42157c7b4df4 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:27.071563 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3016ea-229b-47eb-aaed-42157c7b4df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:27.072027 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3016ea-229b-47eb-aaed-42157c7b4df4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:27.072890 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3016ea-229b-47eb-aaed-42157c7b4df4 None admin] RBAC: Adding query filter params (role.id=434a1fd874d24b959bf48fe61633f240, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=49b69dad00934ce78cbede99f976439f) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:27.073354 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3016ea-229b-47eb-aaed-42157c7b4df4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:27.074939 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3016ea-229b-47eb-aaed-42157c7b4df4 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:27.085834 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891aa8ab-5cb0-4d07-a7ea-5509287d4c24 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:27.086388 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 269/544] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:02:26 2022] GET /identity/v3/role_assignments?user.id=49b69dad00934ce78cbede99f976439f&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=434a1fd874d24b959bf48fe61633f240 => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:27.087927 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e01de-aa8b-43f8-a237-260f26e074d1 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:27.088380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e01de-aa8b-43f8-a237-260f26e074d1 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:27.088809 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e01de-aa8b-43f8-a237-260f26e074d1 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:27.094443 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 270/545] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:27.100922 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae22f6-628a-4b25-a6bb-2035e072ef44 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:27.101222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae22f6-628a-4b25-a6bb-2035e072ef44 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:27.101469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae22f6-628a-4b25-a6bb-2035e072ef44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:27.129780 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-12ae22f6-628a-4b25-a6bb-2035e072ef44 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:27.131493 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-12ae22f6-628a-4b25-a6bb-2035e072ef44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:27.176828 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abcf55-2605-445c-a242-5b5b88ca3276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:27.178037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abcf55-2605-445c-a242-5b5b88ca3276 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:27.178322 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abcf55-2605-445c-a242-5b5b88ca3276 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:27.178596 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abcf55-2605-445c-a242-5b5b88ca3276 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:27.179310 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abcf55-2605-445c-a242-5b5b88ca3276 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:27.179617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abcf55-2605-445c-a242-5b5b88ca3276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:27.181033 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abcf55-2605-445c-a242-5b5b88ca3276 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:27.192468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:27.211465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 276/546] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 10 13:02:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:27.212066 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 271/547] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:27.220189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abcf55-2605-445c-a242-5b5b88ca3276 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:27.235989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae22f6-628a-4b25-a6bb-2035e072ef44 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:27.346680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae22f6-628a-4b25-a6bb-2035e072ef44 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:27.381203 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abcf55-2605-445c-a242-5b5b88ca3276 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:27.383634 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509317c-8827-4ea3-b377-5010979cd4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:27.384524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509317c-8827-4ea3-b377-5010979cd4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:27.385076 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509317c-8827-4ea3-b377-5010979cd4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:27.385557 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509317c-8827-4ea3-b377-5010979cd4f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:27.396710 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509317c-8827-4ea3-b377-5010979cd4f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:27.402086 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-3509317c-8827-4ea3-b377-5010979cd4f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:27.402086 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:27.402086 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:27.402086 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:27.402086 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:27.402086 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:27.402086 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:27.402086 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:27.402086 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:27.402086 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:27.402086 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:27.402086 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:27.402086 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:27.402086 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:27.402086 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:27.402086 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:27.402952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:27.402952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:27.402952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:27.402952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:27.402952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:27.402952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:27.402952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:27.402952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:27.402952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:27.402952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:27.402952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:27.402952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:27.402952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:27.402952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:27.402952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:27.402952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:27.403788 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:27.403788 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:27.403788 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:27.403788 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:27.403788 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:27.403788 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:27.403788 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:27.403788 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:27.403788 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:27.403788 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:27.403788 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:27.403788 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:27.406344 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 272/548] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:02:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:02:27.409519 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:27.412472 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509317c-8827-4ea3-b377-5010979cd4f5 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:27.429909 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649dd49-e3ec-4d7f-a684-9e4cc8548987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:27.430537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649dd49-e3ec-4d7f-a684-9e4cc8548987 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:27.430813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649dd49-e3ec-4d7f-a684-9e4cc8548987 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:27.431103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649dd49-e3ec-4d7f-a684-9e4cc8548987 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:27.453759 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649dd49-e3ec-4d7f-a684-9e4cc8548987 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:27.455243 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649dd49-e3ec-4d7f-a684-9e4cc8548987 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:27.480812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-9649dd49-e3ec-4d7f-a684-9e4cc8548987 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:27.480812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:27.480812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:27.480812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:27.480812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:27.480812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:27.480812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:27.480812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:27.480812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:27.480812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:27.480812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:27.480812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:27.480812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:27.480812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:27.480812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:27.480812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:27.482162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:27.482162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:27.482162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:27.482162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:27.482162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:27.482162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:27.482162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:27.482162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:27.482162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:27.482162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:27.482162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:27.482162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:27.482162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:27.482162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:27.482162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:27.482162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:27.482162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:27.483723 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:27.483723 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:27.483723 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:27.484008 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 277/549] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:27.491047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649dd49-e3ec-4d7f-a684-9e4cc8548987 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:27.495337 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:27.623765 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509317c-8827-4ea3-b377-5010979cd4f5 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:27.626919 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649dd49-e3ec-4d7f-a684-9e4cc8548987 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:27.676463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea95cd-1505-42eb-bce6-136c5eba02f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:27.678259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea95cd-1505-42eb-bce6-136c5eba02f0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:27.678534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea95cd-1505-42eb-bce6-136c5eba02f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:27.678859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea95cd-1505-42eb-bce6-136c5eba02f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:27.679679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea95cd-1505-42eb-bce6-136c5eba02f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:27.679985 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea95cd-1505-42eb-bce6-136c5eba02f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:27.681367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea95cd-1505-42eb-bce6-136c5eba02f0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:27.701041 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 278/550] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:27.703762 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfebb3-5973-49d1-8354-e1d85bc8c60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:27.704374 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfebb3-5973-49d1-8354-e1d85bc8c60e None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:27.704644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfebb3-5973-49d1-8354-e1d85bc8c60e None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:27.704968 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfebb3-5973-49d1-8354-e1d85bc8c60e None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:27.706513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea95cd-1505-42eb-bce6-136c5eba02f0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:27.707294 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfebb3-5973-49d1-8354-e1d85bc8c60e None admin] RBAC: Adding query filter params (name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:27.707609 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfebb3-5973-49d1-8354-e1d85bc8c60e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:27.709053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfebb3-5973-49d1-8354-e1d85bc8c60e None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:27.729741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 273/551] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 10 13:02:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:02:27.736881 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfebb3-5973-49d1-8354-e1d85bc8c60e None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:27.787706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:27.907848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea95cd-1505-42eb-bce6-136c5eba02f0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:27.940264 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfebb3-5973-49d1-8354-e1d85bc8c60e None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:27.957680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:27.987718 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d4e50-f93d-40d1-9d51-15b4fcbcdfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:27.988377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d4e50-f93d-40d1-9d51-15b4fcbcdfb4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:27.988660 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d4e50-f93d-40d1-9d51-15b4fcbcdfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:27.988956 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d4e50-f93d-40d1-9d51-15b4fcbcdfb4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:28.004202 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d4e50-f93d-40d1-9d51-15b4fcbcdfb4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:28.006225 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d4e50-f93d-40d1-9d51-15b4fcbcdfb4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:28.015774 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be9447-fafe-455f-ae47-6170c09370a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:28.016411 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be9447-fafe-455f-ae47-6170c09370a8 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:28.016686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be9447-fafe-455f-ae47-6170c09370a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:28.016954 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be9447-fafe-455f-ae47-6170c09370a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:28.024811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-8f1d4e50-f93d-40d1-9d51-15b4fcbcdfb4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 13:02:28.024811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:28.024811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:28.024811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:28.024811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:28.024811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:28.024811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:28.024811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:28.024811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:28.024811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:28.024811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:28.024811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:28.024811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:28.024811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:28.024811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:28.024811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:28.025732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:28.025732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:28.025732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:28.025732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:28.025732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:28.025732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:28.025732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:28.025732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:28.025732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:28.025732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:28.025732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:28.025732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:28.025732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:28.025732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:28.025732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:28.025732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:28.025732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:28.025732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:28.026750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:28.026750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:28.026750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:28.026750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:28.026750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:28.026750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:28.026750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:28.026750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:28.026750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 13:02:28.026750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:28.026750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 279/552] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:02:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:28.031708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d4e50-f93d-40d1-9d51-15b4fcbcdfb4 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:28.034828 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be9447-fafe-455f-ae47-6170c09370a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:28.036568 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be9447-fafe-455f-ae47-6170c09370a8 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:28.052602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-a6be9447-fafe-455f-ae47-6170c09370a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:28.052602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:28.052602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:28.052602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:28.052602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:28.052602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:28.052602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:28.052602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:28.052602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:28.052602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:28.052602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:28.052602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:28.052602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:28.052602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:28.052602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:28.052602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:28.053595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:28.053595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:28.053595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:28.053595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:28.053595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:28.053595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:28.053595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:28.053595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:28.053595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:28.053595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:28.053595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:28.053595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:28.053595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:28.053595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:28.053595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:28.053595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:28.053595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:28.055369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:28.055369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:28.055369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:28.055369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 274/553] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:28.061170 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be9447-fafe-455f-ae47-6170c09370a8 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:28.179550 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:28.184996 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d4e50-f93d-40d1-9d51-15b4fcbcdfb4 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:28.221277 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b7c26-1d2a-4d8b-adab-54ccaba85761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:28.222387 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b7c26-1d2a-4d8b-adab-54ccaba85761 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:28.223195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b7c26-1d2a-4d8b-adab-54ccaba85761 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:28.223698 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b7c26-1d2a-4d8b-adab-54ccaba85761 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:28.225202 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b7c26-1d2a-4d8b-adab-54ccaba85761 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:28.225709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b7c26-1d2a-4d8b-adab-54ccaba85761 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:28.227393 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b7c26-1d2a-4d8b-adab-54ccaba85761 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:28.229753 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be9447-fafe-455f-ae47-6170c09370a8 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:28.248356 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 280/554] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Aug 10 13:02:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:02:28.256700 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b7c26-1d2a-4d8b-adab-54ccaba85761 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:28.316796 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57d1fa-a785-4f76-9548-f1853b47ec42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:28.317477 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57d1fa-a785-4f76-9548-f1853b47ec42 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:28.318340 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57d1fa-a785-4f76-9548-f1853b47ec42 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:28.318741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57d1fa-a785-4f76-9548-f1853b47ec42 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:28.319261 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57d1fa-a785-4f76-9548-f1853b47ec42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:28.319563 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57d1fa-a785-4f76-9548-f1853b47ec42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:28.320933 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57d1fa-a785-4f76-9548-f1853b47ec42 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:28.350503 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 275/555] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:28.360010 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57d1fa-a785-4f76-9548-f1853b47ec42 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:28.386612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b7c26-1d2a-4d8b-adab-54ccaba85761 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:28.407364 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:28.429704 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3ad39-bc4e-43a9-ae3a-eb1873c872b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:28.430313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3ad39-bc4e-43a9-ae3a-eb1873c872b4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:28.430588 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3ad39-bc4e-43a9-ae3a-eb1873c872b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:28.430857 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3ad39-bc4e-43a9-ae3a-eb1873c872b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:28.484396 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:28.557955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57d1fa-a785-4f76-9548-f1853b47ec42 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:28.568309 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3ad39-bc4e-43a9-ae3a-eb1873c872b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:28.573545 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3ad39-bc4e-43a9-ae3a-eb1873c872b4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:28.632180 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc310055-e852-4a7f-8e6f-ca514a59382b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:28.633273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc310055-e852-4a7f-8e6f-ca514a59382b None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:28.633752 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc310055-e852-4a7f-8e6f-ca514a59382b None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:28.634223 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc310055-e852-4a7f-8e6f-ca514a59382b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:28.650644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc310055-e852-4a7f-8e6f-ca514a59382b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:28.652457 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc310055-e852-4a7f-8e6f-ca514a59382b None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:28.671476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-fc310055-e852-4a7f-8e6f-ca514a59382b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 13:02:28.671476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:28.671476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:28.671476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:28.671476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:28.671476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:28.671476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:28.671476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:28.671476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:28.671476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:28.671476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:28.671476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:28.671476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:28.671476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:28.671476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:28.671476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:28.673003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:28.673003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:28.673003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:28.673003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:28.673003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:28.673003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:28.673003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:28.673003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:28.673003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:28.673003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:28.673003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:28.673003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:28.673003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:28.673003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:28.673003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:28.673003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:28.673003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:28.673003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:28.673950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:28.673950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:28.673950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:28.673950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:28.673950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:28.673950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:28.673950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:28.673950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:28.673950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 13:02:28.673950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:28.682953 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 276/556] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Aug 10 13:02:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:28.686495 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc310055-e852-4a7f-8e6f-ca514a59382b None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:28.753345 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 281/557] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:28.754714 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80901aea-006f-42b9-a392-280f307ec414 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:28.755109 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80901aea-006f-42b9-a392-280f307ec414 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:28.755386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80901aea-006f-42b9-a392-280f307ec414 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:28.756865 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 282/558] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:28.761582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80901aea-006f-42b9-a392-280f307ec414 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:28.804225 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:28.828054 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:28.834843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc310055-e852-4a7f-8e6f-ca514a59382b None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:28.878486 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80901aea-006f-42b9-a392-280f307ec414 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:28.881681 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534f8ed-d62d-489c-948b-a353c43fe588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:28.883349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534f8ed-d62d-489c-948b-a353c43fe588 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:28.883749 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534f8ed-d62d-489c-948b-a353c43fe588 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:28.884123 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534f8ed-d62d-489c-948b-a353c43fe588 None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:28.884956 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534f8ed-d62d-489c-948b-a353c43fe588 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:28.885368 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534f8ed-d62d-489c-948b-a353c43fe588 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:28.886938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534f8ed-d62d-489c-948b-a353c43fe588 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:28.904738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 277/559] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Aug 10 13:02:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:28.906005 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a6b80-7e59-4d14-b0af-201d52c9085d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:28.906293 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a6b80-7e59-4d14-b0af-201d52c9085d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:28.906565 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a6b80-7e59-4d14-b0af-201d52c9085d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:28.922469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899ede9-524e-4622-a455-a3aa63ba74c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:28.923126 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899ede9-524e-4622-a455-a3aa63ba74c1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:28.923403 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899ede9-524e-4622-a455-a3aa63ba74c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:28.923671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899ede9-524e-4622-a455-a3aa63ba74c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:28.924458 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-729a6b80-7e59-4d14-b0af-201d52c9085d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:28.925809 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-729a6b80-7e59-4d14-b0af-201d52c9085d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:28.934393 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899ede9-524e-4622-a455-a3aa63ba74c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:28.935848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899ede9-524e-4622-a455-a3aa63ba74c1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:28.953072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-d899ede9-524e-4622-a455-a3aa63ba74c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:28.953072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:28.953072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:28.953072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:28.953072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:28.953072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:28.953072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:28.953072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:28.953072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:28.953072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:28.953072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:28.953072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:28.953072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:28.953072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:28.953072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:28.953072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:28.954118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:28.954118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:28.954118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:28.954118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:28.954118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:28.954118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:28.954118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:28.954118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:28.954118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:28.954118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:28.954118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:28.954118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:28.954118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:28.954118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:28.954118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:28.954118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:28.954118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:28.955084 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:28.955084 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:28.955084 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:28.963135 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 283/560] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:28.963135 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b10a85-961e-443c-a18b-c31b55a388d4 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:28.963135 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b10a85-961e-443c-a18b-c31b55a388d4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:28.963135 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b10a85-961e-443c-a18b-c31b55a388d4 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:28.963135 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 284/561] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:28.963135 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b10a85-961e-443c-a18b-c31b55a388d4 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:29.019143 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 278/562] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:29.019995 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a6b80-7e59-4d14-b0af-201d52c9085d None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:29.087563 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b10a85-961e-443c-a18b-c31b55a388d4 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:29.093041 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:29.098379 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:29.123857 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50745cd8-344d-4491-818f-6a406d8869b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:29.124478 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50745cd8-344d-4491-818f-6a406d8869b6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:29.124748 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50745cd8-344d-4491-818f-6a406d8869b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:29.125095 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50745cd8-344d-4491-818f-6a406d8869b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:29.133500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a6b80-7e59-4d14-b0af-201d52c9085d None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:29.137159 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50745cd8-344d-4491-818f-6a406d8869b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:29.138604 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50745cd8-344d-4491-818f-6a406d8869b6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:29.153254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-50745cd8-344d-4491-818f-6a406d8869b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:29.153254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:29.153254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:29.153254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:29.153254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:29.153254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:29.153254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:29.153254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:29.153254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:29.153254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:29.153254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:29.153254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:29.153254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:29.153254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:29.153254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:29.153254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:29.154241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:29.154241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:29.154241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:29.154241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:29.154241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:29.154241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:29.154241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:29.154241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:29.154241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:29.154241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:29.154241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:29.154241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:29.154241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:29.154241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:29.154241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:29.154241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:29.154241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:29.160060 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:29.160060 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:29.160060 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:29.160060 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 285/563] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:29.160060 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1b576-fc85-4e28-8bbb-80ab65efefc5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:29.160060 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1b576-fc85-4e28-8bbb-80ab65efefc5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:29.160060 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1b576-fc85-4e28-8bbb-80ab65efefc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:29.176474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc59e8-fe9e-4dd0-b4b3-98129c7b6479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:29.176995 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-13a1b576-fc85-4e28-8bbb-80ab65efefc5 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:29.177176 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc59e8-fe9e-4dd0-b4b3-98129c7b6479 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:29.177424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc59e8-fe9e-4dd0-b4b3-98129c7b6479 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:29.177698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc59e8-fe9e-4dd0-b4b3-98129c7b6479 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:29.178617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-13a1b576-fc85-4e28-8bbb-80ab65efefc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:29.178712 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc59e8-fe9e-4dd0-b4b3-98129c7b6479 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:29.178712 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc59e8-fe9e-4dd0-b4b3-98129c7b6479 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:29.180029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc59e8-fe9e-4dd0-b4b3-98129c7b6479 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:29.197042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 279/564] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:29.197042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc59e8-fe9e-4dd0-b4b3-98129c7b6479 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:29.258887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 286/565] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:29.258887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1b576-fc85-4e28-8bbb-80ab65efefc5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:29.312065 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc59e8-fe9e-4dd0-b4b3-98129c7b6479 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:29.338915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:29.350686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5802a-f044-4f75-a1b5-e4132d8ad476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:29.351448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5802a-f044-4f75-a1b5-e4132d8ad476 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:29.351624 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5802a-f044-4f75-a1b5-e4132d8ad476 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:29.351899 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5802a-f044-4f75-a1b5-e4132d8ad476 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:29.355181 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:29.362764 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5802a-f044-4f75-a1b5-e4132d8ad476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:29.365702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1b576-fc85-4e28-8bbb-80ab65efefc5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:29.367994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-6cb5802a-f044-4f75-a1b5-e4132d8ad476 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:29.367994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:29.367994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:29.367994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:29.367994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:29.367994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:29.367994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:29.367994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:29.367994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:29.367994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:29.367994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:29.367994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:29.367994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:29.367994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:29.367994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:29.367994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:29.368975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:29.368975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:29.368975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:29.368975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:29.368975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:29.368975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:29.368975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:29.368975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:29.368975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:29.368975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:29.368975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:29.368975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:29.368975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:29.368975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:29.368975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:29.368975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:29.369860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:29.369860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:29.369860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:29.369860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:29.369860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:29.369860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:29.369860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:29.369860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:29.369860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:29.369860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:29.369860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:29.369860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:29.369860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 280/566] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:02:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:29.369860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5802a-f044-4f75-a1b5-e4132d8ad476 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:29.405111 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b2d1c-51d1-4725-a399-b339819483e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:29.406046 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b2d1c-51d1-4725-a399-b339819483e5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:29.406515 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b2d1c-51d1-4725-a399-b339819483e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:29.406793 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b2d1c-51d1-4725-a399-b339819483e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:29.407485 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b2d1c-51d1-4725-a399-b339819483e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:29.407773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b2d1c-51d1-4725-a399-b339819483e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:29.409156 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b2d1c-51d1-4725-a399-b339819483e5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:29.421346 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 287/567] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:29.426615 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b2d1c-51d1-4725-a399-b339819483e5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:29.481399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5802a-f044-4f75-a1b5-e4132d8ad476 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:29.514937 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c63746-c686-4558-a8e9-eae77f5929d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:29.515592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c63746-c686-4558-a8e9-eae77f5929d9 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:29.515870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c63746-c686-4558-a8e9-eae77f5929d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:29.516140 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c63746-c686-4558-a8e9-eae77f5929d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:29.523132 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c63746-c686-4558-a8e9-eae77f5929d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:29.524568 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c63746-c686-4558-a8e9-eae77f5929d9 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:29.530671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b2d1c-51d1-4725-a399-b339819483e5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:29.536989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-f9c63746-c686-4558-a8e9-eae77f5929d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:29.536989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:29.536989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:29.536989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:29.536989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:29.536989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:29.536989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:29.536989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:29.536989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:29.536989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:29.536989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:29.536989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:29.536989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:02:29.536989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:02:29.536989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:02:29.537892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:02:29.537892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:29.537892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:29.537892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:29.537892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:29.537892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:29.537892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:29.537892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:29.537892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:29.537892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:29.537892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:29.537892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:29.537892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:29.537892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:29.537892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:29.537892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:29.537892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:29.539393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:02:29.539393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:02:29.539393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:02:29.539393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:02:29.539393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:02:29.539393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:02:29.539393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:29.539393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:29.539393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 281/568] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:29.539393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c63746-c686-4558-a8e9-eae77f5929d9 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:29.564916 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69a7f9-370e-4bcc-894a-334f59f19bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:29.565657 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69a7f9-370e-4bcc-894a-334f59f19bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:29.566007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69a7f9-370e-4bcc-894a-334f59f19bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:29.566341 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69a7f9-370e-4bcc-894a-334f59f19bf6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:29.576713 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69a7f9-370e-4bcc-894a-334f59f19bf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:29.581895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-eb69a7f9-370e-4bcc-894a-334f59f19bf6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:29.581895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:29.581895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:29.581895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:29.581895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:29.581895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:29.581895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:29.581895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:29.581895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:29.581895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:29.581895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:29.581895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:29.581895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:29.581895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:29.581895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:29.581895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:29.582847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:29.582847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:29.582847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:29.582847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:29.582847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:29.582847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:29.582847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:29.582847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:29.582847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:29.582847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:29.582847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:29.582847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:29.582847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:29.582847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:29.582847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:29.582847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:29.584342 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:29.584342 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:29.584342 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:29.584342 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:29.584342 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:29.584342 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:29.584342 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:29.584342 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:29.584342 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:29.584342 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:29.584342 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:29.584342 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:29.584342 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 288/569] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:02:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:29.584342 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69a7f9-370e-4bcc-894a-334f59f19bf6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:29.587837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:29.602773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:29.646897 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c63746-c686-4558-a8e9-eae77f5929d9 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:29.678441 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3685b-144a-4add-a51a-894a23f50ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:29.679064 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3685b-144a-4add-a51a-894a23f50ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:29.679343 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3685b-144a-4add-a51a-894a23f50ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:29.679608 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3685b-144a-4add-a51a-894a23f50ea2 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:29.680256 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3685b-144a-4add-a51a-894a23f50ea2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:29.680551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3685b-144a-4add-a51a-894a23f50ea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:29.681916 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3685b-144a-4add-a51a-894a23f50ea2 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:29.690268 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 282/570] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 10 13:02:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:29.691525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970d93c-d092-444c-92b5-52ade52e22e7 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:29.691807 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970d93c-d092-444c-92b5-52ade52e22e7 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:29.692073 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970d93c-d092-444c-92b5-52ade52e22e7 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:29.692155 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69a7f9-370e-4bcc-894a-334f59f19bf6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:29.693452 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 283/571] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:29.693992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970d93c-d092-444c-92b5-52ade52e22e7 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:29.729046 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8fc20c-196a-4655-aab8-522a6cc1b68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:29.729675 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fc20c-196a-4655-aab8-522a6cc1b68b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:29.729952 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fc20c-196a-4655-aab8-522a6cc1b68b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:29.730223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fc20c-196a-4655-aab8-522a6cc1b68b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:29.736773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8fc20c-196a-4655-aab8-522a6cc1b68b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:29.738208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8fc20c-196a-4655-aab8-522a6cc1b68b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:29.750479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5a8fc20c-196a-4655-aab8-522a6cc1b68b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:29.750479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:29.750479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:29.750479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:29.750479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:29.750479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:29.750479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:29.750479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:29.750479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:29.750479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:29.750479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:29.750479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:29.750479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:02:29.750479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:02:29.750479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:02:29.751558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:02:29.751558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:29.751558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:29.751558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:29.751558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:29.751558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:29.751558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:29.751558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:29.751558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:29.751558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:29.751558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:29.751558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:29.751558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:29.751558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:29.751558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:29.751558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:29.751558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:29.752670 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:02:29.752670 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:02:29.752670 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:02:29.752670 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:02:29.752670 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:02:29.752670 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:02:29.752670 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:29.752670 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:29.752670 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 289/572] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:29.752670 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8fc20c-196a-4655-aab8-522a6cc1b68b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:29.799957 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970d93c-d092-444c-92b5-52ade52e22e7 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:29.808617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:29.829512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:29.839029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00ceeb-d2c4-4e35-8b94-4a8c1c82e63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:29.839650 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00ceeb-d2c4-4e35-8b94-4a8c1c82e63a None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:29.839928 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00ceeb-d2c4-4e35-8b94-4a8c1c82e63a None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:29.840204 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00ceeb-d2c4-4e35-8b94-4a8c1c82e63a None admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:29.840899 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00ceeb-d2c4-4e35-8b94-4a8c1c82e63a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:29.841211 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00ceeb-d2c4-4e35-8b94-4a8c1c82e63a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:29.842649 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00ceeb-d2c4-4e35-8b94-4a8c1c82e63a None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:29.855446 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 284/573] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:02:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:29.856218 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00ceeb-d2c4-4e35-8b94-4a8c1c82e63a None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:29.869081 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8fc20c-196a-4655-aab8-522a6cc1b68b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:29.905771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e21ad5-eeb3-4a7b-b3f0-357e06ddbbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:29.906370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e21ad5-eeb3-4a7b-b3f0-357e06ddbbf7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:29.906656 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e21ad5-eeb3-4a7b-b3f0-357e06ddbbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:29.906930 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e21ad5-eeb3-4a7b-b3f0-357e06ddbbf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:29.907614 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e21ad5-eeb3-4a7b-b3f0-357e06ddbbf7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:29.907915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e21ad5-eeb3-4a7b-b3f0-357e06ddbbf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:29.909280 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e21ad5-eeb3-4a7b-b3f0-357e06ddbbf7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:29.917276 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 290/574] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 10 13:02:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:29.918513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fe64e-f471-4186-b6b4-87b44abe8e89 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:29.918728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fe64e-f471-4186-b6b4-87b44abe8e89 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:29.919035 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fe64e-f471-4186-b6b4-87b44abe8e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:29.936289 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-322fe64e-f471-4186-b6b4-87b44abe8e89 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:29.937486 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-322fe64e-f471-4186-b6b4-87b44abe8e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:29.956282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00ceeb-d2c4-4e35-8b94-4a8c1c82e63a None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:29.990383 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86c88a-19d1-4fcf-9e7f-255ca361ea32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:29.991028 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86c88a-19d1-4fcf-9e7f-255ca361ea32 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:29.991322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86c88a-19d1-4fcf-9e7f-255ca361ea32 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:29.991595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86c88a-19d1-4fcf-9e7f-255ca361ea32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:30.001719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86c88a-19d1-4fcf-9e7f-255ca361ea32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:30.003182 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86c88a-19d1-4fcf-9e7f-255ca361ea32 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:30.004647 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 291/575] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:30.015160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fe64e-f471-4186-b6b4-87b44abe8e89 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:30.018292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-8c86c88a-19d1-4fcf-9e7f-255ca361ea32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:30.018292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:30.018292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:30.018292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:30.018292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:30.018292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:30.018292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:30.018292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:30.018292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:30.018292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:30.018292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:30.018292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:30.018292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:30.018292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:30.018292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:30.018292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:30.024658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:30.024658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:30.024658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:30.024658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:30.024658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:30.024658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:30.024658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:30.024658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:30.024658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:30.024658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:30.024658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:30.024658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:30.024658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:30.024658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:30.024658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:30.024658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:30.024658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:30.025609 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:30.025609 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:30.025609 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:30.025609 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 285/576] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:30.025609 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86c88a-19d1-4fcf-9e7f-255ca361ea32 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:30.043515 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:30.077223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:30.116775 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fe64e-f471-4186-b6b4-87b44abe8e89 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:30.120916 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86c88a-19d1-4fcf-9e7f-255ca361ea32 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:30.149182 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889f5cc-feef-4789-887d-9c4bffbec27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:30.149781 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889f5cc-feef-4789-887d-9c4bffbec27e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:30.150055 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889f5cc-feef-4789-887d-9c4bffbec27e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:30.150321 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889f5cc-feef-4789-887d-9c4bffbec27e None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:30.150995 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889f5cc-feef-4789-887d-9c4bffbec27e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:30.151316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889f5cc-feef-4789-887d-9c4bffbec27e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:30.152721 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889f5cc-feef-4789-887d-9c4bffbec27e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:30.153530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc271af2-b169-43d2-a003-ab572a774d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:30.154132 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc271af2-b169-43d2-a003-ab572a774d71 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:30.154411 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc271af2-b169-43d2-a003-ab572a774d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:30.154684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc271af2-b169-43d2-a003-ab572a774d71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:30.155426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc271af2-b169-43d2-a003-ab572a774d71 None admin] RBAC: Adding query filter params (role.id=434a1fd874d24b959bf48fe61633f240, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=5c86ef66c9564e0395c325a84ca9c4a5) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:30.155738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc271af2-b169-43d2-a003-ab572a774d71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:30.157152 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc271af2-b169-43d2-a003-ab572a774d71 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:30.162940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 286/577] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:02:30 2022] GET /identity/v3/role_assignments?user.id=5c86ef66c9564e0395c325a84ca9c4a5&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=434a1fd874d24b959bf48fe61633f240 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:30.163738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc271af2-b169-43d2-a003-ab572a774d71 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:30.169329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 292/578] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:02:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:30.169329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889f5cc-feef-4789-887d-9c4bffbec27e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:30.274875 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:30.292381 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc271af2-b169-43d2-a003-ab572a774d71 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:30.292596 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889f5cc-feef-4789-887d-9c4bffbec27e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:30.324023 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:30.337619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698f275-dcd7-4347-8d07-f7220ec4790f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:30.338120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618e88b-8c92-45ce-b717-7946b1fa6121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:30.338243 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698f275-dcd7-4347-8d07-f7220ec4790f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:30.338503 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698f275-dcd7-4347-8d07-f7220ec4790f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:30.338744 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618e88b-8c92-45ce-b717-7946b1fa6121 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:30.338851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698f275-dcd7-4347-8d07-f7220ec4790f None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:30.339068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618e88b-8c92-45ce-b717-7946b1fa6121 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:30.339306 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618e88b-8c92-45ce-b717-7946b1fa6121 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:30.339463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698f275-dcd7-4347-8d07-f7220ec4790f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:30.339801 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698f275-dcd7-4347-8d07-f7220ec4790f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:30.341102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698f275-dcd7-4347-8d07-f7220ec4790f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:30.351240 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618e88b-8c92-45ce-b717-7946b1fa6121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:30.353076 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618e88b-8c92-45ce-b717-7946b1fa6121 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:30.361523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 293/579] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:30.361523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698f275-dcd7-4347-8d07-f7220ec4790f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:30.367910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-5618e88b-8c92-45ce-b717-7946b1fa6121 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:30.367910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:30.367910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:30.367910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:30.367910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:30.367910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:30.367910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:30.367910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:30.367910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:30.367910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:30.367910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:30.367910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:30.367910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:30.367910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:30.367910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:30.367910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:30.368834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:30.368834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:30.368834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:30.368834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:30.368834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:30.368834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:30.368834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:30.368834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:30.368834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:30.368834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:30.368834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:30.368834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:30.368834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:30.368834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:30.368834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:30.368834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:30.368834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:30.369728 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:30.369728 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:30.369728 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:30.369728 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 287/580] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:30.369728 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618e88b-8c92-45ce-b717-7946b1fa6121 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:30.469320 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698f275-dcd7-4347-8d07-f7220ec4790f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:30.479429 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618e88b-8c92-45ce-b717-7946b1fa6121 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:30.506352 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d00a52-76f5-418d-808a-d32ed4a99aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:30.506989 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d00a52-76f5-418d-808a-d32ed4a99aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:30.507295 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d00a52-76f5-418d-808a-d32ed4a99aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:30.507573 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d00a52-76f5-418d-808a-d32ed4a99aa3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:30.519128 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d00a52-76f5-418d-808a-d32ed4a99aa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:30.521010 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb2b12-0089-4d62-8eca-785f8d7a04ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:30.521825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb2b12-0089-4d62-8eca-785f8d7a04ef None admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:30.522247 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb2b12-0089-4d62-8eca-785f8d7a04ef None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:30.522682 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb2b12-0089-4d62-8eca-785f8d7a04ef None admin] PATH_INFO: `/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/7fd0f76f24ea481191dfd65fff2376af/roles/434a1fd874d24b959bf48fe61633f240` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:30.523915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b9d00a52-76f5-418d-808a-d32ed4a99aa3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:30.523915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:30.523915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:30.523915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:30.523915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:30.523915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:30.523915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:30.523915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:30.523915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:30.523915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:30.523915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:30.523915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:30.523915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:30.523915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:30.523915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:30.523915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:30.524999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:30.524999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:30.524999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:30.524999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:30.524999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:30.524999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:30.524999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:30.524999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:30.524999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:30.524999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:30.524999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:30.524999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:30.524999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:30.524999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:30.524999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:30.524999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:30.525965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:30.525965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:30.525965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:30.525965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:30.525965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:30.525965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:30.525965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:30.525965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:30.525965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:30.525965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:30.525965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:30.525965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:30.525965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 294/581] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:02:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:30.526654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d00a52-76f5-418d-808a-d32ed4a99aa3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:30.532321 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:30.546696 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb2b12-0089-4d62-8eca-785f8d7a04ef None admin] RBAC: Authorizing `identity:create_grant(project_id=8aa2ccddadb54dd9b88ccc6cec98ae37, user_id=7fd0f76f24ea481191dfd65fff2376af, role_id=434a1fd874d24b959bf48fe61633f240)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:30.548243 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb2b12-0089-4d62-8eca-785f8d7a04ef None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:30.573009 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 288/582] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:02:30 2022] PUT /identity/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/7fd0f76f24ea481191dfd65fff2376af/roles/434a1fd874d24b959bf48fe61633f240 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:02:30.573009 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb2b12-0089-4d62-8eca-785f8d7a04ef None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:30.580510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:30.648767 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d00a52-76f5-418d-808a-d32ed4a99aa3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:30.689691 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b9661-39cc-4889-bfa9-3e6c7395a5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:30.690627 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b9661-39cc-4889-bfa9-3e6c7395a5fe None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:30.691336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b9661-39cc-4889-bfa9-3e6c7395a5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:30.691752 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b9661-39cc-4889-bfa9-3e6c7395a5fe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:30.695560 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb2b12-0089-4d62-8eca-785f8d7a04ef None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:30.700771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b9661-39cc-4889-bfa9-3e6c7395a5fe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:30.702440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b9661-39cc-4889-bfa9-3e6c7395a5fe None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:30.716272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b04b9661-39cc-4889-bfa9-3e6c7395a5fe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 13:02:30.716272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:30.716272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:30.716272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:30.716272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:30.716272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:30.716272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:30.716272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:30.716272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:30.716272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:30.716272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:30.716272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:30.716272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:30.716272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:30.716272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:30.716272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:30.717339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:30.717339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:30.717339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:30.717339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:30.717339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:30.717339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:30.717339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:30.717339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:30.717339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:30.717339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:30.717339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:30.717339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:30.717339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:30.717339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:30.717339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:30.717339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:30.717339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:30.717339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:30.718285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:30.718285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:30.718285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:30.718285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:30.718285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:30.718285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:30.718285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:30.718285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:30.718285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 13:02:30.718285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:30.725300 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 295/583] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:02:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:30.726029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b9661-39cc-4889-bfa9-3e6c7395a5fe None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:30.739681 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb8dd6-d11b-4781-8abe-158b99683a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:30.740934 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb8dd6-d11b-4781-8abe-158b99683a17 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:30.741393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb8dd6-d11b-4781-8abe-158b99683a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:30.742147 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb8dd6-d11b-4781-8abe-158b99683a17 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:30.743290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb8dd6-d11b-4781-8abe-158b99683a17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:30.743769 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb8dd6-d11b-4781-8abe-158b99683a17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:30.745932 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb8dd6-d11b-4781-8abe-158b99683a17 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:30.761507 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 289/584] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:30.764158 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb8dd6-d11b-4781-8abe-158b99683a17 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:30.812720 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:30.863644 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b9661-39cc-4889-bfa9-3e6c7395a5fe None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:30.867288 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:30.880490 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb8dd6-d11b-4781-8abe-158b99683a17 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:30.902271 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369c3d6-3ddf-4647-9beb-fd52a0258ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:30.903217 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369c3d6-3ddf-4647-9beb-fd52a0258ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:30.903737 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369c3d6-3ddf-4647-9beb-fd52a0258ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:30.904237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369c3d6-3ddf-4647-9beb-fd52a0258ce4 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:30.905167 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369c3d6-3ddf-4647-9beb-fd52a0258ce4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:30.905700 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369c3d6-3ddf-4647-9beb-fd52a0258ce4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:30.907510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369c3d6-3ddf-4647-9beb-fd52a0258ce4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:30.917527 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 296/585] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 10 13:02:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:30.918663 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369c3d6-3ddf-4647-9beb-fd52a0258ce4 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:30.923272 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df963e-fc5b-461b-973d-c36d81e17adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:30.923882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df963e-fc5b-461b-973d-c36d81e17adc None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:30.924156 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df963e-fc5b-461b-973d-c36d81e17adc None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:30.924424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df963e-fc5b-461b-973d-c36d81e17adc None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:30.925148 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df963e-fc5b-461b-973d-c36d81e17adc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:30.925444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df963e-fc5b-461b-973d-c36d81e17adc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:30.926947 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df963e-fc5b-461b-973d-c36d81e17adc None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:30.946879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 290/586] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Aug 10 13:02:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:30.947824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df963e-fc5b-461b-973d-c36d81e17adc None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:31.029181 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369c3d6-3ddf-4647-9beb-fd52a0258ce4 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:31.057868 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df963e-fc5b-461b-973d-c36d81e17adc None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:31.060597 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:31.066175 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764bb6b2-511c-4286-90c2-56a131b0c12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:31.067171 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bb6b2-511c-4286-90c2-56a131b0c12f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:31.067778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bb6b2-511c-4286-90c2-56a131b0c12f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:31.068184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bb6b2-511c-4286-90c2-56a131b0c12f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:31.076556 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764bb6b2-511c-4286-90c2-56a131b0c12f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:31.078036 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764bb6b2-511c-4286-90c2-56a131b0c12f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:31.090216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-764bb6b2-511c-4286-90c2-56a131b0c12f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 13:02:31.090216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:31.090216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:31.090216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:31.090216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:31.090216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:31.090216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:31.090216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:31.090216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:31.090216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:31.090216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:31.090216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:31.090216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:31.090216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:31.090216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:31.090216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:31.091290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:31.091290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:31.091290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:31.091290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:31.091290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:31.091290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:31.091290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:31.091290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:31.091290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:31.091290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:31.091290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:31.091290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:31.091290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:31.091290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:31.091290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:31.091290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:31.091290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:31.091290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:31.092800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:31.092800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:31.092800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:31.092800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:31.092800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:31.092800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:31.092800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:31.092800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:31.092800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 13:02:31.092800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:31.092800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 297/587] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:02:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:31.092800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764bb6b2-511c-4286-90c2-56a131b0c12f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:31.101536 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387391e-3de8-4f66-8fb1-658da5d16a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:31.102687 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387391e-3de8-4f66-8fb1-658da5d16a5a None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:31.103297 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387391e-3de8-4f66-8fb1-658da5d16a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:31.103791 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387391e-3de8-4f66-8fb1-658da5d16a5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:31.116539 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387391e-3de8-4f66-8fb1-658da5d16a5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:31.118255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387391e-3de8-4f66-8fb1-658da5d16a5a None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:31.119998 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:31.137350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-1387391e-3de8-4f66-8fb1-658da5d16a5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:31.137350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:31.137350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:31.137350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:31.137350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:31.137350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:31.137350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:31.137350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:31.137350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:31.137350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:31.137350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:31.137350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:31.137350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:31.137350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:31.137350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:31.137350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:31.138378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:31.138378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:31.138378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:31.138378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:31.138378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:31.138378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:31.138378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:31.138378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:31.138378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:31.138378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:31.138378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:31.138378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:31.138378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:31.138378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:31.138378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:31.138378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:31.138378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:31.139293 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:31.139293 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:31.139293 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:31.141574 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 291/588] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:31.142751 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387391e-3de8-4f66-8fb1-658da5d16a5a None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:31.210070 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764bb6b2-511c-4286-90c2-56a131b0c12f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:31.266736 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98fb9e-2771-4ad7-8450-bc3ff4d50b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:31.268052 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98fb9e-2771-4ad7-8450-bc3ff4d50b0e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:31.268513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98fb9e-2771-4ad7-8450-bc3ff4d50b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:31.268830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98fb9e-2771-4ad7-8450-bc3ff4d50b0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:31.276961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387391e-3de8-4f66-8fb1-658da5d16a5a None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:31.284500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98fb9e-2771-4ad7-8450-bc3ff4d50b0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:31.286739 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98fb9e-2771-4ad7-8450-bc3ff4d50b0e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:31.309772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2c98fb9e-2771-4ad7-8450-bc3ff4d50b0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:31.309772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:31.309772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:31.309772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:31.309772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:31.309772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:31.309772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:31.309772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:31.309772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:31.309772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:31.309772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:31.309772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:31.309772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:31.309772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:31.309772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:31.309772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:31.310771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:31.310771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:31.310771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:31.310771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:31.310771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:31.310771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:31.310771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:31.310771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:31.310771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:31.310771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:31.310771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:31.310771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:31.310771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:31.310771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:31.310771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:31.310771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:31.310771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:31.311796 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:31.311796 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:31.311796 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:31.315292 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 298/589] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:31.316720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98fb9e-2771-4ad7-8450-bc3ff4d50b0e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:31.324863 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdabd3-4ae3-4a8b-9671-da1a0d182330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:31.325703 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdabd3-4ae3-4a8b-9671-da1a0d182330 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:31.326133 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdabd3-4ae3-4a8b-9671-da1a0d182330 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:31.327080 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdabd3-4ae3-4a8b-9671-da1a0d182330 None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:31.327982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdabd3-4ae3-4a8b-9671-da1a0d182330 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:31.328471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdabd3-4ae3-4a8b-9671-da1a0d182330 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:31.330818 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdabd3-4ae3-4a8b-9671-da1a0d182330 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:31.356396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 292/590] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Aug 10 13:02:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:31.357559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdabd3-4ae3-4a8b-9671-da1a0d182330 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:31.379331 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:31.403391 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:31.429243 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98fb9e-2771-4ad7-8450-bc3ff4d50b0e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:31.467337 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f206c3-3d5f-423b-9bfd-3a4fa987e508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:31.467880 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f206c3-3d5f-423b-9bfd-3a4fa987e508 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:31.469381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f206c3-3d5f-423b-9bfd-3a4fa987e508 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:31.469381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f206c3-3d5f-423b-9bfd-3a4fa987e508 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:31.469682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f206c3-3d5f-423b-9bfd-3a4fa987e508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:31.469982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f206c3-3d5f-423b-9bfd-3a4fa987e508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:31.471437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f206c3-3d5f-423b-9bfd-3a4fa987e508 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:31.492084 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 299/591] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:31.492084 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f206c3-3d5f-423b-9bfd-3a4fa987e508 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:31.501707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdabd3-4ae3-4a8b-9671-da1a0d182330 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:31.538415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffcb2f-eebc-459c-b393-4b96f72bb613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:31.539041 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffcb2f-eebc-459c-b393-4b96f72bb613 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:31.539610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffcb2f-eebc-459c-b393-4b96f72bb613 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:31.539610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffcb2f-eebc-459c-b393-4b96f72bb613 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:31.540211 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffcb2f-eebc-459c-b393-4b96f72bb613 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:31.540569 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffcb2f-eebc-459c-b393-4b96f72bb613 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:31.541996 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffcb2f-eebc-459c-b393-4b96f72bb613 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:31.559930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 293/592] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:31.559930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffcb2f-eebc-459c-b393-4b96f72bb613 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:31.616661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f206c3-3d5f-423b-9bfd-3a4fa987e508 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:31.642924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:31.667496 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0c8b8-5741-4cf2-9667-29d4e88fb1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:31.668383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0c8b8-5741-4cf2-9667-29d4e88fb1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:31.668902 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0c8b8-5741-4cf2-9667-29d4e88fb1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:31.669345 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0c8b8-5741-4cf2-9667-29d4e88fb1b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:31.672495 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffcb2f-eebc-459c-b393-4b96f72bb613 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:31.672720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:31.683623 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0c8b8-5741-4cf2-9667-29d4e88fb1b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:31.685492 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0c8b8-5741-4cf2-9667-29d4e88fb1b5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:31.703924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-9be0c8b8-5741-4cf2-9667-29d4e88fb1b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:31.703924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:31.703924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:31.703924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:31.703924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:31.703924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:31.703924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:31.703924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:31.703924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:31.703924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:31.703924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:31.703924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:31.703924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:31.703924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:31.703924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:31.703924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:31.705076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:31.705076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:31.705076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:31.705076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:31.705076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:31.705076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:31.705076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:31.705076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:31.705076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:31.705076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:31.705076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:31.705076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:31.705076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:31.705076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:31.705076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:31.705076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:31.705076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:31.706072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:31.706072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:31.706072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:31.708674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 300/593] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:31.709604 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0c8b8-5741-4cf2-9667-29d4e88fb1b5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:31.715614 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2f7ce-6feb-4379-853f-6ff3d81cd059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:31.716263 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2f7ce-6feb-4379-853f-6ff3d81cd059 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:31.716547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2f7ce-6feb-4379-853f-6ff3d81cd059 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:31.716835 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2f7ce-6feb-4379-853f-6ff3d81cd059 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:31.726702 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2f7ce-6feb-4379-853f-6ff3d81cd059 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:31.728100 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2f7ce-6feb-4379-853f-6ff3d81cd059 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:31.739678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-96b2f7ce-6feb-4379-853f-6ff3d81cd059 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 13:02:31.739678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:31.739678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:31.739678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:31.739678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:31.739678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:31.739678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:31.739678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:31.739678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:31.739678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:31.739678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:31.739678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:31.739678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:31.739678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:31.739678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:31.739678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:31.740810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:31.740810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:31.740810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:31.740810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:31.740810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:31.740810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:31.740810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:31.740810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:31.740810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:31.740810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:31.740810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:31.740810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:31.740810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:31.740810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:31.740810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:31.740810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:31.740810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:31.740810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:31.741843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:31.741843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:31.741843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:31.741843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:31.741843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:31.741843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:31.741843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:31.741843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:31.741843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 13:02:31.741843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:31.746720 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 294/594] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:02:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:31.747716 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2f7ce-6feb-4379-853f-6ff3d81cd059 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:31.833622 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0c8b8-5741-4cf2-9667-29d4e88fb1b5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:31.854947 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2f7ce-6feb-4379-853f-6ff3d81cd059 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:31.873672 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff5e21-aa80-4d9a-81e2-c515d9963cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:31.874557 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff5e21-aa80-4d9a-81e2-c515d9963cbc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:31.874983 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff5e21-aa80-4d9a-81e2-c515d9963cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:31.875445 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff5e21-aa80-4d9a-81e2-c515d9963cbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:31.883673 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff5e21-aa80-4d9a-81e2-c515d9963cbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:31.885441 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff5e21-aa80-4d9a-81e2-c515d9963cbc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:31.890944 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440ba3d-08a7-4ecb-9122-637db4464f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:31.891603 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440ba3d-08a7-4ecb-9122-637db4464f7e None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:31.891882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440ba3d-08a7-4ecb-9122-637db4464f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:31.892154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440ba3d-08a7-4ecb-9122-637db4464f7e None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:31.892793 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440ba3d-08a7-4ecb-9122-637db4464f7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:31.893093 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440ba3d-08a7-4ecb-9122-637db4464f7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:31.894554 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440ba3d-08a7-4ecb-9122-637db4464f7e None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:31.896757 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:31.901937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-a1ff5e21-aa80-4d9a-81e2-c515d9963cbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:31.901937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:31.901937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:31.901937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:31.901937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:31.901937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:31.901937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:31.901937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:31.901937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:31.901937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:31.901937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:31.901937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:31.901937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:02:31.901937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:02:31.901937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:02:31.902908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:02:31.902908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:31.902908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:31.902908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:31.902908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:31.902908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:31.902908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:31.902908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:31.902908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:31.902908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:31.902908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:31.902908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:31.902908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:31.902908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:31.902908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:31.902908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:31.902908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:31.903917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:02:31.903917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:02:31.903917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:02:31.903917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:02:31.903917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:02:31.903917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:02:31.903917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:31.903917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:31.911066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 301/596] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:31.912280 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff5e21-aa80-4d9a-81e2-c515d9963cbc None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:31.913597 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 295/596] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:31.914555 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440ba3d-08a7-4ecb-9122-637db4464f7e None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:31.969105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:32.024262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440ba3d-08a7-4ecb-9122-637db4464f7e None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:32.030283 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff5e21-aa80-4d9a-81e2-c515d9963cbc None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:32.060691 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ad71d-4da5-4460-b322-cf53ecb96b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:32.061305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ad71d-4da5-4460-b322-cf53ecb96b93 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:32.061567 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ad71d-4da5-4460-b322-cf53ecb96b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:32.061982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ad71d-4da5-4460-b322-cf53ecb96b93 None admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:32.062673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ad71d-4da5-4460-b322-cf53ecb96b93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:32.062975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ad71d-4da5-4460-b322-cf53ecb96b93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:32.064425 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ad71d-4da5-4460-b322-cf53ecb96b93 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:32.069102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9074e-ac6c-4c1a-a97b-f0fa1a161502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:32.069716 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9074e-ac6c-4c1a-a97b-f0fa1a161502 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:32.069995 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9074e-ac6c-4c1a-a97b-f0fa1a161502 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:32.070268 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9074e-ac6c-4c1a-a97b-f0fa1a161502 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:32.070992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9074e-ac6c-4c1a-a97b-f0fa1a161502 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:32.071339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9074e-ac6c-4c1a-a97b-f0fa1a161502 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:32.072997 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9074e-ac6c-4c1a-a97b-f0fa1a161502 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:32.076848 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 296/597] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:02:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:32.077662 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ad71d-4da5-4460-b322-cf53ecb96b93 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:32.097516 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 302/598] 10.222.0.46 () {56 vars in 1139 bytes} [Wed Aug 10 13:02:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:32.098353 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9074e-ac6c-4c1a-a97b-f0fa1a161502 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:32.151997 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:32.201796 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ad71d-4da5-4460-b322-cf53ecb96b93 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:32.212122 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9074e-ac6c-4c1a-a97b-f0fa1a161502 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:32.220678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:32.243219 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd125e-e71c-4f9f-8f08-9933e02f61c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:32.243928 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd125e-e71c-4f9f-8f08-9933e02f61c5 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:32.244393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd125e-e71c-4f9f-8f08-9933e02f61c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:32.244832 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd125e-e71c-4f9f-8f08-9933e02f61c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:32.253011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd125e-e71c-4f9f-8f08-9933e02f61c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:32.254378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd125e-e71c-4f9f-8f08-9933e02f61c5 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:32.254729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df2312-8553-4477-b600-0562aa8871a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:32.255468 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df2312-8553-4477-b600-0562aa8871a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:32.255746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df2312-8553-4477-b600-0562aa8871a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:32.256023 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df2312-8553-4477-b600-0562aa8871a9 None admin] PATH_INFO: `/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/ad44decbbaee4d11ac076220bb9c7f40/roles/434a1fd874d24b959bf48fe61633f240` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:32.267095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-e3bd125e-e71c-4f9f-8f08-9933e02f61c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:32.267095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:32.267095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:32.267095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:32.267095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:32.267095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:32.267095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:32.267095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:32.267095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:32.267095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:32.267095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:32.267095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:32.267095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:02:32.267095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:02:32.267095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:02:32.270127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:02:32.270127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:32.270127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:32.270127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:32.270127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:32.270127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:32.270127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:32.270127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:32.270127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:32.270127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:32.270127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:32.270127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:32.270127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:32.270127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:32.270127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:32.270127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:32.270127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:32.272655 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:02:32.272655 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:02:32.272655 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:02:32.272655 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:02:32.272655 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:02:32.272655 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:02:32.272655 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:32.272655 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:32.273894 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df2312-8553-4477-b600-0562aa8871a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aa2ccddadb54dd9b88ccc6cec98ae37, user_id=ad44decbbaee4d11ac076220bb9c7f40, role_id=434a1fd874d24b959bf48fe61633f240)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:32.274057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 297/599] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:32.274227 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df2312-8553-4477-b600-0562aa8871a9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:32.274374 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd125e-e71c-4f9f-8f08-9933e02f61c5 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:32.287883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 303/600] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:02:32 2022] PUT /identity/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/ad44decbbaee4d11ac076220bb9c7f40/roles/434a1fd874d24b959bf48fe61633f240 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:02:32.289579 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c16dc5-f6a6-4fd4-b81a-8e57ee8bae41 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:32.289868 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c16dc5-f6a6-4fd4-b81a-8e57ee8bae41 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:32.290250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c16dc5-f6a6-4fd4-b81a-8e57ee8bae41 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:32.291956 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 304/601] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:32.296884 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c16dc5-f6a6-4fd4-b81a-8e57ee8bae41 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:32.438773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd125e-e71c-4f9f-8f08-9933e02f61c5 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:32.455704 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c16dc5-f6a6-4fd4-b81a-8e57ee8bae41 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:32.463043 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:32.488274 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c7f3c-e5fe-4a58-b7b5-758530ab5487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:32.488911 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c7f3c-e5fe-4a58-b7b5-758530ab5487 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:32.489188 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c7f3c-e5fe-4a58-b7b5-758530ab5487 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:32.489510 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c7f3c-e5fe-4a58-b7b5-758530ab5487 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:32.500956 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c7f3c-e5fe-4a58-b7b5-758530ab5487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:32.502432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c7f3c-e5fe-4a58-b7b5-758530ab5487 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:32.510199 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b766f1-ad29-46ce-98f4-532b4c8ff15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:32.511457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b766f1-ad29-46ce-98f4-532b4c8ff15f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:32.511457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b766f1-ad29-46ce-98f4-532b4c8ff15f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:32.511457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b766f1-ad29-46ce-98f4-532b4c8ff15f None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:32.512106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b766f1-ad29-46ce-98f4-532b4c8ff15f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:32.512407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b766f1-ad29-46ce-98f4-532b4c8ff15f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:32.513906 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b766f1-ad29-46ce-98f4-532b4c8ff15f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:32.523426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-7c8c7f3c-e5fe-4a58-b7b5-758530ab5487 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:32.523426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:32.523426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:32.523426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:32.523426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:32.523426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:32.523426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:32.523426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:32.523426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:32.523426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:32.523426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:32.523426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:32.523426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:32.523426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:32.523426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:32.523426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:32.524829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:32.524829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:32.524829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:32.524829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:32.524829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:32.524829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:32.524829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:32.524829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:32.524829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:32.524829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:32.524829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:32.524829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:32.524829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:32.524829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:32.524829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:32.524829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:32.524829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:32.526018 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:32.526018 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:32.526018 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:32.528561 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 298/602] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:32.533770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf425a-f5f1-4c74-bffa-2383b9266d7e None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:32.533770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf425a-f5f1-4c74-bffa-2383b9266d7e None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:32.533770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf425a-f5f1-4c74-bffa-2383b9266d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:32.535959 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 305/603] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:02:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:32.537481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b766f1-ad29-46ce-98f4-532b4c8ff15f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:32.551623 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-9adf425a-f5f1-4c74-bffa-2383b9266d7e None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:32.553117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-9adf425a-f5f1-4c74-bffa-2383b9266d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:32.562681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:32.631166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 299/604] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:32.632157 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf425a-f5f1-4c74-bffa-2383b9266d7e None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:32.655458 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b766f1-ad29-46ce-98f4-532b4c8ff15f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:32.692145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b27cf-795c-49d5-bc68-823d13646d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:32.692936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b27cf-795c-49d5-bc68-823d13646d98 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:32.693220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b27cf-795c-49d5-bc68-823d13646d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:32.693486 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b27cf-795c-49d5-bc68-823d13646d98 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:32.694222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b27cf-795c-49d5-bc68-823d13646d98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:32.694524 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b27cf-795c-49d5-bc68-823d13646d98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:32.696090 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b27cf-795c-49d5-bc68-823d13646d98 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:32.709811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 306/605] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:32.710776 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b27cf-795c-49d5-bc68-823d13646d98 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:32.741093 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:32.748027 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf425a-f5f1-4c74-bffa-2383b9266d7e None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:32.784114 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626f188-8212-4af8-88f1-839001989ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:32.785027 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626f188-8212-4af8-88f1-839001989ea8 None admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:32.785306 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626f188-8212-4af8-88f1-839001989ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:32.785576 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626f188-8212-4af8-88f1-839001989ea8 None admin] PATH_INFO: `/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/5979be13ad31421b886069faf0dcc915/roles/434a1fd874d24b959bf48fe61633f240` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:32.795133 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:32.802576 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626f188-8212-4af8-88f1-839001989ea8 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aa2ccddadb54dd9b88ccc6cec98ae37, user_id=5979be13ad31421b886069faf0dcc915, role_id=434a1fd874d24b959bf48fe61633f240)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:32.804252 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626f188-8212-4af8-88f1-839001989ea8 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:32.819605 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b27cf-795c-49d5-bc68-823d13646d98 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:32.827140 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 300/606] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:02:32 2022] PUT /identity/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/5979be13ad31421b886069faf0dcc915/roles/434a1fd874d24b959bf48fe61633f240 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:02:32.828173 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626f188-8212-4af8-88f1-839001989ea8 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:32.871932 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc230dd-91da-434e-a425-83073aa26996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:32.872650 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc230dd-91da-434e-a425-83073aa26996 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:32.872927 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc230dd-91da-434e-a425-83073aa26996 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:32.873823 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc230dd-91da-434e-a425-83073aa26996 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:32.892531 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc230dd-91da-434e-a425-83073aa26996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:32.900176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-fdc230dd-91da-434e-a425-83073aa26996 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:32.900176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:32.900176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:32.900176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:32.900176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:32.900176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:32.900176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:32.900176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:32.900176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:32.900176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:32.900176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:32.900176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:32.900176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:32.900176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:32.900176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:32.900176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:32.901205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:32.901205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:32.901205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:32.901205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:32.901205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:32.901205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:32.901205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:32.901205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:32.901205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:32.901205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:32.901205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:32.901205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:32.901205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:32.901205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:32.901205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:32.901205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:32.902075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:32.902075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:32.902075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:32.902075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:32.902075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:32.902075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:32.902075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:32.902075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:32.902075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:32.902075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:32.902075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:32.902075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:32.906828 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 307/607] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:02:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:32.908343 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72cbe0-8ac5-4cf8-adae-51d0dd515b1a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:32.908628 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72cbe0-8ac5-4cf8-adae-51d0dd515b1a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:32.908909 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72cbe0-8ac5-4cf8-adae-51d0dd515b1a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:32.915240 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 308/608] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:32.915240 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72cbe0-8ac5-4cf8-adae-51d0dd515b1a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:32.975978 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626f188-8212-4af8-88f1-839001989ea8 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:33.024377 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089579c-c9da-4557-adfc-90800e6be1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:33.025344 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089579c-c9da-4557-adfc-90800e6be1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:33.025950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089579c-c9da-4557-adfc-90800e6be1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:33.026224 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089579c-c9da-4557-adfc-90800e6be1d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:33.037641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089579c-c9da-4557-adfc-90800e6be1d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:33.039153 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089579c-c9da-4557-adfc-90800e6be1d6 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:33.051635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-7089579c-c9da-4557-adfc-90800e6be1d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:33.051635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:33.051635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:33.051635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:33.051635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:33.051635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:33.051635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:33.051635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:33.051635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:33.051635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:33.051635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:33.051635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:33.051635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:02:33.051635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:02:33.051635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:02:33.052684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:02:33.052684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:33.052684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:33.052684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:33.052684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:33.052684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:33.052684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:33.052684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:33.052684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:33.052684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:33.052684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:33.052684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:33.052684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:33.052684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:33.052684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:33.052684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:33.052684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:33.053677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:02:33.053677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:02:33.053677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:02:33.053677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:02:33.053677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:02:33.053677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:02:33.053677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:33.053677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:33.053677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 301/609] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:33.054636 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d3197-8279-4c06-8d90-e52c414dad40 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:33.054636 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d3197-8279-4c06-8d90-e52c414dad40 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:33.054871 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d3197-8279-4c06-8d90-e52c414dad40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:33.060355 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72cbe0-8ac5-4cf8-adae-51d0dd515b1a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:33.069611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:33.075914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-e25d3197-8279-4c06-8d90-e52c414dad40 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:33.076994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-e25d3197-8279-4c06-8d90-e52c414dad40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:33.110390 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e773e-318f-495f-88d4-7c3781893414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:33.111683 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e773e-318f-495f-88d4-7c3781893414 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:33.112261 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e773e-318f-495f-88d4-7c3781893414 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:33.112794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e773e-318f-495f-88d4-7c3781893414 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:33.113610 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e773e-318f-495f-88d4-7c3781893414 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:33.114050 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e773e-318f-495f-88d4-7c3781893414 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:33.115616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e773e-318f-495f-88d4-7c3781893414 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:33.119393 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:33.127741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 309/610] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 10 13:02:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:33.128837 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e773e-318f-495f-88d4-7c3781893414 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:33.166379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 302/611] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:33.167711 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d3197-8279-4c06-8d90-e52c414dad40 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:33.250720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e773e-318f-495f-88d4-7c3781893414 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:33.284247 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d3197-8279-4c06-8d90-e52c414dad40 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:33.296401 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad42f2-4a35-4828-ab1f-4c62041b5a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:33.296943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad42f2-4a35-4828-ab1f-4c62041b5a56 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:33.297224 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad42f2-4a35-4828-ab1f-4c62041b5a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:33.297760 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad42f2-4a35-4828-ab1f-4c62041b5a56 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:33.298467 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad42f2-4a35-4828-ab1f-4c62041b5a56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:33.298771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad42f2-4a35-4828-ab1f-4c62041b5a56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:33.300537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad42f2-4a35-4828-ab1f-4c62041b5a56 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:33.316144 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 310/612] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:02:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:33.316796 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad42f2-4a35-4828-ab1f-4c62041b5a56 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:33.323973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6128ef-3949-4386-a22b-969d5f96137a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:33.325005 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6128ef-3949-4386-a22b-969d5f96137a None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:33.325491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6128ef-3949-4386-a22b-969d5f96137a None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:33.325986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6128ef-3949-4386-a22b-969d5f96137a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:33.329207 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:33.339116 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6128ef-3949-4386-a22b-969d5f96137a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:33.340837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6128ef-3949-4386-a22b-969d5f96137a None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:33.357479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-4e6128ef-3949-4386-a22b-969d5f96137a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:33.357479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:33.357479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:33.357479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:33.357479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:33.357479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:33.357479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:33.357479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:33.357479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:33.357479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:33.357479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:33.357479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:33.357479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:33.357479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:33.357479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:33.357479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:33.358469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:33.358469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:33.358469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:33.358469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:33.358469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:33.358469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:33.358469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:33.358469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:33.358469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:33.358469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:33.358469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:33.358469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:33.358469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:33.358469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:33.358469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:33.358469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:33.358469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:33.359409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:33.359409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:33.359409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:33.362122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 303/613] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:33.363315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6128ef-3949-4386-a22b-969d5f96137a None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:33.378322 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:33.423033 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad42f2-4a35-4828-ab1f-4c62041b5a56 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:33.459314 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe61b74-3d3f-474b-b078-f4920d38e011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:33.459942 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe61b74-3d3f-474b-b078-f4920d38e011 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:33.460217 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe61b74-3d3f-474b-b078-f4920d38e011 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:33.460485 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe61b74-3d3f-474b-b078-f4920d38e011 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:33.471579 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6128ef-3949-4386-a22b-969d5f96137a None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:33.471848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe61b74-3d3f-474b-b078-f4920d38e011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:33.477291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-7fe61b74-3d3f-474b-b078-f4920d38e011 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:33.477291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:33.477291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:33.477291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:33.477291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:33.477291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:33.477291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:33.477291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:33.477291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:33.477291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:33.477291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:33.477291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:33.477291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:33.477291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:33.477291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:33.477291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:33.478308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:33.478308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:33.478308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:33.478308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:33.478308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:33.478308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:33.478308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:33.478308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:33.478308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:33.478308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:33.478308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:33.478308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:33.478308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:33.478308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:33.478308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:33.478308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:33.479329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:33.479329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:33.479329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:33.479329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:33.479329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:33.479329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:33.479329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:33.479329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:33.479329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:33.479329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:33.479329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:33.479329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:33.479329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 311/614] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:02:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:33.480090 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe61b74-3d3f-474b-b078-f4920d38e011 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:33.513696 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7fcb2-3aab-42be-ad1a-49a17ae07cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:33.514900 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7fcb2-3aab-42be-ad1a-49a17ae07cc9 None admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:33.515450 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7fcb2-3aab-42be-ad1a-49a17ae07cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:33.515867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7fcb2-3aab-42be-ad1a-49a17ae07cc9 None admin] PATH_INFO: `/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/49b69dad00934ce78cbede99f976439f/roles/434a1fd874d24b959bf48fe61633f240` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:33.539805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7fcb2-3aab-42be-ad1a-49a17ae07cc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aa2ccddadb54dd9b88ccc6cec98ae37, user_id=49b69dad00934ce78cbede99f976439f, role_id=434a1fd874d24b959bf48fe61633f240)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:33.542471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7fcb2-3aab-42be-ad1a-49a17ae07cc9 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:33.561412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 304/615] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:02:33 2022] PUT /identity/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/49b69dad00934ce78cbede99f976439f/roles/434a1fd874d24b959bf48fe61633f240 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:02:33.562627 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7fcb2-3aab-42be-ad1a-49a17ae07cc9 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:33.598406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe61b74-3d3f-474b-b078-f4920d38e011 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:33.639395 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:33.646945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:33.668950 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5f706-f814-4686-9594-0393f271a4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:33.670022 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5f706-f814-4686-9594-0393f271a4af None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:33.670524 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5f706-f814-4686-9594-0393f271a4af None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:33.671030 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5f706-f814-4686-9594-0393f271a4af None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:33.672074 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5f706-f814-4686-9594-0393f271a4af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:33.672590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5f706-f814-4686-9594-0393f271a4af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:33.674277 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5f706-f814-4686-9594-0393f271a4af None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:33.688224 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 312/616] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:33.700072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5f706-f814-4686-9594-0393f271a4af None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:33.739663 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7fcb2-3aab-42be-ad1a-49a17ae07cc9 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:33.788547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee87ceb-e518-4a10-b872-ea1d1736ea6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:33.789191 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee87ceb-e518-4a10-b872-ea1d1736ea6c None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:33.789735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee87ceb-e518-4a10-b872-ea1d1736ea6c None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:33.790016 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee87ceb-e518-4a10-b872-ea1d1736ea6c None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:33.790680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee87ceb-e518-4a10-b872-ea1d1736ea6c None admin] RBAC: Adding query filter params (name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:33.790976 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee87ceb-e518-4a10-b872-ea1d1736ea6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:33.792649 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee87ceb-e518-4a10-b872-ea1d1736ea6c None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:33.804583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 305/617] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 10 13:02:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:33.811026 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee87ceb-e518-4a10-b872-ea1d1736ea6c None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:33.863899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5f706-f814-4686-9594-0393f271a4af None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:33.908783 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c0187-0883-4e5d-851d-777d3650fab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:33.909413 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c0187-0883-4e5d-851d-777d3650fab5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:33.909696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c0187-0883-4e5d-851d-777d3650fab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:33.909962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c0187-0883-4e5d-851d-777d3650fab5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:33.926064 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c0187-0883-4e5d-851d-777d3650fab5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:33.929428 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c0187-0883-4e5d-851d-777d3650fab5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:33.943149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-762c0187-0883-4e5d-851d-777d3650fab5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 13:02:33.943149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:33.943149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:33.943149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:33.943149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:33.943149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:33.943149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:33.943149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:33.943149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:33.943149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:33.943149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:33.943149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:33.943149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:33.943149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:33.943149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:33.943149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:33.944129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:33.944129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:33.944129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:33.944129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:33.944129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:33.944129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:33.944129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:33.944129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:33.944129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:33.944129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:33.944129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:33.944129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:33.944129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:33.944129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:33.944129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:33.944129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:33.944129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:33.944129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:33.945083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:33.945083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:33.945083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:33.945083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:33.945083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:33.945083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:33.945083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:33.945083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:33.945083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 13:02:33.945083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:33.945083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 313/618] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:02:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:33.955027 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c0187-0883-4e5d-851d-777d3650fab5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:33.975498 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:33.981471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee87ceb-e518-4a10-b872-ea1d1736ea6c None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:34.021403 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:34.048312 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008b629-4856-4a98-ac04-45cf9c00eb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:34.049314 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008b629-4856-4a98-ac04-45cf9c00eb4d None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:34.049592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008b629-4856-4a98-ac04-45cf9c00eb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:34.050008 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008b629-4856-4a98-ac04-45cf9c00eb4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:34.073649 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a008b629-4856-4a98-ac04-45cf9c00eb4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:34.075965 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a008b629-4856-4a98-ac04-45cf9c00eb4d None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:34.097806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-a008b629-4856-4a98-ac04-45cf9c00eb4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:34.097806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:34.097806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:34.097806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:34.097806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:34.097806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:34.097806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:34.097806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:34.097806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:34.097806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:34.097806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:34.097806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:34.097806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:34.097806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:34.097806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:34.097806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:34.099424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:34.099424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:34.099424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:34.099424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:34.099424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:34.099424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:34.099424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:34.099424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:34.099424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:34.099424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:34.099424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:34.099424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:34.099424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:34.099424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:34.099424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:34.099424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:34.099424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:34.100500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:34.100500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:34.100500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:34.104984 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 306/619] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:02:34.112590 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008b629-4856-4a98-ac04-45cf9c00eb4d None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:34.134087 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c0187-0883-4e5d-851d-777d3650fab5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:34.188774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30858ba-f8b2-4589-8d2b-68f48b612035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:34.189680 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30858ba-f8b2-4589-8d2b-68f48b612035 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:34.190100 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30858ba-f8b2-4589-8d2b-68f48b612035 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:34.190512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30858ba-f8b2-4589-8d2b-68f48b612035 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:34.191553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30858ba-f8b2-4589-8d2b-68f48b612035 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:34.194317 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30858ba-f8b2-4589-8d2b-68f48b612035 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:34.196128 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30858ba-f8b2-4589-8d2b-68f48b612035 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:34.226812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 314/620] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Aug 10 13:02:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:02:34.232337 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30858ba-f8b2-4589-8d2b-68f48b612035 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:34.281074 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008b629-4856-4a98-ac04-45cf9c00eb4d None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:34.320889 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d78d71-57cc-4c06-b7c9-f541b0ca76a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:34.321654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d78d71-57cc-4c06-b7c9-f541b0ca76a1 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:34.322043 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d78d71-57cc-4c06-b7c9-f541b0ca76a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:34.326070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d78d71-57cc-4c06-b7c9-f541b0ca76a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:34.326070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d78d71-57cc-4c06-b7c9-f541b0ca76a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:34.326070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d78d71-57cc-4c06-b7c9-f541b0ca76a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:34.326070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d78d71-57cc-4c06-b7c9-f541b0ca76a1 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:34.339861 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 307/621] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:34.348063 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d78d71-57cc-4c06-b7c9-f541b0ca76a1 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:34.384717 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:34.414407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:34.422759 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30858ba-f8b2-4589-8d2b-68f48b612035 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:34.487564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff3d5a-7bad-4ab3-8f17-84beaeedac52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:34.488198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff3d5a-7bad-4ab3-8f17-84beaeedac52 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:34.488473 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff3d5a-7bad-4ab3-8f17-84beaeedac52 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:34.488738 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff3d5a-7bad-4ab3-8f17-84beaeedac52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:34.508185 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff3d5a-7bad-4ab3-8f17-84beaeedac52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:34.509633 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff3d5a-7bad-4ab3-8f17-84beaeedac52 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:34.525830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-05ff3d5a-7bad-4ab3-8f17-84beaeedac52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:34.525830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:34.525830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:34.525830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:34.525830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:34.525830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:34.525830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:34.525830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:34.525830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:34.525830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:34.525830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:34.525830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:34.525830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:34.525830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:34.525830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:34.525830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:34.526846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:34.526846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:34.526846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:34.526846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:34.526846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:34.526846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:34.526846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:34.526846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:34.526846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:34.526846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:34.526846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:34.526846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:34.526846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:34.526846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:34.526846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:34.526846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:34.526846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:34.527799 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:34.527799 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:34.527799 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:34.527799 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 315/622] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:34.536000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff3d5a-7bad-4ab3-8f17-84beaeedac52 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:34.557474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d78d71-57cc-4c06-b7c9-f541b0ca76a1 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:34.607343 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a16f5c-f150-4fdd-90a4-113b9ddcd934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:34.608224 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a16f5c-f150-4fdd-90a4-113b9ddcd934 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:34.608745 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a16f5c-f150-4fdd-90a4-113b9ddcd934 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:34.609145 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a16f5c-f150-4fdd-90a4-113b9ddcd934 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:34.618185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a16f5c-f150-4fdd-90a4-113b9ddcd934 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:34.620016 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a16f5c-f150-4fdd-90a4-113b9ddcd934 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:34.632676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-45a16f5c-f150-4fdd-90a4-113b9ddcd934 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 13:02:34.632676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:34.632676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:34.632676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:34.632676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:34.632676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:34.632676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:34.632676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:34.632676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:34.632676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:34.632676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:34.632676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:34.632676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:34.632676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:34.632676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:34.632676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:34.633694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:34.633694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:34.633694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:34.633694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:34.633694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:34.633694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:34.633694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:34.633694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:34.633694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:34.633694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:34.633694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:34.633694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:34.633694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:34.633694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:34.633694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:34.633694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:34.633694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:34.633694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:34.634666 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:34.634666 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:34.634666 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:34.634666 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:34.634666 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:34.634666 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:34.634666 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:34.634666 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:34.634666 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 13:02:34.634666 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:34.638453 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 308/623] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Aug 10 13:02:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:34.639738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d54bd-42b8-454b-a981-e3a74fb9bf18 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:34.640015 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d54bd-42b8-454b-a981-e3a74fb9bf18 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:34.640283 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d54bd-42b8-454b-a981-e3a74fb9bf18 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:34.645928 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 309/624] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:34.646817 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d54bd-42b8-454b-a981-e3a74fb9bf18 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:34.654445 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff3d5a-7bad-4ab3-8f17-84beaeedac52 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:34.695845 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb6e7a-3bd2-4c48-b909-1ccf4be80772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:34.696562 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb6e7a-3bd2-4c48-b909-1ccf4be80772 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:34.696883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb6e7a-3bd2-4c48-b909-1ccf4be80772 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:34.697154 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb6e7a-3bd2-4c48-b909-1ccf4be80772 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:34.697842 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb6e7a-3bd2-4c48-b909-1ccf4be80772 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:34.698145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb6e7a-3bd2-4c48-b909-1ccf4be80772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:34.699801 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb6e7a-3bd2-4c48-b909-1ccf4be80772 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:34.713690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 316/625] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:34.719762 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49689c51-da4f-42a5-92db-e94b6f4b020d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:34.720129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49689c51-da4f-42a5-92db-e94b6f4b020d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:34.720414 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:34.721665 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49689c51-da4f-42a5-92db-e94b6f4b020d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:34.743826 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-49689c51-da4f-42a5-92db-e94b6f4b020d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:34.745390 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-49689c51-da4f-42a5-92db-e94b6f4b020d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:34.747854 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:34.754020 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d54bd-42b8-454b-a981-e3a74fb9bf18 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:34.789153 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c2522-b1c4-4f37-b7fe-68120d4152d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:34.789153 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c2522-b1c4-4f37-b7fe-68120d4152d1 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:34.789447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c2522-b1c4-4f37-b7fe-68120d4152d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:34.789681 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c2522-b1c4-4f37-b7fe-68120d4152d1 None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:34.790390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c2522-b1c4-4f37-b7fe-68120d4152d1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:34.790688 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c2522-b1c4-4f37-b7fe-68120d4152d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:34.792245 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c2522-b1c4-4f37-b7fe-68120d4152d1 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:34.814761 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 310/626] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Aug 10 13:02:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:34.815756 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c2522-b1c4-4f37-b7fe-68120d4152d1 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:34.828033 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 317/627] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:34.829188 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49689c51-da4f-42a5-92db-e94b6f4b020d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:34.940033 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49689c51-da4f-42a5-92db-e94b6f4b020d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:34.941292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c2522-b1c4-4f37-b7fe-68120d4152d1 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:34.971287 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:34.978666 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da229095-d3d0-4210-a3e7-ba1c57a446e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:34.979429 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da229095-d3d0-4210-a3e7-ba1c57a446e7 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:34.979707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da229095-d3d0-4210-a3e7-ba1c57a446e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:34.980049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da229095-d3d0-4210-a3e7-ba1c57a446e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:34.985082 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139a688-16f1-4d77-91c0-6b0de2e18cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:34.985993 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139a688-16f1-4d77-91c0-6b0de2e18cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:34.986649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139a688-16f1-4d77-91c0-6b0de2e18cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:34.987096 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139a688-16f1-4d77-91c0-6b0de2e18cd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:34.990983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da229095-d3d0-4210-a3e7-ba1c57a446e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:34.994385 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da229095-d3d0-4210-a3e7-ba1c57a446e7 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:35.000824 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:35.009092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-da229095-d3d0-4210-a3e7-ba1c57a446e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:35.009092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:35.009092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:35.009092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:35.009092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:35.009092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:35.009092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:35.009092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:35.009092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:35.009092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:35.009092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:35.009092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:35.009092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:02:35.009092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:02:35.009092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:02:35.010282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:02:35.010282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:35.010282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:35.010282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:35.010282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:35.010282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:35.010282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:35.010282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:35.010282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:35.010282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:35.010282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:35.010282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:35.010282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:35.010282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:35.010282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:35.010282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:35.010282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:35.011317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:02:35.011317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:02:35.011317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:02:35.011317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:02:35.011317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:02:35.011317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:02:35.011317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:35.011317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:35.014891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 311/628] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:35.015787 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da229095-d3d0-4210-a3e7-ba1c57a446e7 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:35.070255 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139a688-16f1-4d77-91c0-6b0de2e18cd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:35.072014 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139a688-16f1-4d77-91c0-6b0de2e18cd2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:35.119390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da229095-d3d0-4210-a3e7-ba1c57a446e7 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:35.154009 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fb0d8-1ae2-46f1-91bc-f7191c4a0247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:35.154551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fb0d8-1ae2-46f1-91bc-f7191c4a0247 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:35.154832 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fb0d8-1ae2-46f1-91bc-f7191c4a0247 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:35.155142 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fb0d8-1ae2-46f1-91bc-f7191c4a0247 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:35.166154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fb0d8-1ae2-46f1-91bc-f7191c4a0247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:35.170790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-3c0fb0d8-1ae2-46f1-91bc-f7191c4a0247 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:35.170790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:35.170790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:35.170790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:35.170790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:35.170790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:35.170790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:35.170790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:35.170790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:35.170790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:35.170790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:35.170790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:35.170790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:35.170790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:35.170790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:35.170790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:35.171784 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:35.171784 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:35.171784 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:35.171784 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:35.171784 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:35.171784 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:35.171784 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:35.171784 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:35.171784 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:35.171784 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:35.171784 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:35.171784 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:35.171784 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:35.171784 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:35.171784 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:35.171784 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:35.172610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:35.172610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:35.172610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:35.172610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:35.172610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:35.172610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:35.172610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:35.172610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:35.172610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:35.172610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:35.172610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:35.172610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:35.172610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 312/629] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:02:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:35.173310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fb0d8-1ae2-46f1-91bc-f7191c4a0247 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:35.188576 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 318/630] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:35.188576 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f278d60-b593-4a67-95fe-6a4f71cc21d3 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:35.188576 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f278d60-b593-4a67-95fe-6a4f71cc21d3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:35.188576 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f278d60-b593-4a67-95fe-6a4f71cc21d3 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:35.191374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 319/631] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:35.192174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f278d60-b593-4a67-95fe-6a4f71cc21d3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:35.231861 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:35.237669 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:35.287031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fb0d8-1ae2-46f1-91bc-f7191c4a0247 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:35.309086 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f278d60-b593-4a67-95fe-6a4f71cc21d3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:35.325533 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae03fa-6ca3-4cb9-9020-d2efaacf9987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:35.326132 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae03fa-6ca3-4cb9-9020-d2efaacf9987 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:35.326404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae03fa-6ca3-4cb9-9020-d2efaacf9987 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:35.326677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae03fa-6ca3-4cb9-9020-d2efaacf9987 None admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:35.327389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae03fa-6ca3-4cb9-9020-d2efaacf9987 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:35.327686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae03fa-6ca3-4cb9-9020-d2efaacf9987 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:35.329092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae03fa-6ca3-4cb9-9020-d2efaacf9987 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:35.340584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 313/632] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:02:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:35.341379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae03fa-6ca3-4cb9-9020-d2efaacf9987 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:35.352090 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89873f-f923-43ba-a7aa-0d0b091d14d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:35.353098 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89873f-f923-43ba-a7aa-0d0b091d14d7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:35.353389 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89873f-f923-43ba-a7aa-0d0b091d14d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:35.353657 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89873f-f923-43ba-a7aa-0d0b091d14d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:35.354330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89873f-f923-43ba-a7aa-0d0b091d14d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:35.354629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89873f-f923-43ba-a7aa-0d0b091d14d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:35.356063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89873f-f923-43ba-a7aa-0d0b091d14d7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:35.365486 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 320/633] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 10 13:02:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:35.372154 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3094b-952b-4ca6-9207-c9f8ae93f8fe None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:35.372437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3094b-952b-4ca6-9207-c9f8ae93f8fe None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:35.372711 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3094b-952b-4ca6-9207-c9f8ae93f8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:35.394395 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d0e3094b-952b-4ca6-9207-c9f8ae93f8fe None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:35.395663 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d0e3094b-952b-4ca6-9207-c9f8ae93f8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:35.457513 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae03fa-6ca3-4cb9-9020-d2efaacf9987 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:35.469382 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 321/634] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:35.471454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3094b-952b-4ca6-9207-c9f8ae93f8fe None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:35.480352 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:35.494702 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61a35c-807e-4776-80bb-19c8fd7848c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:35.495475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61a35c-807e-4776-80bb-19c8fd7848c0 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:35.495806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61a35c-807e-4776-80bb-19c8fd7848c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:35.496083 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61a35c-807e-4776-80bb-19c8fd7848c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:35.508666 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61a35c-807e-4776-80bb-19c8fd7848c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:35.511249 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61a35c-807e-4776-80bb-19c8fd7848c0 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:35.511977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:35.533025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-cc61a35c-807e-4776-80bb-19c8fd7848c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:35.533025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:35.533025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:35.533025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:35.533025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:35.533025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:35.533025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:35.533025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:35.533025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:35.533025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:35.533025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:35.533025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:35.533025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:35.533025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:35.533025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:35.533025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:35.534024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:35.534024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:35.534024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:35.534024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:35.534024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:35.534024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:35.534024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:35.534024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:35.534024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:35.534024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:35.534024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:35.534024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:35.534024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:35.534024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:35.534024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:35.534024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:35.534024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:35.534915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:35.534915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:35.534915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:35.540904 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 314/635] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:35.540904 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61a35c-807e-4776-80bb-19c8fd7848c0 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:35.588284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3094b-952b-4ca6-9207-c9f8ae93f8fe None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:35.626227 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3031b7-5ca8-44bd-92a5-c018dde90e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:35.626897 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3031b7-5ca8-44bd-92a5-c018dde90e05 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:35.627203 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3031b7-5ca8-44bd-92a5-c018dde90e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:35.627855 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3031b7-5ca8-44bd-92a5-c018dde90e05 None admin] PATH_INFO: `/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/5c86ef66c9564e0395c325a84ca9c4a5/roles/434a1fd874d24b959bf48fe61633f240` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:35.643351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3031b7-5ca8-44bd-92a5-c018dde90e05 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aa2ccddadb54dd9b88ccc6cec98ae37, user_id=5c86ef66c9564e0395c325a84ca9c4a5, role_id=434a1fd874d24b959bf48fe61633f240)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:35.644813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3031b7-5ca8-44bd-92a5-c018dde90e05 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:35.652476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61a35c-807e-4776-80bb-19c8fd7848c0 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:35.660545 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 322/636] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:02:35 2022] PUT /identity/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/5c86ef66c9564e0395c325a84ca9c4a5/roles/434a1fd874d24b959bf48fe61633f240 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:02:35.661673 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3031b7-5ca8-44bd-92a5-c018dde90e05 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:35.712209 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72deec-224c-4a8b-9958-63bfc816228d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:35.712869 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72deec-224c-4a8b-9958-63bfc816228d None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:35.713208 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72deec-224c-4a8b-9958-63bfc816228d None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:35.713483 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72deec-224c-4a8b-9958-63bfc816228d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:35.727066 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72deec-224c-4a8b-9958-63bfc816228d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:35.728615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72deec-224c-4a8b-9958-63bfc816228d None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:35.745049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-2b72deec-224c-4a8b-9958-63bfc816228d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:35.745049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:35.745049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:35.745049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:35.745049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:35.745049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:35.745049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:35.745049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:35.745049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:35.745049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:35.745049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:35.745049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:35.745049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:35.745049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:35.745049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:35.745049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:35.746105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:35.746105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:35.746105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:35.746105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:35.746105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:35.746105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:35.746105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:35.746105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:35.746105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:35.746105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:35.746105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:35.746105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:35.746105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:35.746105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:35.746105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:35.746105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:35.746105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:35.747054 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:35.747054 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:35.747054 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:35.751300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 315/637] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:35.752286 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72deec-224c-4a8b-9958-63bfc816228d None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:35.771256 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:35.778671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:35.809107 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3031b7-5ca8-44bd-92a5-c018dde90e05 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:35.860084 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec6973-295c-4af0-a0f8-2656b6fd618b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:35.860724 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec6973-295c-4af0-a0f8-2656b6fd618b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:35.861011 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec6973-295c-4af0-a0f8-2656b6fd618b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:35.861848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec6973-295c-4af0-a0f8-2656b6fd618b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:35.873877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec6973-295c-4af0-a0f8-2656b6fd618b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:35.879196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-fbec6973-295c-4af0-a0f8-2656b6fd618b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:35.879196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:35.879196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:35.879196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:35.879196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:35.879196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:35.879196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:35.879196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:35.879196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:35.879196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:35.879196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:35.879196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:35.879196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:35.879196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:35.879196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:35.879196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:35.880774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:35.880774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:35.880774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:35.880774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:35.880774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:35.880774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:35.880774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:35.880774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:35.880774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:35.880774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:35.880774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:35.880774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:35.880774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:35.880774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:35.880774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:35.880774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:35.881616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:35.881616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:35.881616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:35.881616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:35.881616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:35.881616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:35.881616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:35.881616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:35.881616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:35.881616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:35.881616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:35.881616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:35.882265 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72deec-224c-4a8b-9958-63bfc816228d None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:35.884453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 323/638] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:02:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:35.885473 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec6973-295c-4af0-a0f8-2656b6fd618b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:35.920719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be2f08-5f04-4aa5-be59-58dcca2d33b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:35.921804 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be2f08-5f04-4aa5-be59-58dcca2d33b7 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:35.922435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be2f08-5f04-4aa5-be59-58dcca2d33b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:35.922767 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be2f08-5f04-4aa5-be59-58dcca2d33b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:35.923578 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be2f08-5f04-4aa5-be59-58dcca2d33b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:35.923886 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be2f08-5f04-4aa5-be59-58dcca2d33b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:35.927316 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be2f08-5f04-4aa5-be59-58dcca2d33b7 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:35.946762 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 316/639] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:35.947641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be2f08-5f04-4aa5-be59-58dcca2d33b7 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:36.005374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec6973-295c-4af0-a0f8-2656b6fd618b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:36.032827 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:36.042065 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05d727-bc90-44a9-94f4-981101a09371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:36.042672 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05d727-bc90-44a9-94f4-981101a09371 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:36.042950 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05d727-bc90-44a9-94f4-981101a09371 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:36.043260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05d727-bc90-44a9-94f4-981101a09371 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:36.044108 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05d727-bc90-44a9-94f4-981101a09371 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:36.044639 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05d727-bc90-44a9-94f4-981101a09371 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:36.047290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05d727-bc90-44a9-94f4-981101a09371 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:36.059253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:36.062165 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be2f08-5f04-4aa5-be59-58dcca2d33b7 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:36.069437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 324/640] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:36.070804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ea754-f65c-4523-b74a-155af09fc035 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:36.071233 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ea754-f65c-4523-b74a-155af09fc035 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:36.071668 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ea754-f65c-4523-b74a-155af09fc035 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:36.072972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 325/641] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:36.073663 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ea754-f65c-4523-b74a-155af09fc035 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:36.105417 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b07d78-7868-491f-b02c-c5c6e03c3a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:36.106126 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b07d78-7868-491f-b02c-c5c6e03c3a4a None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:36.106396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b07d78-7868-491f-b02c-c5c6e03c3a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:36.106665 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b07d78-7868-491f-b02c-c5c6e03c3a4a None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:36.107407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b07d78-7868-491f-b02c-c5c6e03c3a4a None admin] RBAC: Adding query filter params (name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:36.107705 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b07d78-7868-491f-b02c-c5c6e03c3a4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:36.109055 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b07d78-7868-491f-b02c-c5c6e03c3a4a None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:36.121672 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 317/642] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 10 13:02:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:36.121672 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b07d78-7868-491f-b02c-c5c6e03c3a4a None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:36.194493 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ea754-f65c-4523-b74a-155af09fc035 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:36.224316 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b07d78-7868-491f-b02c-c5c6e03c3a4a None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:36.230732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb7089-75f4-4e81-b4b5-cf5413ba5b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:36.231510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb7089-75f4-4e81-b4b5-cf5413ba5b6b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:36.231785 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb7089-75f4-4e81-b4b5-cf5413ba5b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:36.232061 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb7089-75f4-4e81-b4b5-cf5413ba5b6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:36.240099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb7089-75f4-4e81-b4b5-cf5413ba5b6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:36.242238 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb7089-75f4-4e81-b4b5-cf5413ba5b6b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:36.257523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5fcb7089-75f4-4e81-b4b5-cf5413ba5b6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:36.257523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:36.257523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:36.257523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:36.257523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:36.257523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:36.257523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:36.257523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:36.257523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:36.257523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:36.257523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:36.257523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:36.257523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:02:36.257523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:02:36.257523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:02:36.259384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:02:36.259384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:36.259384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:36.259384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:36.259384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:36.259384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:36.259384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:36.259384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:36.259384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:36.259384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:36.259384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:36.259384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:36.259384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:36.259384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:36.259384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:36.259384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:36.259384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:36.261212 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:02:36.261212 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:02:36.261212 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:02:36.261212 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:02:36.261212 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:02:36.261212 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:02:36.261212 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:36.261212 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:36.261212 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 326/643] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:36.262184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2eb88f-2d97-4f8b-8259-5bb4776f6ca5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:36.262184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2eb88f-2d97-4f8b-8259-5bb4776f6ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:36.262184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2eb88f-2d97-4f8b-8259-5bb4776f6ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:36.265882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b665795-2b3e-41a7-af86-2ad4f4f43288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:36.266518 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b665795-2b3e-41a7-af86-2ad4f4f43288 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:36.266879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b665795-2b3e-41a7-af86-2ad4f4f43288 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:36.267155 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b665795-2b3e-41a7-af86-2ad4f4f43288 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:36.270266 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:36.276856 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b665795-2b3e-41a7-af86-2ad4f4f43288 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:36.278300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b665795-2b3e-41a7-af86-2ad4f4f43288 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:36.285037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9c2eb88f-2d97-4f8b-8259-5bb4776f6ca5 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:36.286260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9c2eb88f-2d97-4f8b-8259-5bb4776f6ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:36.290592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-6b665795-2b3e-41a7-af86-2ad4f4f43288 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 13:02:36.290592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:36.290592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:36.290592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:36.290592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:36.290592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:36.290592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:36.290592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:36.290592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:36.290592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:36.290592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:36.290592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:36.290592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:36.290592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:36.290592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:36.290592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:36.291543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:36.291543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:36.291543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:36.291543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:36.291543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:36.291543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:36.291543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:36.291543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:36.291543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:36.291543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:36.291543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:36.291543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:36.291543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:36.291543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:36.291543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:36.291543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:36.291543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:36.291543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:36.292630 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:36.292630 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:36.292630 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:36.292630 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:36.292630 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:36.292630 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:36.292630 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:36.292630 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:36.292630 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 13:02:36.292630 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:36.293917 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 318/644] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:02:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:36.294728 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b665795-2b3e-41a7-af86-2ad4f4f43288 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:36.348627 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:36.361585 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 327/645] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:36.362677 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2eb88f-2d97-4f8b-8259-5bb4776f6ca5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:36.416800 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b665795-2b3e-41a7-af86-2ad4f4f43288 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:36.459638 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a6437-d6f1-43d1-824e-913dae6db207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:36.460640 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a6437-d6f1-43d1-824e-913dae6db207 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:36.461145 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a6437-d6f1-43d1-824e-913dae6db207 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:36.461614 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a6437-d6f1-43d1-824e-913dae6db207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:36.473012 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a6437-d6f1-43d1-824e-913dae6db207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:36.475338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a6437-d6f1-43d1-824e-913dae6db207 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:36.489792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-d88a6437-d6f1-43d1-824e-913dae6db207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:36.489792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:36.489792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:36.489792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:36.489792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:36.489792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:36.489792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:36.489792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:36.489792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:36.489792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:36.489792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:36.489792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:36.489792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:36.489792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:36.489792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:36.489792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:36.490794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:36.490794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:36.490794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:36.490794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:36.490794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:36.490794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:36.490794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:36.490794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:36.490794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:36.490794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:36.490794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:36.490794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:36.490794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:36.490794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:36.490794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:36.490794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:36.490794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:36.491741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:36.491741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:36.491741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:36.493103 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 319/646] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:36.494013 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a6437-d6f1-43d1-824e-913dae6db207 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:36.501578 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2eb88f-2d97-4f8b-8259-5bb4776f6ca5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:36.542195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceedf0e-046c-4043-8b1d-3d459a49fb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:36.542805 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceedf0e-046c-4043-8b1d-3d459a49fb34 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:36.543274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceedf0e-046c-4043-8b1d-3d459a49fb34 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:36.543552 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceedf0e-046c-4043-8b1d-3d459a49fb34 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:36.544621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceedf0e-046c-4043-8b1d-3d459a49fb34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:36.545081 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceedf0e-046c-4043-8b1d-3d459a49fb34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:36.546509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceedf0e-046c-4043-8b1d-3d459a49fb34 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:36.546819 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:36.564636 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 328/647] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:02:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:36.565636 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceedf0e-046c-4043-8b1d-3d459a49fb34 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:36.604130 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a6437-d6f1-43d1-824e-913dae6db207 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:36.621589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:36.640057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c8222-df73-4dff-857b-2cc0dd86e411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:36.640652 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c8222-df73-4dff-857b-2cc0dd86e411 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:36.640925 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c8222-df73-4dff-857b-2cc0dd86e411 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:36.641196 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c8222-df73-4dff-857b-2cc0dd86e411 None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:36.641933 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c8222-df73-4dff-857b-2cc0dd86e411 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:36.642356 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c8222-df73-4dff-857b-2cc0dd86e411 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:36.643673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c8222-df73-4dff-857b-2cc0dd86e411 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:36.662397 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 320/648] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Aug 10 13:02:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:36.663270 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c8222-df73-4dff-857b-2cc0dd86e411 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:36.681076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceedf0e-046c-4043-8b1d-3d459a49fb34 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:36.715858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444db818-208a-47a4-8bb9-dd0749a08df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:36.716482 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444db818-208a-47a4-8bb9-dd0749a08df6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:36.716756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444db818-208a-47a4-8bb9-dd0749a08df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:36.717030 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444db818-208a-47a4-8bb9-dd0749a08df6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:36.728510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444db818-208a-47a4-8bb9-dd0749a08df6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:36.733553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-444db818-208a-47a4-8bb9-dd0749a08df6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:36.733553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:36.733553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:36.733553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:36.733553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:36.733553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:36.733553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:36.733553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:36.733553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:36.733553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:36.733553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:36.733553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:36.733553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:36.733553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:36.733553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:36.733553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:36.734554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:36.734554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:36.734554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:36.734554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:36.734554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:36.734554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:36.734554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:36.734554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:36.734554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:36.734554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:36.734554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:36.734554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:36.734554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:36.734554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:36.734554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:36.734554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:36.735510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:36.735510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:36.735510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:36.735510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:36.735510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:36.735510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:36.735510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:36.735510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:36.735510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:36.735510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:36.735510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:36.735510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:36.740118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 329/649] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:02:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:36.741077 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444db818-208a-47a4-8bb9-dd0749a08df6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:36.783379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c8222-df73-4dff-857b-2cc0dd86e411 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:36.794074 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:36.826228 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208fb3a-1ccb-4423-b558-bfef2580be06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:36.826865 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208fb3a-1ccb-4423-b558-bfef2580be06 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:36.827174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208fb3a-1ccb-4423-b558-bfef2580be06 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:36.827451 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208fb3a-1ccb-4423-b558-bfef2580be06 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:36.828118 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208fb3a-1ccb-4423-b558-bfef2580be06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:36.828432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208fb3a-1ccb-4423-b558-bfef2580be06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:36.830075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208fb3a-1ccb-4423-b558-bfef2580be06 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:36.843558 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 321/650] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:36.844681 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208fb3a-1ccb-4423-b558-bfef2580be06 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:36.845726 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444db818-208a-47a4-8bb9-dd0749a08df6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:36.858503 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:36.884403 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ed6d4-8448-41b6-a519-652a0deb8e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:36.885006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ed6d4-8448-41b6-a519-652a0deb8e47 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:36.885281 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ed6d4-8448-41b6-a519-652a0deb8e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:36.885540 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ed6d4-8448-41b6-a519-652a0deb8e47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:36.886255 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ed6d4-8448-41b6-a519-652a0deb8e47 None admin] RBAC: Adding query filter params (role.id=434a1fd874d24b959bf48fe61633f240, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=7fd0f76f24ea481191dfd65fff2376af) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:36.886556 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ed6d4-8448-41b6-a519-652a0deb8e47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:36.888004 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ed6d4-8448-41b6-a519-652a0deb8e47 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:36.903029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 330/651] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:02:36 2022] GET /identity/v3/role_assignments?user.id=7fd0f76f24ea481191dfd65fff2376af&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=434a1fd874d24b959bf48fe61633f240 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:36.903029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ed6d4-8448-41b6-a519-652a0deb8e47 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:36.983241 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208fb3a-1ccb-4423-b558-bfef2580be06 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:37.022972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ed6d4-8448-41b6-a519-652a0deb8e47 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:37.043514 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59ec0f-0598-4f1d-adcf-b4a52fba0319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:37.044293 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59ec0f-0598-4f1d-adcf-b4a52fba0319 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:37.044674 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59ec0f-0598-4f1d-adcf-b4a52fba0319 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:37.045724 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59ec0f-0598-4f1d-adcf-b4a52fba0319 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:37.061422 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316c1bf-9ca7-46ea-b908-b924b38d1b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:37.062043 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316c1bf-9ca7-46ea-b908-b924b38d1b69 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:37.062373 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316c1bf-9ca7-46ea-b908-b924b38d1b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:37.062644 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316c1bf-9ca7-46ea-b908-b924b38d1b69 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:37.063614 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316c1bf-9ca7-46ea-b908-b924b38d1b69 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:37.063919 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316c1bf-9ca7-46ea-b908-b924b38d1b69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:37.065298 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316c1bf-9ca7-46ea-b908-b924b38d1b69 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:37.076034 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 331/652] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 10 13:02:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:37.076890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316c1bf-9ca7-46ea-b908-b924b38d1b69 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:37.097010 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:37.126504 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:37.145124 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59ec0f-0598-4f1d-adcf-b4a52fba0319 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:37.146976 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59ec0f-0598-4f1d-adcf-b4a52fba0319 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:37.208504 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316c1bf-9ca7-46ea-b908-b924b38d1b69 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:37.254099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcbdb5-3451-4161-961f-7e87ff38b485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:37.254813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcbdb5-3451-4161-961f-7e87ff38b485 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:37.255622 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcbdb5-3451-4161-961f-7e87ff38b485 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:37.255954 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcbdb5-3451-4161-961f-7e87ff38b485 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:37.266771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcbdb5-3451-4161-961f-7e87ff38b485 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:37.268690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcbdb5-3451-4161-961f-7e87ff38b485 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:37.280033 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 322/653] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:37.280033 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59ec0f-0598-4f1d-adcf-b4a52fba0319 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:37.288500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-a0dcbdb5-3451-4161-961f-7e87ff38b485 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 13:02:37.288500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:37.288500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:37.288500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:37.288500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:37.288500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:37.288500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:37.288500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:37.288500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:37.288500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:37.288500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:37.288500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:37.288500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:37.288500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:37.288500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:37.288500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:37.289539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:37.289539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:37.289539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:37.289539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:37.289539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:37.289539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:37.289539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:37.289539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:37.289539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:37.289539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:37.289539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:37.289539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:37.289539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:37.289539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:37.289539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:37.289539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:37.289539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:37.289539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:37.291195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:37.291195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:37.291195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:37.291195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:37.291195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:37.291195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:37.291195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:37.291195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:37.291195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 13:02:37.291195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:37.291195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 332/654] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:02:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:37.291195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcbdb5-3451-4161-961f-7e87ff38b485 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:37.368708 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:37.410732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:37.412797 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59ec0f-0598-4f1d-adcf-b4a52fba0319 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:37.418782 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcbdb5-3451-4161-961f-7e87ff38b485 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:37.449922 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82119fb2-4293-4f5b-b1e7-9b498c004867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:37.450553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82119fb2-4293-4f5b-b1e7-9b498c004867 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:37.450826 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82119fb2-4293-4f5b-b1e7-9b498c004867 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:37.451124 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82119fb2-4293-4f5b-b1e7-9b498c004867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:37.456445 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11f994-b1b6-4724-bd5c-ebcbe8dae14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:37.457347 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11f994-b1b6-4724-bd5c-ebcbe8dae14d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:37.457884 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11f994-b1b6-4724-bd5c-ebcbe8dae14d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:37.458471 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11f994-b1b6-4724-bd5c-ebcbe8dae14d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:37.462689 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82119fb2-4293-4f5b-b1e7-9b498c004867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:37.464236 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82119fb2-4293-4f5b-b1e7-9b498c004867 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:37.470839 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11f994-b1b6-4724-bd5c-ebcbe8dae14d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:37.472710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11f994-b1b6-4724-bd5c-ebcbe8dae14d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:37.480177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-82119fb2-4293-4f5b-b1e7-9b498c004867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:37.480177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:37.480177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:37.480177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:37.480177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:37.480177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:37.480177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:37.480177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:37.480177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:37.480177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:37.480177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:37.480177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:37.480177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:37.480177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:37.480177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:37.480177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:37.481162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:37.481162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:37.481162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:37.481162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:37.481162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:37.481162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:37.481162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:37.481162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:37.481162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:37.481162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:37.481162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:37.481162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:37.481162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:37.481162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:37.481162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:37.481162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:37.481162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:37.482499 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:37.482499 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:37.482499 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:37.485838 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 323/655] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:37.486800 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82119fb2-4293-4f5b-b1e7-9b498c004867 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:37.492707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-ce11f994-b1b6-4724-bd5c-ebcbe8dae14d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:37.492707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:37.492707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:37.492707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:37.492707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:37.492707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:37.492707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:37.492707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:37.492707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:37.492707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:37.492707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:37.492707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:37.492707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:37.492707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:37.492707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:37.492707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:37.493648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:37.493648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:37.493648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:37.493648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:37.493648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:37.493648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:37.493648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:37.493648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:37.493648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:37.493648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:37.493648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:37.493648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:37.493648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:37.493648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:37.493648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:37.493648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:37.493648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:37.494551 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:37.494551 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:37.494551 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:37.500856 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 333/656] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:37.502121 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11f994-b1b6-4724-bd5c-ebcbe8dae14d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:37.595187 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82119fb2-4293-4f5b-b1e7-9b498c004867 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:37.605725 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11f994-b1b6-4724-bd5c-ebcbe8dae14d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:37.623385 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:37.636980 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347794b-159b-4073-ba05-7683d8d72dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:37.637482 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347794b-159b-4073-ba05-7683d8d72dcc None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:37.637758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347794b-159b-4073-ba05-7683d8d72dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:37.638022 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347794b-159b-4073-ba05-7683d8d72dcc None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:37.638732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347794b-159b-4073-ba05-7683d8d72dcc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:37.639065 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347794b-159b-4073-ba05-7683d8d72dcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:37.640530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347794b-159b-4073-ba05-7683d8d72dcc None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:37.643076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3513274-b4cd-49da-9839-afcd579399f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:37.643963 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3513274-b4cd-49da-9839-afcd579399f3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:37.644449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3513274-b4cd-49da-9839-afcd579399f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:37.644933 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3513274-b4cd-49da-9839-afcd579399f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:37.645877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3513274-b4cd-49da-9839-afcd579399f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:37.646433 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3513274-b4cd-49da-9839-afcd579399f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:37.648091 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3513274-b4cd-49da-9839-afcd579399f3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:37.665118 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 324/657] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Aug 10 13:02:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:37.665118 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347794b-159b-4073-ba05-7683d8d72dcc None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:37.665977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 334/658] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:37.667083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3513274-b4cd-49da-9839-afcd579399f3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:37.678750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:37.771355 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3513274-b4cd-49da-9839-afcd579399f3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:37.777155 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347794b-159b-4073-ba05-7683d8d72dcc None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:37.808661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9654a3-ba04-4f69-b9b7-ea6c632d33af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:37.809299 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9654a3-ba04-4f69-b9b7-ea6c632d33af None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:37.809576 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9654a3-ba04-4f69-b9b7-ea6c632d33af None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:37.809845 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9654a3-ba04-4f69-b9b7-ea6c632d33af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:37.813493 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a47ce-d2ef-47d9-9fc3-fe266bdef04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:37.814102 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a47ce-d2ef-47d9-9fc3-fe266bdef04f None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:37.814370 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a47ce-d2ef-47d9-9fc3-fe266bdef04f None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:37.814636 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a47ce-d2ef-47d9-9fc3-fe266bdef04f None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:37.815295 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a47ce-d2ef-47d9-9fc3-fe266bdef04f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:37.815594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a47ce-d2ef-47d9-9fc3-fe266bdef04f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:37.817051 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a47ce-d2ef-47d9-9fc3-fe266bdef04f None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:37.830128 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 325/659] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:37.835589 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a47ce-d2ef-47d9-9fc3-fe266bdef04f None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:37.872823 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:37.886123 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9654a3-ba04-4f69-b9b7-ea6c632d33af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:37.887722 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9654a3-ba04-4f69-b9b7-ea6c632d33af None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:37.898750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:37.945841 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a47ce-d2ef-47d9-9fc3-fe266bdef04f None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:37.982088 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edca7e-b8ec-41b8-987a-fb997bdaca24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:37.982709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edca7e-b8ec-41b8-987a-fb997bdaca24 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:37.982984 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edca7e-b8ec-41b8-987a-fb997bdaca24 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:37.983276 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edca7e-b8ec-41b8-987a-fb997bdaca24 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:37.993664 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edca7e-b8ec-41b8-987a-fb997bdaca24 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:37.995259 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edca7e-b8ec-41b8-987a-fb997bdaca24 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:37.998790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 335/660] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:38.000369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b88d0-22a1-4442-aa50-4edc838554a2 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:38.000896 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b88d0-22a1-4442-aa50-4edc838554a2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:38.001340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b88d0-22a1-4442-aa50-4edc838554a2 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:38.003894 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 336/661] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:38.005011 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b88d0-22a1-4442-aa50-4edc838554a2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:38.007617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-b0edca7e-b8ec-41b8-987a-fb997bdaca24 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 13:02:38.007617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:38.007617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:38.007617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:38.007617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:38.007617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:38.007617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:38.007617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:38.007617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:38.007617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:38.007617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:38.007617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:38.007617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:38.007617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:38.007617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:38.007617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:38.009532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:38.009532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:38.009532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:38.009532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:38.009532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:38.009532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:38.009532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:38.009532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:38.009532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:38.009532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:38.009532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:38.009532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:38.009532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:38.009532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:38.009532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:38.009532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:38.009532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:38.009532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:38.010866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:38.010866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:38.010866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:38.010866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:38.010866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:38.010866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:38.010866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:38.010866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:38.010866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 13:02:38.010866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:38.010866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 326/662] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:02:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:38.010866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edca7e-b8ec-41b8-987a-fb997bdaca24 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:38.115988 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:38.122415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edca7e-b8ec-41b8-987a-fb997bdaca24 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:38.128416 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b88d0-22a1-4442-aa50-4edc838554a2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:38.137817 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:38.167436 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a6b18-09d5-451c-9ac6-c28b0fd5d5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:38.168277 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa0c77-e0cd-4db1-971f-d207f3ae8583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:38.168911 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa0c77-e0cd-4db1-971f-d207f3ae8583 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:38.169192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa0c77-e0cd-4db1-971f-d207f3ae8583 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:38.169466 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa0c77-e0cd-4db1-971f-d207f3ae8583 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:38.169757 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a6b18-09d5-451c-9ac6-c28b0fd5d5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:38.170247 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a6b18-09d5-451c-9ac6-c28b0fd5d5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:38.170795 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a6b18-09d5-451c-9ac6-c28b0fd5d5c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:38.177619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa0c77-e0cd-4db1-971f-d207f3ae8583 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:38.179567 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa0c77-e0cd-4db1-971f-d207f3ae8583 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:38.182926 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a6b18-09d5-451c-9ac6-c28b0fd5d5c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:38.184543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a6b18-09d5-451c-9ac6-c28b0fd5d5c8 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:38.191507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-88fa0c77-e0cd-4db1-971f-d207f3ae8583 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:38.191507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:38.191507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:38.191507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:38.191507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:38.191507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:38.191507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:38.191507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:38.191507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:38.191507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:38.191507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:38.191507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:38.191507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:02:38.191507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:02:38.191507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:02:38.192625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:02:38.192625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:38.192625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:38.192625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:38.192625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:38.192625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:38.192625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:38.192625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:38.192625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:38.192625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:38.192625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:38.192625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:38.192625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:38.192625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:38.192625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:38.192625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:38.192625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:38.193554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:02:38.193554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:02:38.193554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:02:38.193554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:02:38.193554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:02:38.193554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:02:38.193554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:38.193554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:38.193554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 337/663] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:38.194401 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764883c-b739-4073-9a32-7cec9fc68be3 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:38.194687 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764883c-b739-4073-9a32-7cec9fc68be3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:38.194955 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764883c-b739-4073-9a32-7cec9fc68be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:38.205676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-0f0a6b18-09d5-451c-9ac6-c28b0fd5d5c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:38.205676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:38.205676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:38.205676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:38.205676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:38.205676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:38.205676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:38.205676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:38.205676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:38.205676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:38.205676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:38.205676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:38.205676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:38.205676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:38.205676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:38.205676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:38.206870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:38.206870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:38.206870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:38.206870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:38.206870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:38.206870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:38.206870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:38.206870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:38.206870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:38.206870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:38.206870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:38.206870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:38.206870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:38.206870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:38.206870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:38.206870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:38.206870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:38.208056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:38.208056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:38.208056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:38.209472 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 327/664] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:38.210414 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a6b18-09d5-451c-9ac6-c28b0fd5d5c8 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:38.219459 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8764883c-b739-4073-9a32-7cec9fc68be3 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:38.220648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8764883c-b739-4073-9a32-7cec9fc68be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:38.289273 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 338/665] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:38.290092 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764883c-b739-4073-9a32-7cec9fc68be3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:38.328751 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a6b18-09d5-451c-9ac6-c28b0fd5d5c8 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:38.363879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84840c56-7f80-4afc-ba23-26f1b1651a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:38.365088 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84840c56-7f80-4afc-ba23-26f1b1651a33 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:38.365366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84840c56-7f80-4afc-ba23-26f1b1651a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:38.365633 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84840c56-7f80-4afc-ba23-26f1b1651a33 None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:38.366363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84840c56-7f80-4afc-ba23-26f1b1651a33 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:38.366670 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84840c56-7f80-4afc-ba23-26f1b1651a33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:38.368126 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84840c56-7f80-4afc-ba23-26f1b1651a33 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:38.386683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 328/666] 10.222.0.46 () {56 vars in 1139 bytes} [Wed Aug 10 13:02:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:38.387453 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84840c56-7f80-4afc-ba23-26f1b1651a33 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:38.394489 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:38.396116 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:38.401995 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764883c-b739-4073-9a32-7cec9fc68be3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:38.439230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7ad5a-866c-4e29-ad8a-5200b2ce0bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:38.440176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7ad5a-866c-4e29-ad8a-5200b2ce0bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:38.440521 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7ad5a-866c-4e29-ad8a-5200b2ce0bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:38.440792 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7ad5a-866c-4e29-ad8a-5200b2ce0bc9 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:38.441497 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7ad5a-866c-4e29-ad8a-5200b2ce0bc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:38.441811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7ad5a-866c-4e29-ad8a-5200b2ce0bc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:38.443772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7ad5a-866c-4e29-ad8a-5200b2ce0bc9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:38.455710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 339/667] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:02:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:38.456315 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7ad5a-866c-4e29-ad8a-5200b2ce0bc9 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:38.508853 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84840c56-7f80-4afc-ba23-26f1b1651a33 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:38.554774 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960044fc-d4d6-4434-bcf8-64648af67891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:38.555823 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960044fc-d4d6-4434-bcf8-64648af67891 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:38.556379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960044fc-d4d6-4434-bcf8-64648af67891 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:38.556654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960044fc-d4d6-4434-bcf8-64648af67891 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:38.557540 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960044fc-d4d6-4434-bcf8-64648af67891 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:38.557842 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960044fc-d4d6-4434-bcf8-64648af67891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:38.559877 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960044fc-d4d6-4434-bcf8-64648af67891 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:38.560964 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7ad5a-866c-4e29-ad8a-5200b2ce0bc9 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:38.578421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 329/668] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:38.579389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960044fc-d4d6-4434-bcf8-64648af67891 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:38.599981 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c520c-21e4-4785-9aab-cc5418024fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:38.601145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c520c-21e4-4785-9aab-cc5418024fcb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:38.601568 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c520c-21e4-4785-9aab-cc5418024fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:38.601889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c520c-21e4-4785-9aab-cc5418024fcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:38.613372 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c520c-21e4-4785-9aab-cc5418024fcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:38.620460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-8a0c520c-21e4-4785-9aab-cc5418024fcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:38.620460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:38.620460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:38.620460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:38.620460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:38.620460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:38.620460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:38.620460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:38.620460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:38.620460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:38.620460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:38.620460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:38.620460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:38.620460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:38.620460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:38.620460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:38.626719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:38.626719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:38.626719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:38.626719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:38.626719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:38.626719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:38.626719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:38.626719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:38.626719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:38.626719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:38.626719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:38.626719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:38.626719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:38.626719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:38.626719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:38.626719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:38.627877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:38.627877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:38.627877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:38.627877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:38.627877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:38.627877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:38.627877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:38.627877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:38.627877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:38.627877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:38.627877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:38.627877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:38.627877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 340/669] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:02:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:38.627877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c520c-21e4-4785-9aab-cc5418024fcb None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:38.646463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:38.665855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:38.703434 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960044fc-d4d6-4434-bcf8-64648af67891 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:38.740598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c520c-21e4-4785-9aab-cc5418024fcb None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:38.741016 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4e470-384e-486d-8d70-4ac0cbae30ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:38.741626 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4e470-384e-486d-8d70-4ac0cbae30ac None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:38.741911 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4e470-384e-486d-8d70-4ac0cbae30ac None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:38.742185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4e470-384e-486d-8d70-4ac0cbae30ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:38.778783 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b407fe-8d4d-4c19-9396-d5398ca5871b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:38.779410 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b407fe-8d4d-4c19-9396-d5398ca5871b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:38.779688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b407fe-8d4d-4c19-9396-d5398ca5871b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:38.779958 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b407fe-8d4d-4c19-9396-d5398ca5871b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:38.780683 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b407fe-8d4d-4c19-9396-d5398ca5871b None admin] RBAC: Adding query filter params (role.id=434a1fd874d24b959bf48fe61633f240, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=ad44decbbaee4d11ac076220bb9c7f40) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:38.780986 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b407fe-8d4d-4c19-9396-d5398ca5871b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:38.782785 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b407fe-8d4d-4c19-9396-d5398ca5871b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:38.788813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 341/670] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:02:38 2022] GET /identity/v3/role_assignments?user.id=ad44decbbaee4d11ac076220bb9c7f40&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=434a1fd874d24b959bf48fe61633f240 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:38.789440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b407fe-8d4d-4c19-9396-d5398ca5871b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:38.834787 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4e470-384e-486d-8d70-4ac0cbae30ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:38.836331 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4e470-384e-486d-8d70-4ac0cbae30ac None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:38.908934 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:38.910810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:38.935488 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b407fe-8d4d-4c19-9396-d5398ca5871b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:38.952038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 330/671] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:38.952896 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4e470-384e-486d-8d70-4ac0cbae30ac None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:38.976157 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8a49d-8a39-45fe-b1ce-06cb45965b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:38.976828 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8a49d-8a39-45fe-b1ce-06cb45965b90 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:38.977107 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8a49d-8a39-45fe-b1ce-06cb45965b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:38.977382 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8a49d-8a39-45fe-b1ce-06cb45965b90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:38.990672 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8a49d-8a39-45fe-b1ce-06cb45965b90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:38.994133 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8a49d-8a39-45fe-b1ce-06cb45965b90 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:39.006340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-51e8a49d-8a39-45fe-b1ce-06cb45965b90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:39.006340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:39.006340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:39.006340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:39.006340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:39.006340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:39.006340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:39.006340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:39.006340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:39.006340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:39.006340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:39.006340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:39.006340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:02:39.006340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:02:39.006340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:02:39.007457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:02:39.007457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:39.007457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:39.007457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:39.007457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:39.007457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:39.007457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:39.007457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:39.007457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:39.007457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:39.007457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:39.007457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:39.007457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:39.007457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:39.007457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:39.007457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:39.007457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:39.008367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:02:39.008367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:02:39.008367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:02:39.008367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:02:39.008367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:02:39.008367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:02:39.008367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:39.008367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:39.008367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 342/672] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:39.013701 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8a49d-8a39-45fe-b1ce-06cb45965b90 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:39.086211 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4e470-384e-486d-8d70-4ac0cbae30ac None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:39.131530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc37590-055d-4a45-9587-ef00028e659c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:39.132134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc37590-055d-4a45-9587-ef00028e659c None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:39.132409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc37590-055d-4a45-9587-ef00028e659c None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:39.132678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc37590-055d-4a45-9587-ef00028e659c None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:39.133334 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc37590-055d-4a45-9587-ef00028e659c None admin] RBAC: Adding query filter params (name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:39.133632 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc37590-055d-4a45-9587-ef00028e659c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:39.134989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc37590-055d-4a45-9587-ef00028e659c None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:39.143434 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 331/673] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 10 13:02:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:39.144590 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc37590-055d-4a45-9587-ef00028e659c None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:39.144989 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8a49d-8a39-45fe-b1ce-06cb45965b90 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:39.174153 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:39.189698 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038068e-4d6e-4be5-9f33-ef0dad657f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:39.191054 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038068e-4d6e-4be5-9f33-ef0dad657f29 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:39.191655 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038068e-4d6e-4be5-9f33-ef0dad657f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:39.192282 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038068e-4d6e-4be5-9f33-ef0dad657f29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:39.207080 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038068e-4d6e-4be5-9f33-ef0dad657f29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:39.209879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038068e-4d6e-4be5-9f33-ef0dad657f29 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:39.212130 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:39.228003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-f038068e-4d6e-4be5-9f33-ef0dad657f29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:39.228003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:39.228003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:39.228003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:39.228003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:39.228003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:39.228003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:39.228003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:39.228003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:39.228003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:39.228003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:39.228003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:39.228003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:39.228003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:39.228003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:39.228003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:39.229018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:39.229018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:39.229018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:39.229018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:39.229018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:39.229018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:39.229018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:39.229018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:39.229018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:39.229018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:39.229018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:39.229018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:39.229018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:39.229018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:39.229018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:39.229018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:39.229018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:39.229928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:39.229928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:39.229928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:39.229928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 343/674] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:39.230741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5f5ea-ce24-44d1-a5a4-664fee6d4d4a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:39.230741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5f5ea-ce24-44d1-a5a4-664fee6d4d4a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:39.230741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5f5ea-ce24-44d1-a5a4-664fee6d4d4a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:39.232068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 344/675] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:39.233821 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5f5ea-ce24-44d1-a5a4-664fee6d4d4a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:39.256812 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc37590-055d-4a45-9587-ef00028e659c None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:39.294105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6a2e1-58d3-401a-9770-f0f92b7096b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:39.294811 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6a2e1-58d3-401a-9770-f0f92b7096b1 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:39.294982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6a2e1-58d3-401a-9770-f0f92b7096b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:39.295272 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6a2e1-58d3-401a-9770-f0f92b7096b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:39.295951 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6a2e1-58d3-401a-9770-f0f92b7096b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:39.296314 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6a2e1-58d3-401a-9770-f0f92b7096b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:39.297727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6a2e1-58d3-401a-9770-f0f92b7096b1 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:39.318418 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 332/676] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:02:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:39.318418 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6a2e1-58d3-401a-9770-f0f92b7096b1 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:39.353931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5f5ea-ce24-44d1-a5a4-664fee6d4d4a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:39.388474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c84ac-7ece-4961-a2ad-6f986be30946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:39.389085 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c84ac-7ece-4961-a2ad-6f986be30946 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:39.389357 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c84ac-7ece-4961-a2ad-6f986be30946 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:39.389621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c84ac-7ece-4961-a2ad-6f986be30946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:39.401081 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c84ac-7ece-4961-a2ad-6f986be30946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:39.402549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c84ac-7ece-4961-a2ad-6f986be30946 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:39.407983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:39.418808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-980c84ac-7ece-4961-a2ad-6f986be30946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:39.418808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:39.418808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:39.418808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:39.418808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:39.418808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:39.418808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:39.418808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:39.418808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:39.418808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:39.418808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:39.418808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:39.418808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:39.418808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:39.418808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:39.418808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:39.419937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:39.419937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:39.419937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:39.419937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:39.419937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:39.419937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:39.419937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:39.419937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:39.419937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:39.419937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:39.419937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:39.419937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:39.419937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:39.419937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:39.419937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:39.419937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:39.419937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:39.420992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:39.420992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:39.420992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:39.420992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 345/677] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:39.423946 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6a2e1-58d3-401a-9770-f0f92b7096b1 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:39.425614 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4054884-35e4-4ac8-a5bb-4c8f87502ce7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:39.425841 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4054884-35e4-4ac8-a5bb-4c8f87502ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:39.426111 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4054884-35e4-4ac8-a5bb-4c8f87502ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:39.445670 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c4054884-35e4-4ac8-a5bb-4c8f87502ce7 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:39.446845 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c4054884-35e4-4ac8-a5bb-4c8f87502ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:39.461883 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086a938-a137-49ef-8c0b-ced9af7cd956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:39.462496 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086a938-a137-49ef-8c0b-ced9af7cd956 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:39.462773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086a938-a137-49ef-8c0b-ced9af7cd956 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:39.463068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086a938-a137-49ef-8c0b-ced9af7cd956 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:39.463708 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086a938-a137-49ef-8c0b-ced9af7cd956 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:39.464010 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086a938-a137-49ef-8c0b-ced9af7cd956 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:39.465363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086a938-a137-49ef-8c0b-ced9af7cd956 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:39.477955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 333/678] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:39.478648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086a938-a137-49ef-8c0b-ced9af7cd956 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:39.495981 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:39.523046 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 346/679] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:39.523046 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4054884-35e4-4ac8-a5bb-4c8f87502ce7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:39.597306 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086a938-a137-49ef-8c0b-ced9af7cd956 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:39.634654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04366daa-1802-4549-a82c-a4333154bbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:39.635298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04366daa-1802-4549-a82c-a4333154bbee None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:39.635579 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04366daa-1802-4549-a82c-a4333154bbee None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:39.635853 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04366daa-1802-4549-a82c-a4333154bbee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:39.636573 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04366daa-1802-4549-a82c-a4333154bbee None admin] RBAC: Adding query filter params (role.id=434a1fd874d24b959bf48fe61633f240, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=5979be13ad31421b886069faf0dcc915) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:39.636885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04366daa-1802-4549-a82c-a4333154bbee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:39.638324 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04366daa-1802-4549-a82c-a4333154bbee None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:39.641083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4054884-35e4-4ac8-a5bb-4c8f87502ce7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:39.646056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 334/680] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:02:39 2022] GET /identity/v3/role_assignments?user.id=5979be13ad31421b886069faf0dcc915&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=434a1fd874d24b959bf48fe61633f240 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:39.647204 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04366daa-1802-4549-a82c-a4333154bbee None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:39.673314 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:39.683553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4cdbd-aeae-404d-84c8-c46992f127e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:39.684550 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4cdbd-aeae-404d-84c8-c46992f127e0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:39.685164 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4cdbd-aeae-404d-84c8-c46992f127e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:39.685647 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4cdbd-aeae-404d-84c8-c46992f127e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:39.686598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4cdbd-aeae-404d-84c8-c46992f127e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:39.687144 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4cdbd-aeae-404d-84c8-c46992f127e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:39.689048 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4cdbd-aeae-404d-84c8-c46992f127e0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:39.703048 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 347/681] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:39.704336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4cdbd-aeae-404d-84c8-c46992f127e0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:39.746333 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:39.780057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04366daa-1802-4549-a82c-a4333154bbee None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:39.827290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc90e8d-2df7-4f2f-bfb3-29f16fc49eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:39.828303 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc90e8d-2df7-4f2f-bfb3-29f16fc49eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:39.828806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc90e8d-2df7-4f2f-bfb3-29f16fc49eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:39.829124 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc90e8d-2df7-4f2f-bfb3-29f16fc49eb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:39.837663 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc90e8d-2df7-4f2f-bfb3-29f16fc49eb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:39.839190 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc90e8d-2df7-4f2f-bfb3-29f16fc49eb8 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:39.844693 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4cdbd-aeae-404d-84c8-c46992f127e0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:39.852626 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-4dc90e8d-2df7-4f2f-bfb3-29f16fc49eb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:39.852626 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:39.852626 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:39.852626 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:39.852626 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:39.852626 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:39.852626 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:39.852626 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:39.852626 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:39.852626 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:39.852626 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:39.852626 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:39.852626 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:02:39.852626 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:02:39.852626 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:02:39.853605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:02:39.853605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:39.853605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:39.853605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:39.853605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:39.853605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:39.853605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:39.853605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:39.853605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:39.853605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:39.853605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:39.853605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:39.853605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:39.853605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:39.853605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:39.853605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:39.853605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:39.854565 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:02:39.854565 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:02:39.854565 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:02:39.854565 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:02:39.854565 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:02:39.854565 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:02:39.854565 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:39.854565 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:39.854565 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 335/682] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:39.855529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc90e8d-2df7-4f2f-bfb3-29f16fc49eb8 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:39.896339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357e793-74fb-45b2-9afb-852304c319cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:39.896339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357e793-74fb-45b2-9afb-852304c319cd None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:39.896651 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357e793-74fb-45b2-9afb-852304c319cd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:39.896896 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357e793-74fb-45b2-9afb-852304c319cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:39.908097 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357e793-74fb-45b2-9afb-852304c319cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:39.913370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-1357e793-74fb-45b2-9afb-852304c319cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:02:39.913370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:39.913370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:39.913370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:39.913370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:39.913370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:39.913370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:39.913370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:39.913370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:39.913370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:39.913370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:39.913370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:39.913370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:39.913370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:39.913370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:39.913370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:39.914305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:39.914305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:39.914305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:39.914305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:39.914305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:39.914305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:39.914305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:39.914305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:39.914305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:39.914305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:39.914305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:39.914305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:39.914305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:39.914305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:39.914305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:39.914305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:39.915223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:39.915223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:39.915223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:39.915223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:39.915223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:39.915223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:39.915223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:39.915223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:39.915223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:39.915223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:39.915223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:02:39.915223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:39.915223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 348/683] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:02:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:39.916604 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357e793-74fb-45b2-9afb-852304c319cd None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:39.948401 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:39.997302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc90e8d-2df7-4f2f-bfb3-29f16fc49eb8 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:40.035581 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5af3e-ddb3-49a1-bb11-8e9dac2337d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:40.036362 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5af3e-ddb3-49a1-bb11-8e9dac2337d0 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:40.036703 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5af3e-ddb3-49a1-bb11-8e9dac2337d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:40.037039 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5af3e-ddb3-49a1-bb11-8e9dac2337d0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:40.045388 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5af3e-ddb3-49a1-bb11-8e9dac2337d0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:40.046909 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5af3e-ddb3-49a1-bb11-8e9dac2337d0 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:40.056109 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:40.059855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-34c5af3e-ddb3-49a1-bb11-8e9dac2337d0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 13:02:40.059855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:40.059855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:40.059855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:40.059855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:40.059855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:40.059855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:40.059855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:40.059855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:40.059855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:40.059855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:40.059855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:40.059855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:40.059855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:40.059855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:40.059855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:40.061045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:40.061045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:40.061045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:40.061045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:40.061045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:40.061045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:40.061045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:40.061045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:40.061045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:40.061045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:40.061045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:40.061045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:40.061045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:40.061045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:40.061045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:40.061045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:40.061045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:40.061045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:40.062915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:40.062915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:40.062915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:40.062915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:40.062915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:40.062915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:40.062915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:40.062915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:40.062915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 13:02:40.062915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:40.062915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 336/684] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:02:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:40.064364 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5af3e-ddb3-49a1-bb11-8e9dac2337d0 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:40.064501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357e793-74fb-45b2-9afb-852304c319cd None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:40.105642 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f1913-cc83-4aa8-b0c5-bd4993cfe952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:40.106258 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f1913-cc83-4aa8-b0c5-bd4993cfe952 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:40.106537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f1913-cc83-4aa8-b0c5-bd4993cfe952 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:40.106810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f1913-cc83-4aa8-b0c5-bd4993cfe952 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:40.107534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f1913-cc83-4aa8-b0c5-bd4993cfe952 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:40.107834 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f1913-cc83-4aa8-b0c5-bd4993cfe952 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:40.109268 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f1913-cc83-4aa8-b0c5-bd4993cfe952 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:40.123072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 349/685] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:02:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:40.124011 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f1913-cc83-4aa8-b0c5-bd4993cfe952 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:40.173880 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5af3e-ddb3-49a1-bb11-8e9dac2337d0 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:40.204604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:40.212573 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1675c8-ff16-4d7d-b1b1-bd1f2fecd5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:40.213416 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1675c8-ff16-4d7d-b1b1-bd1f2fecd5dd None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:40.213841 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1675c8-ff16-4d7d-b1b1-bd1f2fecd5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:40.214266 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1675c8-ff16-4d7d-b1b1-bd1f2fecd5dd None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:40.215106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1675c8-ff16-4d7d-b1b1-bd1f2fecd5dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:40.215564 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1675c8-ff16-4d7d-b1b1-bd1f2fecd5dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:40.217081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1675c8-ff16-4d7d-b1b1-bd1f2fecd5dd None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:40.226936 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 337/686] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:02:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:40.228205 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1675c8-ff16-4d7d-b1b1-bd1f2fecd5dd None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:40.230537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f1913-cc83-4aa8-b0c5-bd4993cfe952 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:40.266710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206f3ae-7073-4f69-a14c-d6c34285c12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:40.267359 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206f3ae-7073-4f69-a14c-d6c34285c12c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:40.267645 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206f3ae-7073-4f69-a14c-d6c34285c12c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:40.267919 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206f3ae-7073-4f69-a14c-d6c34285c12c None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:40.268653 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206f3ae-7073-4f69-a14c-d6c34285c12c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:40.268960 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206f3ae-7073-4f69-a14c-d6c34285c12c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:40.271410 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206f3ae-7073-4f69-a14c-d6c34285c12c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:40.290696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 350/687] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Aug 10 13:02:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:40.291580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206f3ae-7073-4f69-a14c-d6c34285c12c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:40.307603 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:40.337366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1675c8-ff16-4d7d-b1b1-bd1f2fecd5dd None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:40.373467 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725966c-2cd5-464b-9670-8752f4897876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:40.373902 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725966c-2cd5-464b-9670-8752f4897876 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:40.374190 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725966c-2cd5-464b-9670-8752f4897876 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:40.374459 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725966c-2cd5-464b-9670-8752f4897876 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:40.375211 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725966c-2cd5-464b-9670-8752f4897876 None admin] RBAC: Adding query filter params (role.id=434a1fd874d24b959bf48fe61633f240, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=49b69dad00934ce78cbede99f976439f) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:40.375516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725966c-2cd5-464b-9670-8752f4897876 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:40.376928 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725966c-2cd5-464b-9670-8752f4897876 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:40.384011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 338/688] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:02:40 2022] GET /identity/v3/role_assignments?user.id=49b69dad00934ce78cbede99f976439f&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=434a1fd874d24b959bf48fe61633f240 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:40.384903 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725966c-2cd5-464b-9670-8752f4897876 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:40.406891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206f3ae-7073-4f69-a14c-d6c34285c12c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:40.449765 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f57f8-be96-44b1-b3be-a0475b6a49e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:40.450777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f57f8-be96-44b1-b3be-a0475b6a49e6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:40.451297 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f57f8-be96-44b1-b3be-a0475b6a49e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:40.451847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f57f8-be96-44b1-b3be-a0475b6a49e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:40.456334 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:40.467024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f57f8-be96-44b1-b3be-a0475b6a49e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:40.470094 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f57f8-be96-44b1-b3be-a0475b6a49e6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:40.492406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-774f57f8-be96-44b1-b3be-a0475b6a49e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:40.492406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:40.492406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:40.492406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:40.492406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:40.492406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:40.492406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:40.492406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:40.492406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:40.492406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:40.492406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:40.492406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:40.492406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:40.492406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:40.492406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:40.492406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:40.493431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:40.493431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:40.493431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:40.493431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:40.493431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:40.493431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:40.493431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:40.493431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:40.493431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:40.493431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:40.493431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:40.493431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:40.493431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:40.493431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:40.493431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:40.493431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:40.493431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:40.494334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:40.494334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:40.494334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:40.496493 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 351/689] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:40.503400 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f57f8-be96-44b1-b3be-a0475b6a49e6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:40.519045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725966c-2cd5-464b-9670-8752f4897876 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:40.560676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58d4e5-7fd9-4f19-b145-e2cc1320b5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:40.562718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58d4e5-7fd9-4f19-b145-e2cc1320b5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:40.563012 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58d4e5-7fd9-4f19-b145-e2cc1320b5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:40.563298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58d4e5-7fd9-4f19-b145-e2cc1320b5b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:40.648991 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58d4e5-7fd9-4f19-b145-e2cc1320b5b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:40.649580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:40.650702 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58d4e5-7fd9-4f19-b145-e2cc1320b5b7 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:40.692651 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f57f8-be96-44b1-b3be-a0475b6a49e6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:40.712032 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:40.730479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18bc5a-7bf9-4973-9db4-65ae34a0dc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:40.731465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18bc5a-7bf9-4973-9db4-65ae34a0dc2c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:40.731956 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18bc5a-7bf9-4973-9db4-65ae34a0dc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:40.732481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18bc5a-7bf9-4973-9db4-65ae34a0dc2c None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:40.733351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18bc5a-7bf9-4973-9db4-65ae34a0dc2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:40.733862 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18bc5a-7bf9-4973-9db4-65ae34a0dc2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:40.735481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18bc5a-7bf9-4973-9db4-65ae34a0dc2c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:40.748677 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 352/690] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:02:40.755972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18bc5a-7bf9-4973-9db4-65ae34a0dc2c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:40.759755 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 339/691] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:40.767496 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58d4e5-7fd9-4f19-b145-e2cc1320b5b7 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:40.888764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18bc5a-7bf9-4973-9db4-65ae34a0dc2c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:40.907786 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58d4e5-7fd9-4f19-b145-e2cc1320b5b7 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:40.926448 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:40.930336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae488e1f-b142-4403-afcb-261ab3b66c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:40.931185 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae488e1f-b142-4403-afcb-261ab3b66c28 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:40.931462 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae488e1f-b142-4403-afcb-261ab3b66c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:40.931729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae488e1f-b142-4403-afcb-261ab3b66c28 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:40.941320 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae488e1f-b142-4403-afcb-261ab3b66c28 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:40.947028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae488e1f-b142-4403-afcb-261ab3b66c28 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:40.960440 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cdf58-5163-4d95-b5fc-5389460859fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:40.961086 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cdf58-5163-4d95-b5fc-5389460859fd None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:40.961359 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cdf58-5163-4d95-b5fc-5389460859fd None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:40.961627 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cdf58-5163-4d95-b5fc-5389460859fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:40.972006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-ae488e1f-b142-4403-afcb-261ab3b66c28 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 13:02:40.972006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:40.972006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:40.972006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:40.972006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:40.972006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:40.972006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:40.972006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:40.972006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:40.972006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:40.972006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:40.972006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:40.972006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:40.972006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:40.972006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:40.972006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:40.973007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:40.973007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:40.973007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:40.973007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:40.973007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:40.973007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:40.973007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:40.973007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:40.973007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:40.973007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:40.973007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:40.973007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:40.973007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:40.973007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:40.973007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:40.973007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:40.973007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:40.973007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:40.974658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:40.974658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:40.974658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:40.974658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:40.974658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:40.974658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:40.974658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:40.974658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:40.974658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 13:02:40.974658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:40.975262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cdf58-5163-4d95-b5fc-5389460859fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:40.975338 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 353/692] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Aug 10 13:02:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:40.975420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cdf58-5163-4d95-b5fc-5389460859fd None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:40.982210 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae488e1f-b142-4403-afcb-261ab3b66c28 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:40.991273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-6b4cdf58-5163-4d95-b5fc-5389460859fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:40.991273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:40.991273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:40.991273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:40.991273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:40.991273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:40.991273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:40.991273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:40.991273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:40.991273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:40.991273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:40.991273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:40.991273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:40.991273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:40.991273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:40.991273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:40.992262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:40.992262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:40.992262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:40.992262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:40.992262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:40.992262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:40.992262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:40.992262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:40.992262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:40.992262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:40.992262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:40.992262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:40.992262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:40.992262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:40.992262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:40.992262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:40.992262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:40.993177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:40.993177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:40.993177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:40.993177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 340/693] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:40.993912 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922108b1-f2f2-48bf-a8be-c4deb6d7c38b None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:40.994192 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922108b1-f2f2-48bf-a8be-c4deb6d7c38b None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:40.994459 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922108b1-f2f2-48bf-a8be-c4deb6d7c38b None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:41.000471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 341/694] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:41.005159 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922108b1-f2f2-48bf-a8be-c4deb6d7c38b None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:41.014600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:41.107609 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae488e1f-b142-4403-afcb-261ab3b66c28 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:41.111588 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922108b1-f2f2-48bf-a8be-c4deb6d7c38b None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:41.148356 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd68a9-cf7e-4fa4-9830-fdaeed240d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:41.148963 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd68a9-cf7e-4fa4-9830-fdaeed240d27 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:41.149300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd68a9-cf7e-4fa4-9830-fdaeed240d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:41.149408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f0e22-e7d2-44d0-b0c6-b2d759d43189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:41.149586 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd68a9-cf7e-4fa4-9830-fdaeed240d27 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:41.150203 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd68a9-cf7e-4fa4-9830-fdaeed240d27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:41.150501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd68a9-cf7e-4fa4-9830-fdaeed240d27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:41.150808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f0e22-e7d2-44d0-b0c6-b2d759d43189 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:41.151311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f0e22-e7d2-44d0-b0c6-b2d759d43189 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:41.151781 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f0e22-e7d2-44d0-b0c6-b2d759d43189 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:41.151995 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd68a9-cf7e-4fa4-9830-fdaeed240d27 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:41.152914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f0e22-e7d2-44d0-b0c6-b2d759d43189 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:41.153561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f0e22-e7d2-44d0-b0c6-b2d759d43189 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:41.155333 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f0e22-e7d2-44d0-b0c6-b2d759d43189 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:41.174985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 342/695] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:41.180373 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2732ab-c479-482f-8c7d-8742c595383c None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:41.180373 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2732ab-c479-482f-8c7d-8742c595383c None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:41.180373 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2732ab-c479-482f-8c7d-8742c595383c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:41.180816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 354/696] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Aug 10 13:02:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:41.181985 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f0e22-e7d2-44d0-b0c6-b2d759d43189 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:41.196598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-9f2732ab-c479-482f-8c7d-8742c595383c None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:41.197966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-9f2732ab-c479-482f-8c7d-8742c595383c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:41.239445 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:41.268109 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:41.279023 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 343/697] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:41.279023 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2732ab-c479-482f-8c7d-8742c595383c None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:41.309020 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f0e22-e7d2-44d0-b0c6-b2d759d43189 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:41.346629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28274b-7d36-403c-aa51-dd78175314c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:41.347662 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28274b-7d36-403c-aa51-dd78175314c8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:41.348150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28274b-7d36-403c-aa51-dd78175314c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:41.348675 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28274b-7d36-403c-aa51-dd78175314c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:41.355920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28274b-7d36-403c-aa51-dd78175314c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:41.357588 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28274b-7d36-403c-aa51-dd78175314c8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:41.369667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-fe28274b-7d36-403c-aa51-dd78175314c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:41.369667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:41.369667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:41.369667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:41.369667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:41.369667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:41.369667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:41.369667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:41.369667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:41.369667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:41.369667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:41.369667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:41.369667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:02:41.369667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:02:41.369667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:02:41.370584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:02:41.370584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:41.370584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:41.370584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:41.370584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:41.370584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:41.370584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:41.370584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:41.370584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:41.370584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:41.370584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:41.370584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:41.370584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:41.370584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:41.370584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:41.370584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:41.370584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:41.371534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:02:41.371534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:02:41.371534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:02:41.371534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:02:41.371534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:02:41.371534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:02:41.371534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:41.371534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:41.373899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 355/698] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:41.374950 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28274b-7d36-403c-aa51-dd78175314c8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:41.385382 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2732ab-c479-482f-8c7d-8742c595383c None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:41.420344 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b19f78-5daa-4ca1-b694-c3964b01bba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:41.421019 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b19f78-5daa-4ca1-b694-c3964b01bba7 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:41.421302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b19f78-5daa-4ca1-b694-c3964b01bba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:41.421572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b19f78-5daa-4ca1-b694-c3964b01bba7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:41.484373 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28274b-7d36-403c-aa51-dd78175314c8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:41.487217 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:41.491821 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b19f78-5daa-4ca1-b694-c3964b01bba7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:41.493223 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b19f78-5daa-4ca1-b694-c3964b01bba7 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:41.511425 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:41.523879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a5f03-8304-4f67-b1b1-fcc7576d6e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:41.524898 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a5f03-8304-4f67-b1b1-fcc7576d6e1d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:41.525458 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a5f03-8304-4f67-b1b1-fcc7576d6e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:41.525944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a5f03-8304-4f67-b1b1-fcc7576d6e1d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:41.526747 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a5f03-8304-4f67-b1b1-fcc7576d6e1d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:41.528341 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a5f03-8304-4f67-b1b1-fcc7576d6e1d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:41.539810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b24a5f03-8304-4f67-b1b1-fcc7576d6e1d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 13:02:41.539810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:41.539810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:02:41.539810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:02:41.539810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:02:41.539810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:02:41.539810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:02:41.539810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:02:41.539810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 13:02:41.539810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:41.539810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:02:41.539810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:41.539810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:41.539810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:41.539810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:41.539810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:41.539810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:41.540938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:41.540938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:41.540938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:41.540938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:41.540938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:41.540938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:41.540938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:02:41.540938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:02:41.540938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:02:41.540938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:02:41.540938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:41.540938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:41.540938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:41.540938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:41.540938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:41.540938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:41.541830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:41.541830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:41.541830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:41.541830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:41.541830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:41.541830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:41.541830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:41.541830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:41.541830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:41.541830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:41.541830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:02:41.541830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:02:41.541830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 13:02:41.541830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:41.549182 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 356/699] 10.222.0.46 () {56 vars in 1129 bytes} [Wed Aug 10 13:02:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:41.550334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a5f03-8304-4f67-b1b1-fcc7576d6e1d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:41.606070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 344/700] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:41.606070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b19f78-5daa-4ca1-b694-c3964b01bba7 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:41.680516 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a5f03-8304-4f67-b1b1-fcc7576d6e1d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:41.716534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565fa6d-4865-4d95-af83-2195ad7e7010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:41.717140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565fa6d-4865-4d95-af83-2195ad7e7010 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:41.717417 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565fa6d-4865-4d95-af83-2195ad7e7010 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:41.717688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565fa6d-4865-4d95-af83-2195ad7e7010 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:41.718370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565fa6d-4865-4d95-af83-2195ad7e7010 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:41.718672 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565fa6d-4865-4d95-af83-2195ad7e7010 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:41.720374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565fa6d-4865-4d95-af83-2195ad7e7010 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:41.723611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:41.727979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b19f78-5daa-4ca1-b694-c3964b01bba7 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:41.737847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 357/701] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:02:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:41.737847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565fa6d-4865-4d95-af83-2195ad7e7010 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:41.763029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:41.775628 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b89895-4973-4ae8-bc5b-72ca54173be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:41.776718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b89895-4973-4ae8-bc5b-72ca54173be9 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:41.777258 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b89895-4973-4ae8-bc5b-72ca54173be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:41.777731 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b89895-4973-4ae8-bc5b-72ca54173be9 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:41.778715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b89895-4973-4ae8-bc5b-72ca54173be9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:41.779284 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b89895-4973-4ae8-bc5b-72ca54173be9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:41.780940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b89895-4973-4ae8-bc5b-72ca54173be9 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:41.786609 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 345/702] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Aug 10 13:02:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:41.787695 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b89895-4973-4ae8-bc5b-72ca54173be9 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:41.837764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565fa6d-4865-4d95-af83-2195ad7e7010 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:41.874815 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55febb24-c5eb-48a9-a905-00329014ea3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:41.875719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55febb24-c5eb-48a9-a905-00329014ea3a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:41.875922 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55febb24-c5eb-48a9-a905-00329014ea3a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:41.876202 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55febb24-c5eb-48a9-a905-00329014ea3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:41.887786 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55febb24-c5eb-48a9-a905-00329014ea3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:41.889302 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55febb24-c5eb-48a9-a905-00329014ea3a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:41.900705 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b89895-4973-4ae8-bc5b-72ca54173be9 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:41.905559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-55febb24-c5eb-48a9-a905-00329014ea3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:41.905559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:41.905559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:41.905559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:41.905559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:41.905559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:41.905559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:41.905559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:41.905559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:41.905559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:41.905559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:41.905559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:41.905559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:41.905559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:41.905559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:41.905559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:41.906589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:41.906589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:41.906589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:41.906589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:41.906589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:41.906589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:41.906589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:41.906589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:41.906589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:41.906589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:41.906589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:41.906589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:41.906589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:41.906589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:41.906589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:41.906589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:41.906589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:41.907526 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:41.907526 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:41.907526 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:41.907526 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 358/703] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:41.908195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55febb24-c5eb-48a9-a905-00329014ea3a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:41.943869 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da4594-2157-402a-812b-aaf03bbd2d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:41.945077 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da4594-2157-402a-812b-aaf03bbd2d37 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:41.945561 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da4594-2157-402a-812b-aaf03bbd2d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:41.946062 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da4594-2157-402a-812b-aaf03bbd2d37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:41.947030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da4594-2157-402a-812b-aaf03bbd2d37 None admin] RBAC: Adding query filter params (role.id=434a1fd874d24b959bf48fe61633f240, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=5c86ef66c9564e0395c325a84ca9c4a5) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:41.947550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da4594-2157-402a-812b-aaf03bbd2d37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:41.949401 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da4594-2157-402a-812b-aaf03bbd2d37 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:41.960800 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 346/704] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:02:41 2022] GET /identity/v3/role_assignments?user.id=5c86ef66c9564e0395c325a84ca9c4a5&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=434a1fd874d24b959bf48fe61633f240 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:41.962160 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da4594-2157-402a-812b-aaf03bbd2d37 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:42.011046 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:42.012553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:42.030825 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55febb24-c5eb-48a9-a905-00329014ea3a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:42.073135 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f10a4-0f52-44b8-8dce-dbad39b14ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:42.073760 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f10a4-0f52-44b8-8dce-dbad39b14ccb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:42.074040 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f10a4-0f52-44b8-8dce-dbad39b14ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:42.074319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f10a4-0f52-44b8-8dce-dbad39b14ccb None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:42.074956 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f10a4-0f52-44b8-8dce-dbad39b14ccb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:42.075304 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f10a4-0f52-44b8-8dce-dbad39b14ccb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:42.076900 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f10a4-0f52-44b8-8dce-dbad39b14ccb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:42.083987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 359/705] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Aug 10 13:02:41 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:42.085503 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b03fe-c0a4-47d3-a93b-7be160fd2699 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:42.085788 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b03fe-c0a4-47d3-a93b-7be160fd2699 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:42.086060 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b03fe-c0a4-47d3-a93b-7be160fd2699 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:42.091501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 360/706] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:42.094639 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369593a-fc46-4093-8561-9ce37c1570cb None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:42.094859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369593a-fc46-4093-8561-9ce37c1570cb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:42.095182 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369593a-fc46-4093-8561-9ce37c1570cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:42.107207 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da4594-2157-402a-812b-aaf03bbd2d37 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:42.115926 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a369593a-fc46-4093-8561-9ce37c1570cb None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:42.117466 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a369593a-fc46-4093-8561-9ce37c1570cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:42.164580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8f4f0-89a4-49dd-bfda-8b62e1f854f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:42.165218 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8f4f0-89a4-49dd-bfda-8b62e1f854f5 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:42.165500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8f4f0-89a4-49dd-bfda-8b62e1f854f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:42.165774 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8f4f0-89a4-49dd-bfda-8b62e1f854f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:42.166448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8f4f0-89a4-49dd-bfda-8b62e1f854f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:42.166816 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8f4f0-89a4-49dd-bfda-8b62e1f854f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:42.170581 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8f4f0-89a4-49dd-bfda-8b62e1f854f5 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:42.191795 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 347/707] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:42.197497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8f4f0-89a4-49dd-bfda-8b62e1f854f5 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:42.215589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 361/708] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 13:02:42.249357 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369593a-fc46-4093-8561-9ce37c1570cb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:42.316003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:42.326814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8f4f0-89a4-49dd-bfda-8b62e1f854f5 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:42.340176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:42.374248 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8ded9-6ae7-45e7-a013-40436c5ec924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:42.374664 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369593a-fc46-4093-8561-9ce37c1570cb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:42.374958 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8ded9-6ae7-45e7-a013-40436c5ec924 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:42.375282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8ded9-6ae7-45e7-a013-40436c5ec924 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:42.375556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8ded9-6ae7-45e7-a013-40436c5ec924 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:42.384977 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8ded9-6ae7-45e7-a013-40436c5ec924 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:42.387060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8ded9-6ae7-45e7-a013-40436c5ec924 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:42.402690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-05e8ded9-6ae7-45e7-a013-40436c5ec924 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:42.402690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:42.402690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:42.402690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:42.402690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:42.402690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:42.402690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:42.402690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:42.402690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:42.402690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:42.402690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:42.402690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:42.402690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:02:42.402690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:02:42.402690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:02:42.403699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:02:42.403699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:42.403699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:42.403699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:42.403699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:42.403699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:42.403699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:42.403699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:42.403699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:42.403699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:42.403699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:42.403699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:42.403699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:42.403699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:42.403699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:42.403699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:42.403699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:42.404962 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:02:42.404962 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:02:42.404962 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:02:42.404962 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:02:42.404962 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:02:42.404962 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:02:42.404962 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:42.404962 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:42.404962 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 348/709] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:42.409721 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8ded9-6ae7-45e7-a013-40436c5ec924 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:42.414720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df977026-4e40-4636-9cc8-30cb51c9f1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:42.415396 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df977026-4e40-4636-9cc8-30cb51c9f1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:42.415677 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df977026-4e40-4636-9cc8-30cb51c9f1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:42.415952 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df977026-4e40-4636-9cc8-30cb51c9f1b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:42.426396 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df977026-4e40-4636-9cc8-30cb51c9f1b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:42.428123 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df977026-4e40-4636-9cc8-30cb51c9f1b8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:42.445732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-df977026-4e40-4636-9cc8-30cb51c9f1b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:42.445732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:42.445732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:42.445732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:42.445732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:42.445732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:42.445732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:42.445732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:42.445732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:42.445732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:42.445732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:42.445732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:42.445732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:42.445732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:42.445732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:42.445732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:42.446757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:42.446757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:42.446757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:42.446757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:42.446757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:42.446757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:42.446757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:42.446757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:42.446757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:42.446757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:42.446757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:42.446757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:42.446757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:42.446757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:42.446757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:42.446757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:42.446757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:42.447684 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:42.447684 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:42.447684 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:42.451245 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 362/710] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:02:42.452989 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df977026-4e40-4636-9cc8-30cb51c9f1b8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:42.569058 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df977026-4e40-4636-9cc8-30cb51c9f1b8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:42.616800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:42.651718 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf603d-12db-4b49-9c9d-b883a5c10bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:42.652718 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf603d-12db-4b49-9c9d-b883a5c10bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:42.653202 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf603d-12db-4b49-9c9d-b883a5c10bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:42.653697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf603d-12db-4b49-9c9d-b883a5c10bd8 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:42.654607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf603d-12db-4b49-9c9d-b883a5c10bd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:42.655182 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf603d-12db-4b49-9c9d-b883a5c10bd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:42.656755 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf603d-12db-4b49-9c9d-b883a5c10bd8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:42.665816 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8ded9-6ae7-45e7-a013-40436c5ec924 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:42.685644 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 363/711] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:02:42.696009 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf603d-12db-4b49-9c9d-b883a5c10bd8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:42.712770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be66b6-97bb-4913-9198-056278affcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:42.713460 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be66b6-97bb-4913-9198-056278affcbe None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:42.713737 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be66b6-97bb-4913-9198-056278affcbe None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:42.713995 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be66b6-97bb-4913-9198-056278affcbe None admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:42.714692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be66b6-97bb-4913-9198-056278affcbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:42.715025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be66b6-97bb-4913-9198-056278affcbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:42.716770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be66b6-97bb-4913-9198-056278affcbe None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:42.741357 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 349/712] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:02:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:42.748121 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be66b6-97bb-4913-9198-056278affcbe None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:42.768024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:42.889227 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf603d-12db-4b49-9c9d-b883a5c10bd8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:42.894131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be66b6-97bb-4913-9198-056278affcbe None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:42.954472 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a63933-3181-4a8e-8ca2-3addc0bad3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:42.955118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a63933-3181-4a8e-8ca2-3addc0bad3ba None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:42.955615 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a63933-3181-4a8e-8ca2-3addc0bad3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:42.955888 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a63933-3181-4a8e-8ca2-3addc0bad3ba None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:42.956530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a63933-3181-4a8e-8ca2-3addc0bad3ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:42.958057 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a63933-3181-4a8e-8ca2-3addc0bad3ba None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:42.966383 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e5b40-534f-4549-b7d0-8ebc05ce85ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:42.966994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e5b40-534f-4549-b7d0-8ebc05ce85ad None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:42.967292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e5b40-534f-4549-b7d0-8ebc05ce85ad None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:42.967563 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e5b40-534f-4549-b7d0-8ebc05ce85ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:42.968281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e5b40-534f-4549-b7d0-8ebc05ce85ad None admin] RBAC: Adding query filter params (role.id=d9c9200468cb4f7ab6a23882bfb1f062, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=7fd0f76f24ea481191dfd65fff2376af) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:42.971701 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e5b40-534f-4549-b7d0-8ebc05ce85ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:42.973126 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e5b40-534f-4549-b7d0-8ebc05ce85ad None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:42.990096 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 350/713] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:02:42 2022] GET /identity/v3/role_assignments?user.id=7fd0f76f24ea481191dfd65fff2376af&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=d9c9200468cb4f7ab6a23882bfb1f062 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:43.017910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 364/714] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 10 13:02:42 2022] POST /identity/v3/users => generated 254 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:02:43.021584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b337e-a54c-49ed-acca-74be046e3e1c None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:43.021867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b337e-a54c-49ed-acca-74be046e3e1c None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:43.022138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b337e-a54c-49ed-acca-74be046e3e1c None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:43.023919 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 351/715] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:43.040972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317d1d5-ec6c-4b37-bf21-242c6b164ead None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:43.041446 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317d1d5-ec6c-4b37-bf21-242c6b164ead None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:43.041824 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317d1d5-ec6c-4b37-bf21-242c6b164ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:43.073860 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2317d1d5-ec6c-4b37-bf21-242c6b164ead None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:43.075366 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2317d1d5-ec6c-4b37-bf21-242c6b164ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:43.128786 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:43.177920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 365/716] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:43.212130 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b337e-a54c-49ed-acca-74be046e3e1c None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:43.289910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:43.323407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b337e-a54c-49ed-acca-74be046e3e1c None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:43.359324 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8a0f5-b905-477f-9396-49f5a0fa3a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:43.359953 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8a0f5-b905-477f-9396-49f5a0fa3a02 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:43.360285 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8a0f5-b905-477f-9396-49f5a0fa3a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:43.360608 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8a0f5-b905-477f-9396-49f5a0fa3a02 None admin] PATH_INFO: `/v3/services/network` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:43.361191 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8a0f5-b905-477f-9396-49f5a0fa3a02 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:43.362666 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8a0f5-b905-477f-9396-49f5a0fa3a02 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:43.374551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-edc8a0f5-b905-477f-9396-49f5a0fa3a02 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 13:02:43.374551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:43.374551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:02:43.374551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:02:43.374551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:02:43.374551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:02:43.374551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:02:43.374551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:02:43.374551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 13:02:43.374551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:43.374551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:02:43.374551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:43.374551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:43.374551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:43.374551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:43.374551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:43.374551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:43.375726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:43.375726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:43.375726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:43.375726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:43.375726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:43.375726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:43.375726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:02:43.375726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:02:43.375726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:02:43.375726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:02:43.375726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:43.375726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:43.375726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:43.375726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:43.375726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:43.375726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:43.376625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:43.376625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:43.376625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:43.376625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:43.376625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:43.376625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:43.376625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:43.376625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:43.376625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:43.376625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:43.376625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:02:43.376625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:02:43.376625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 13:02:43.376625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:43.376625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 352/717] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:43 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:02:43.382561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317d1d5-ec6c-4b37-bf21-242c6b164ead None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:43.500104 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317d1d5-ec6c-4b37-bf21-242c6b164ead None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:43.542647 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a98db5-c034-4ff3-97fc-195759d41510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:43.543341 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98db5-c034-4ff3-97fc-195759d41510 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:43.543622 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98db5-c034-4ff3-97fc-195759d41510 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:43.543894 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98db5-c034-4ff3-97fc-195759d41510 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:43.544536 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a98db5-c034-4ff3-97fc-195759d41510 None admin] RBAC: Adding query filter params (name=network) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:43.544840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a98db5-c034-4ff3-97fc-195759d41510 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:43.546216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a98db5-c034-4ff3-97fc-195759d41510 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:43.551346 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 366/718] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 10 13:02:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:43.557553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8a0f5-b905-477f-9396-49f5a0fa3a02 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:43.683511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8a0f5-b905-477f-9396-49f5a0fa3a02 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:43.726434 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2489a1-e570-4eb4-897d-e4103dcd63f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:43.727067 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2489a1-e570-4eb4-897d-e4103dcd63f5 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:43.727348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2489a1-e570-4eb4-897d-e4103dcd63f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:43.727670 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2489a1-e570-4eb4-897d-e4103dcd63f5 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:43.728308 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2489a1-e570-4eb4-897d-e4103dcd63f5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:43.728607 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2489a1-e570-4eb4-897d-e4103dcd63f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:43.729961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2489a1-e570-4eb4-897d-e4103dcd63f5 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:43.737014 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:43.739956 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 353/719] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 10 13:02:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:44.629946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb9cef-74c7-40c3-8f87-7df42ac10bc1 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:44.630481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb9cef-74c7-40c3-8f87-7df42ac10bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:44.630588 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb9cef-74c7-40c3-8f87-7df42ac10bc1 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:44.632156 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 367/720] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:44.637675 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e87b6d-014e-4701-9120-2063d9ade931 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:44.638113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e87b6d-014e-4701-9120-2063d9ade931 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:44.638285 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e87b6d-014e-4701-9120-2063d9ade931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:44.657151 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-91e87b6d-014e-4701-9120-2063d9ade931 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:44.658360 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-91e87b6d-014e-4701-9120-2063d9ade931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:44.736098 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 354/721] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:44.759733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb9cef-74c7-40c3-8f87-7df42ac10bc1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:44.779398 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b159dec-32bb-4e33-ab7d-44415450de41 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:44.779722 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b159dec-32bb-4e33-ab7d-44415450de41 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:44.779940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b159dec-32bb-4e33-ab7d-44415450de41 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:44.781333 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 355/722] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:02:44.787694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaec038-ea7b-452a-b9f6-69fe850c572a None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:44.787974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaec038-ea7b-452a-b9f6-69fe850c572a None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:44.788234 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaec038-ea7b-452a-b9f6-69fe850c572a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:44.815817 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-ccaec038-ea7b-452a-b9f6-69fe850c572a None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:44.817844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-ccaec038-ea7b-452a-b9f6-69fe850c572a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:44.826146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:44.945515 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 356/723] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:44.950451 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb9cef-74c7-40c3-8f87-7df42ac10bc1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:44.980078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaec038-ea7b-452a-b9f6-69fe850c572a None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:45.017280 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63e6cb-1a2f-461c-8ba6-05a105a94900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:45.020137 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63e6cb-1a2f-461c-8ba6-05a105a94900 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:45.020646 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63e6cb-1a2f-461c-8ba6-05a105a94900 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:45.021928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63e6cb-1a2f-461c-8ba6-05a105a94900 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:45.043556 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63e6cb-1a2f-461c-8ba6-05a105a94900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:45.048889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-8d63e6cb-1a2f-461c-8ba6-05a105a94900 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:02:45.048889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:45.048889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:45.048889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:45.048889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:45.048889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:45.048889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:45.048889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:45.048889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:45.048889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:45.048889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:45.048889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:45.048889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:45.048889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:45.048889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:45.048889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:45.049850 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:45.049850 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:45.049850 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:45.049850 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:45.049850 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:45.049850 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:45.049850 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:45.049850 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:45.049850 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:45.049850 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:45.049850 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:45.049850 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:45.049850 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:45.049850 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:45.049850 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:45.049850 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:45.050720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:45.050720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:45.050720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:45.050720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:45.050720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:45.050720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:45.050720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:45.050720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:45.050720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:45.050720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:45.050720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:02:45.050720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:45.058368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 368/724] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:02:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:45.066338 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63e6cb-1a2f-461c-8ba6-05a105a94900 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:45.099367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:45.181683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaec038-ea7b-452a-b9f6-69fe850c572a None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:45.217241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:45.227874 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63e6cb-1a2f-461c-8ba6-05a105a94900 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:45.248768 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28dd6b-8fd7-423b-9eeb-0b1bf0fce020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:45.249381 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28dd6b-8fd7-423b-9eeb-0b1bf0fce020 None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:45.249651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28dd6b-8fd7-423b-9eeb-0b1bf0fce020 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:45.249916 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28dd6b-8fd7-423b-9eeb-0b1bf0fce020 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:45.250554 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28dd6b-8fd7-423b-9eeb-0b1bf0fce020 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:45.251927 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28dd6b-8fd7-423b-9eeb-0b1bf0fce020 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:45.280218 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 357/725] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 10 13:02:44 2022] POST /identity/v3/services => generated 251 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:02:45.297437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf451b0-6134-4162-9dc1-7dba020678fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:45.298055 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf451b0-6134-4162-9dc1-7dba020678fe None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:45.298331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf451b0-6134-4162-9dc1-7dba020678fe None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:45.298602 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf451b0-6134-4162-9dc1-7dba020678fe None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:45.299314 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf451b0-6134-4162-9dc1-7dba020678fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:45.299612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf451b0-6134-4162-9dc1-7dba020678fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:45.300996 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf451b0-6134-4162-9dc1-7dba020678fe None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:45.309949 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c9c29-0709-4704-8925-0acd3f1e30c9 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:45.310171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c9c29-0709-4704-8925-0acd3f1e30c9 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:45.310390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c9c29-0709-4704-8925-0acd3f1e30c9 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:45.312198 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 358/727] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:02:45.313011 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 369/727] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:02:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:45.320219 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf451b0-6134-4162-9dc1-7dba020678fe None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:45.320974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a21aa-29e3-42e6-a04d-cae7793fcb13 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:45.321459 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a21aa-29e3-42e6-a04d-cae7793fcb13 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:45.321974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a21aa-29e3-42e6-a04d-cae7793fcb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:45.358618 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-7b9a21aa-29e3-42e6-a04d-cae7793fcb13 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:45.363315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7b9a21aa-29e3-42e6-a04d-cae7793fcb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:45.480428 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 359/728] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:45 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:45.503613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a21aa-29e3-42e6-a04d-cae7793fcb13 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:45.504771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf451b0-6134-4162-9dc1-7dba020678fe None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:45.554912 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647de16-0141-4c37-b39f-8c6a2fec8233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:45.555625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647de16-0141-4c37-b39f-8c6a2fec8233 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:45.555907 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647de16-0141-4c37-b39f-8c6a2fec8233 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:45.556179 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647de16-0141-4c37-b39f-8c6a2fec8233 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:45.562412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:45.568952 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647de16-0141-4c37-b39f-8c6a2fec8233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:45.570682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647de16-0141-4c37-b39f-8c6a2fec8233 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:45.586136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-7647de16-0141-4c37-b39f-8c6a2fec8233 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:45.586136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:45.586136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:45.586136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:45.586136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:45.586136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:45.586136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:45.586136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:45.586136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:45.586136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:45.586136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:45.586136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:45.586136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:45.586136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:45.586136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:45.586136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:45.587149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:45.587149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:45.587149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:45.587149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:45.587149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:45.587149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:45.587149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:45.587149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:45.587149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:45.587149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:45.587149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:45.587149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:45.587149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:45.587149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:45.587149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:45.587149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:45.587149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:45.588059 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:45.588059 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:45.588059 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:45.588229 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 370/729] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:45.593315 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647de16-0141-4c37-b39f-8c6a2fec8233 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:45.604483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:45.618895 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a21aa-29e3-42e6-a04d-cae7793fcb13 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:45.703574 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647de16-0141-4c37-b39f-8c6a2fec8233 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:45.709169 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348085e-660b-4ce4-857e-1634b6092c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:45.709815 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348085e-660b-4ce4-857e-1634b6092c41 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:45.710096 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348085e-660b-4ce4-857e-1634b6092c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:45.710368 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348085e-660b-4ce4-857e-1634b6092c41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:45.736403 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348085e-660b-4ce4-857e-1634b6092c41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:45.740010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf685f-b487-4d31-bb47-5eb21c8265cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:45.740680 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf685f-b487-4d31-bb47-5eb21c8265cd None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:45.741020 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf685f-b487-4d31-bb47-5eb21c8265cd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:45.741297 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf685f-b487-4d31-bb47-5eb21c8265cd None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:45.741621 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-6348085e-660b-4ce4-857e-1634b6092c41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:02:45.741621 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:45.741621 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:45.741621 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:45.741621 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:45.741621 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:45.741621 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:45.741621 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:45.741621 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:45.741621 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:45.741621 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:45.741621 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:45.741621 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:45.741621 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:45.741621 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:45.741621 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:45.742528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:45.742528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:45.742528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:45.742528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:45.742528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:45.742528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:45.742528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:45.742528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:45.742528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:45.742528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:45.742528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:45.742528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:45.742528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:45.742528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:45.742528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:45.742528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:45.743412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:45.743412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:45.743412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:45.743412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:45.743412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:45.743412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:45.743412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:45.743412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:45.743412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:45.743412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:45.743412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:02:45.743412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:45.744057 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf685f-b487-4d31-bb47-5eb21c8265cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:45.744057 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf685f-b487-4d31-bb47-5eb21c8265cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:45.744057 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf685f-b487-4d31-bb47-5eb21c8265cd None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:45.751177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 360/730] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:02:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:02:45.762580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348085e-660b-4ce4-857e-1634b6092c41 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:45.762882 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 371/731] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:02:45.767901 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf685f-b487-4d31-bb47-5eb21c8265cd None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:45.860068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:45.900638 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf685f-b487-4d31-bb47-5eb21c8265cd None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:45.955938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348085e-660b-4ce4-857e-1634b6092c41 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:45.957679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348d3ac-f3b7-476d-8507-35f76a7a6671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:45.958490 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348d3ac-f3b7-476d-8507-35f76a7a6671 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:45.959797 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348d3ac-f3b7-476d-8507-35f76a7a6671 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:45.960118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348d3ac-f3b7-476d-8507-35f76a7a6671 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:45.968636 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348d3ac-f3b7-476d-8507-35f76a7a6671 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:45.969058 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:45.970867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348d3ac-f3b7-476d-8507-35f76a7a6671 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:45.987411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-3348d3ac-f3b7-476d-8507-35f76a7a6671 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 13:02:45.987411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:45.987411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:45.987411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:45.987411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:45.987411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:45.987411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:45.987411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:45.987411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:45.987411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:45.987411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:45.987411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:45.987411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:45.987411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:45.987411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:45.987411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:45.988319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:45.988319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:45.988319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:45.988319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:45.988319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:45.988319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:45.988319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:45.988319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:45.988319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:45.988319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:45.988319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:45.988319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:45.988319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:45.988319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:45.988319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:45.988319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:45.988319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:45.988319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:45.989820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:45.989820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:45.989820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:45.989820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:45.989820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:45.989820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:45.989820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:45.989820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:45.989820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 13:02:45.989820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:45.989820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 372/732] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:02:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:45.990439 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7314f-f5e9-406d-ba03-0988273cccb9 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:45.991177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7314f-f5e9-406d-ba03-0988273cccb9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:45.991177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7314f-f5e9-406d-ba03-0988273cccb9 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:45.998697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 373/733] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:45.998697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7314f-f5e9-406d-ba03-0988273cccb9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:46.011237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcf0d5-d3e0-418c-a7ea-f6caa0b1e2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:46.011846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcf0d5-d3e0-418c-a7ea-f6caa0b1e2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:46.012122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcf0d5-d3e0-418c-a7ea-f6caa0b1e2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:46.012389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcf0d5-d3e0-418c-a7ea-f6caa0b1e2f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:46.013634 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfcf0d5-d3e0-418c-a7ea-f6caa0b1e2f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:46.013947 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfcf0d5-d3e0-418c-a7ea-f6caa0b1e2f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:46.015338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfcf0d5-d3e0-418c-a7ea-f6caa0b1e2f3 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:46.031176 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 361/734] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:02:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:46.032853 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686860b0-10be-4409-a231-f76693ee005d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:46.033141 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686860b0-10be-4409-a231-f76693ee005d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:46.033413 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686860b0-10be-4409-a231-f76693ee005d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:46.052809 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-686860b0-10be-4409-a231-f76693ee005d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:46.054017 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-686860b0-10be-4409-a231-f76693ee005d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:46.126590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7314f-f5e9-406d-ba03-0988273cccb9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:46.135202 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 362/735] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:46.136174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686860b0-10be-4409-a231-f76693ee005d None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:46.159376 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:46.171128 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235d0aa-c8f5-4aa2-821c-d71c5de69afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:46.172213 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235d0aa-c8f5-4aa2-821c-d71c5de69afa None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:46.172817 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235d0aa-c8f5-4aa2-821c-d71c5de69afa None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:46.173294 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235d0aa-c8f5-4aa2-821c-d71c5de69afa None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:46.174224 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235d0aa-c8f5-4aa2-821c-d71c5de69afa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:46.174843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235d0aa-c8f5-4aa2-821c-d71c5de69afa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:46.177209 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235d0aa-c8f5-4aa2-821c-d71c5de69afa None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:46.197278 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 374/736] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Aug 10 13:02:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:46.198612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235d0aa-c8f5-4aa2-821c-d71c5de69afa None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:46.252344 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686860b0-10be-4409-a231-f76693ee005d None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:46.253789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:46.290830 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a67af0-10a9-44fb-9754-5f079c46f06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:46.291506 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a67af0-10a9-44fb-9754-5f079c46f06e None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:46.291775 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a67af0-10a9-44fb-9754-5f079c46f06e None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:46.292073 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a67af0-10a9-44fb-9754-5f079c46f06e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:46.303133 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a67af0-10a9-44fb-9754-5f079c46f06e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:46.304679 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a67af0-10a9-44fb-9754-5f079c46f06e None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:46.313170 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235d0aa-c8f5-4aa2-821c-d71c5de69afa None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:46.320641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-44a67af0-10a9-44fb-9754-5f079c46f06e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:46.320641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:46.320641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:46.320641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:46.320641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:46.320641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:46.320641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:46.320641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:46.320641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:46.320641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:46.320641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:46.320641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:46.320641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:46.320641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:46.320641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:46.320641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:46.321707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:46.321707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:46.321707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:46.321707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:46.321707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:46.321707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:46.321707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:46.321707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:46.321707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:46.321707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:46.321707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:46.321707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:46.321707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:46.321707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:46.321707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:46.321707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:46.321707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:46.323235 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:46.323235 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:46.323235 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:46.326450 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 363/737] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:46.327461 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a67af0-10a9-44fb-9754-5f079c46f06e None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:46.356475 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5dc78-1850-4776-a826-e6fc93d8cbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:46.357525 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5dc78-1850-4776-a826-e6fc93d8cbdf None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:46.358029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5dc78-1850-4776-a826-e6fc93d8cbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:46.358603 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5dc78-1850-4776-a826-e6fc93d8cbdf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:46.370223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5dc78-1850-4776-a826-e6fc93d8cbdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:46.375047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b0c5dc78-1850-4776-a826-e6fc93d8cbdf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:46.375047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:46.375047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:46.375047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:46.375047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:46.375047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:46.375047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:46.375047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:46.375047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:46.375047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:46.375047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:46.375047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:46.375047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:46.375047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:46.375047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:46.375047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:46.375975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:46.375975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:46.375975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:46.375975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:46.375975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:46.375975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:46.375975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:46.375975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:46.375975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:46.375975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:46.375975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:46.375975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:46.375975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:46.375975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:46.375975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:46.375975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:46.376816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:46.376816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:46.376816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:46.376816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:46.376816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:46.376816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:46.376816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:46.376816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:46.376816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:46.376816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:46.376816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:46.376816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:46.379867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 375/738] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:02:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:46.381091 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5dc78-1850-4776-a826-e6fc93d8cbdf None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:46.433489 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:46.438623 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a67af0-10a9-44fb-9754-5f079c46f06e None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:46.473552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18df3c-33ea-4ca1-9118-09b8ef3bb535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:46.473911 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18df3c-33ea-4ca1-9118-09b8ef3bb535 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:46.474390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18df3c-33ea-4ca1-9118-09b8ef3bb535 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:46.474873 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18df3c-33ea-4ca1-9118-09b8ef3bb535 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:46.494118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5dc78-1850-4776-a826-e6fc93d8cbdf None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:46.502853 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:46.531734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf371e97-143c-4704-a4d3-5b9ab35509fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:46.532347 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf371e97-143c-4704-a4d3-5b9ab35509fc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:46.532627 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf371e97-143c-4704-a4d3-5b9ab35509fc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:46.532900 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf371e97-143c-4704-a4d3-5b9ab35509fc None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:46.533540 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf371e97-143c-4704-a4d3-5b9ab35509fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:46.533842 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf371e97-143c-4704-a4d3-5b9ab35509fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:46.535227 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf371e97-143c-4704-a4d3-5b9ab35509fc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:46.547855 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 376/739] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:46.553378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b043f32-cd98-46e9-99e2-d23d7d8bc0ad None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:46.553815 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18df3c-33ea-4ca1-9118-09b8ef3bb535 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:46.554280 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b043f32-cd98-46e9-99e2-d23d7d8bc0ad None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:46.554777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b043f32-cd98-46e9-99e2-d23d7d8bc0ad None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:46.556553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18df3c-33ea-4ca1-9118-09b8ef3bb535 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:46.556808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 377/740] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:46.557789 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b043f32-cd98-46e9-99e2-d23d7d8bc0ad None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:46.668653 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b043f32-cd98-46e9-99e2-d23d7d8bc0ad None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:46.670969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:46.672569 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 364/741] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:46 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:46.673529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18df3c-33ea-4ca1-9118-09b8ef3bb535 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:46.708059 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1ef57-2d3f-4b2e-8d0d-83c48b2186b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:46.708676 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1ef57-2d3f-4b2e-8d0d-83c48b2186b6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:46.708956 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1ef57-2d3f-4b2e-8d0d-83c48b2186b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:46.709230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1ef57-2d3f-4b2e-8d0d-83c48b2186b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:46.709895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1ef57-2d3f-4b2e-8d0d-83c48b2186b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:46.710196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1ef57-2d3f-4b2e-8d0d-83c48b2186b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:46.711598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1ef57-2d3f-4b2e-8d0d-83c48b2186b6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:46.725001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 378/742] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 10 13:02:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:46.725001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ff48d-ad55-4e56-8379-69a26f8718df None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:46.725001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ff48d-ad55-4e56-8379-69a26f8718df None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:46.725001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ff48d-ad55-4e56-8379-69a26f8718df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:46.736823 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:46.740883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e11ff48d-ad55-4e56-8379-69a26f8718df None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:46.742090 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e11ff48d-ad55-4e56-8379-69a26f8718df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:46.785070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18df3c-33ea-4ca1-9118-09b8ef3bb535 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:46.812659 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 379/743] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 13:02:46.813882 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ff48d-ad55-4e56-8379-69a26f8718df None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:46.827849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045d1c5-4948-4cd5-b1a0-64f6e1349711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:46.828770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045d1c5-4948-4cd5-b1a0-64f6e1349711 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:46.829232 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045d1c5-4948-4cd5-b1a0-64f6e1349711 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:46.829722 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045d1c5-4948-4cd5-b1a0-64f6e1349711 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:46.839105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045d1c5-4948-4cd5-b1a0-64f6e1349711 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:46.840775 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045d1c5-4948-4cd5-b1a0-64f6e1349711 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:46.852544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-5045d1c5-4948-4cd5-b1a0-64f6e1349711 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 13:02:46.852544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:46.852544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:46.852544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:46.852544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:46.852544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:46.852544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:46.852544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:46.852544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:46.852544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:46.852544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:46.852544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:46.852544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:46.852544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:46.852544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:46.852544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:46.853538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:46.853538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:46.853538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:46.853538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:46.853538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:46.853538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:46.853538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:46.853538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:46.853538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:46.853538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:46.853538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:46.853538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:46.853538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:46.853538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:46.853538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:46.853538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:46.853538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:46.853538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:46.854559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:46.854559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:46.854559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:46.854559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:46.854559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:46.854559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:46.854559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:46.854559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:46.854559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 13:02:46.854559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:46.854559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 365/744] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Aug 10 13:02:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:46.854559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045d1c5-4948-4cd5-b1a0-64f6e1349711 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:46.921904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:46.928607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ff48d-ad55-4e56-8379-69a26f8718df None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:46.962394 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045d1c5-4948-4cd5-b1a0-64f6e1349711 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:46.965930 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16014b-a572-4af9-a19a-d1d124f7bc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:46.966564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16014b-a572-4af9-a19a-d1d124f7bc87 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:46.966844 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16014b-a572-4af9-a19a-d1d124f7bc87 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:46.967150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16014b-a572-4af9-a19a-d1d124f7bc87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:46.977896 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16014b-a572-4af9-a19a-d1d124f7bc87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:46.978051 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:46.979543 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16014b-a572-4af9-a19a-d1d124f7bc87 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:46.999900 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc72ce-c22f-4421-96bf-09c457343201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:47.000783 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc72ce-c22f-4421-96bf-09c457343201 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:47.001199 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc72ce-c22f-4421-96bf-09c457343201 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:47.001608 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc72ce-c22f-4421-96bf-09c457343201 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:47.003696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-7f16014b-a572-4af9-a19a-d1d124f7bc87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:47.003696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:47.003696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:47.003696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:47.003696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:47.003696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:47.003696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:47.003696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:47.003696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:47.003696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:47.003696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:47.003696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:47.003696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:47.003696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:47.003696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:47.003696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:47.009513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:47.009513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:47.009513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:47.009513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:47.009513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:47.009513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:47.009513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:47.009513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:47.009513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:47.009513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:47.009513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:47.009513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:47.009513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:47.009513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:47.009513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:47.009513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:47.009513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:47.010423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:47.010423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:47.010423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:47.010423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 380/745] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:47.010423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16014b-a572-4af9-a19a-d1d124f7bc87 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:47.021267 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc72ce-c22f-4421-96bf-09c457343201 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:47.022887 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc72ce-c22f-4421-96bf-09c457343201 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:47.038138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-6efc72ce-c22f-4421-96bf-09c457343201 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:47.038138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:47.038138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:47.038138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:47.038138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:47.038138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:47.038138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:47.038138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:47.038138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:47.038138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:47.038138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:47.038138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:47.038138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:47.038138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:47.038138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:47.038138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:47.039127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:47.039127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:47.039127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:47.039127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:47.039127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:47.039127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:47.039127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:47.039127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:47.039127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:47.039127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:47.039127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:47.039127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:47.039127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:47.039127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:47.039127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:47.039127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:47.039127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:47.040139 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:47.040139 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:47.040139 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:47.040139 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 366/746] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:47.040139 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc72ce-c22f-4421-96bf-09c457343201 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:47.117534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16014b-a572-4af9-a19a-d1d124f7bc87 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:47.150230 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc72ce-c22f-4421-96bf-09c457343201 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:47.154692 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33da516-03c8-4278-a2e2-7462807ae81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:47.155336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33da516-03c8-4278-a2e2-7462807ae81a None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:47.155672 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33da516-03c8-4278-a2e2-7462807ae81a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:47.155875 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33da516-03c8-4278-a2e2-7462807ae81a None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:47.156512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33da516-03c8-4278-a2e2-7462807ae81a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:47.157884 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33da516-03c8-4278-a2e2-7462807ae81a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:47.174504 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 381/747] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 10 13:02:47 2022] POST /identity/v3/services => generated 240 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:02:47.175362 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33da516-03c8-4278-a2e2-7462807ae81a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:47.196779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:47.215396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cccfd-4378-42e9-b50d-e1cafd1868e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:47.216373 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cccfd-4378-42e9-b50d-e1cafd1868e3 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:47.216802 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cccfd-4378-42e9-b50d-e1cafd1868e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:47.217223 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cccfd-4378-42e9-b50d-e1cafd1868e3 None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:47.218113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51cccfd-4378-42e9-b50d-e1cafd1868e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:47.218604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51cccfd-4378-42e9-b50d-e1cafd1868e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:47.220844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51cccfd-4378-42e9-b50d-e1cafd1868e3 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:47.248559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 367/748] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Aug 10 13:02:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:47.249757 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cccfd-4378-42e9-b50d-e1cafd1868e3 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:47.276322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:47.349349 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33da516-03c8-4278-a2e2-7462807ae81a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:47.377554 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cccfd-4378-42e9-b50d-e1cafd1868e3 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:47.397110 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4588e67-77e5-4d6c-bc5c-da0063da064c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:47.397981 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4588e67-77e5-4d6c-bc5c-da0063da064c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:47.398734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4588e67-77e5-4d6c-bc5c-da0063da064c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:47.398734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4588e67-77e5-4d6c-bc5c-da0063da064c None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:47.399196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4588e67-77e5-4d6c-bc5c-da0063da064c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:47.399705 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4588e67-77e5-4d6c-bc5c-da0063da064c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:47.401163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4588e67-77e5-4d6c-bc5c-da0063da064c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:47.417913 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 382/749] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:47.418580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4588e67-77e5-4d6c-bc5c-da0063da064c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:47.423339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222d77f-772b-4fde-a92b-f3496d6658ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:47.424149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222d77f-772b-4fde-a92b-f3496d6658ef None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:47.424336 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222d77f-772b-4fde-a92b-f3496d6658ef None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:47.424878 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222d77f-772b-4fde-a92b-f3496d6658ef None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:47.425229 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222d77f-772b-4fde-a92b-f3496d6658ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:47.425529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222d77f-772b-4fde-a92b-f3496d6658ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:47.427502 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222d77f-772b-4fde-a92b-f3496d6658ef None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:47.449976 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 368/750] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:47.451869 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222d77f-772b-4fde-a92b-f3496d6658ef None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:47.496492 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:47.533118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4588e67-77e5-4d6c-bc5c-da0063da064c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:47.561891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:47.570942 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba109aff-7954-42f7-b21e-4311c675bbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:47.571677 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba109aff-7954-42f7-b21e-4311c675bbc2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:47.571925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba109aff-7954-42f7-b21e-4311c675bbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:47.572195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba109aff-7954-42f7-b21e-4311c675bbc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:47.584085 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222d77f-772b-4fde-a92b-f3496d6658ef None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:47.584253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba109aff-7954-42f7-b21e-4311c675bbc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:47.585800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba109aff-7954-42f7-b21e-4311c675bbc2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:47.602561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-ba109aff-7954-42f7-b21e-4311c675bbc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:47.602561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:47.602561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:47.602561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:47.602561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:47.602561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:47.602561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:47.602561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:47.602561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:47.602561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:47.602561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:47.602561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:47.602561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:47.602561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:47.602561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:47.602561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:47.603589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:47.603589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:47.603589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:47.603589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:47.603589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:47.603589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:47.603589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:47.603589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:47.603589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:47.603589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:47.603589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:47.603589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:47.603589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:47.603589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:47.603589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:47.603589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:47.603589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:47.604520 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:47.604520 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:47.604520 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:47.606660 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 383/751] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:47.607597 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba109aff-7954-42f7-b21e-4311c675bbc2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:47.623570 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee5f68-800c-42c5-b5d2-eea573569f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:47.624210 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee5f68-800c-42c5-b5d2-eea573569f7c None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:47.624493 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee5f68-800c-42c5-b5d2-eea573569f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:47.624767 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee5f68-800c-42c5-b5d2-eea573569f7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:47.631587 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee5f68-800c-42c5-b5d2-eea573569f7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:47.633016 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee5f68-800c-42c5-b5d2-eea573569f7c None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:47.644167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-4eee5f68-800c-42c5-b5d2-eea573569f7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:47.644167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:47.644167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:47.644167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:47.644167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:47.644167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:47.644167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:47.644167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:47.644167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:47.644167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:47.644167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:47.644167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:47.644167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:02:47.644167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:02:47.644167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:02:47.645759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:02:47.645759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:47.645759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:47.645759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:47.645759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:47.645759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:47.645759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:47.645759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:47.645759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:47.645759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:47.645759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:47.645759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:47.645759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:47.645759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:47.645759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:47.645759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:47.645759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:47.646857 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:02:47.646857 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:02:47.646857 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:02:47.646857 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:02:47.646857 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:02:47.646857 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:02:47.646857 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:47.646857 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:47.650666 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 369/752] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:47.652026 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd0de0-b6c5-4942-9dab-bfc015864035 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:47.652316 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd0de0-b6c5-4942-9dab-bfc015864035 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:47.652595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd0de0-b6c5-4942-9dab-bfc015864035 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:47.658085 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 370/753] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:47.658085 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd0de0-b6c5-4942-9dab-bfc015864035 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:47.717596 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba109aff-7954-42f7-b21e-4311c675bbc2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:47.739443 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:47.754316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f3b1f-b020-4f46-9af5-6aa5928b268d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:47.755999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f3b1f-b020-4f46-9af5-6aa5928b268d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:47.755999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f3b1f-b020-4f46-9af5-6aa5928b268d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:47.755999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f3b1f-b020-4f46-9af5-6aa5928b268d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:47.764231 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f3b1f-b020-4f46-9af5-6aa5928b268d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:47.765676 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f3b1f-b020-4f46-9af5-6aa5928b268d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:47.771976 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd0de0-b6c5-4942-9dab-bfc015864035 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:47.777230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-d93f3b1f-b020-4f46-9af5-6aa5928b268d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 13:02:47.777230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:47.777230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:47.777230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:47.777230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:47.777230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:47.777230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:47.777230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:47.777230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:47.777230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:47.777230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:47.777230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:47.777230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:47.777230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:47.777230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:47.777230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:47.778183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:47.778183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:47.778183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:47.778183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:47.778183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:47.778183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:47.778183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:47.778183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:47.778183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:47.778183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:47.778183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:47.778183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:47.778183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:47.778183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:47.778183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:47.778183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:47.778183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:47.778183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:47.779150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:47.779150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:47.779150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:47.779150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:47.779150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:47.779150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:47.779150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:47.779150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:47.779150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 13:02:47.779150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:47.779150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 384/754] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Aug 10 13:02:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:47.779150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f3b1f-b020-4f46-9af5-6aa5928b268d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:47.811656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e1037-86e0-4ede-9bee-950aa9395c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:47.812276 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e1037-86e0-4ede-9bee-950aa9395c59 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:47.812535 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e1037-86e0-4ede-9bee-950aa9395c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:47.812853 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e1037-86e0-4ede-9bee-950aa9395c59 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:47.813435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e1037-86e0-4ede-9bee-950aa9395c59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:47.813738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e1037-86e0-4ede-9bee-950aa9395c59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:47.815125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e1037-86e0-4ede-9bee-950aa9395c59 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:47.825398 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:47.833968 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 371/755] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:47.835178 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623accab-4d87-485d-9f93-85d44c66b074 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:47.835467 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623accab-4d87-485d-9f93-85d44c66b074 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:47.835750 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623accab-4d87-485d-9f93-85d44c66b074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:47.853747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-623accab-4d87-485d-9f93-85d44c66b074 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:47.854866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-623accab-4d87-485d-9f93-85d44c66b074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:47.892971 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f3b1f-b020-4f46-9af5-6aa5928b268d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:47.930468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 372/756] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:02:47.931347 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623accab-4d87-485d-9f93-85d44c66b074 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:47.939986 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8679d8-1c7c-493a-a394-dc9f3cd1dcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:47.940604 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8679d8-1c7c-493a-a394-dc9f3cd1dcb7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:47.940878 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8679d8-1c7c-493a-a394-dc9f3cd1dcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:47.941144 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8679d8-1c7c-493a-a394-dc9f3cd1dcb7 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:47.943992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8679d8-1c7c-493a-a394-dc9f3cd1dcb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:47.944972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8679d8-1c7c-493a-a394-dc9f3cd1dcb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:47.946971 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8679d8-1c7c-493a-a394-dc9f3cd1dcb7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:47.962921 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 385/757] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:02:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:47.964364 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8679d8-1c7c-493a-a394-dc9f3cd1dcb7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:48.016256 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:48.049199 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623accab-4d87-485d-9f93-85d44c66b074 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:48.080186 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:48.085249 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8679d8-1c7c-493a-a394-dc9f3cd1dcb7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:48.086954 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436afcbd-57a0-4786-8dcc-3f52ca9f883a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:48.088111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436afcbd-57a0-4786-8dcc-3f52ca9f883a None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:48.088111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436afcbd-57a0-4786-8dcc-3f52ca9f883a None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:48.088314 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436afcbd-57a0-4786-8dcc-3f52ca9f883a None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:48.088893 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436afcbd-57a0-4786-8dcc-3f52ca9f883a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:48.089190 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436afcbd-57a0-4786-8dcc-3f52ca9f883a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:48.090596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436afcbd-57a0-4786-8dcc-3f52ca9f883a None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:48.114645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 373/758] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Aug 10 13:02:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:48.114645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436afcbd-57a0-4786-8dcc-3f52ca9f883a None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:48.220708 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436afcbd-57a0-4786-8dcc-3f52ca9f883a None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:48.239207 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdb6a9-e515-4b72-bfb6-7ead43e49211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:48.240122 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdb6a9-e515-4b72-bfb6-7ead43e49211 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:48.240589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdb6a9-e515-4b72-bfb6-7ead43e49211 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:48.240955 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdb6a9-e515-4b72-bfb6-7ead43e49211 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:48.247973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdb6a9-e515-4b72-bfb6-7ead43e49211 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:48.249503 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdb6a9-e515-4b72-bfb6-7ead43e49211 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:48.257725 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e7d00-23a9-42a0-9408-6cfd563cac42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:48.258352 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e7d00-23a9-42a0-9408-6cfd563cac42 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:48.258627 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e7d00-23a9-42a0-9408-6cfd563cac42 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:48.258897 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e7d00-23a9-42a0-9408-6cfd563cac42 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:48.259582 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e7d00-23a9-42a0-9408-6cfd563cac42 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:48.260902 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e7d00-23a9-42a0-9408-6cfd563cac42 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:48.261312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-41fdb6a9-e515-4b72-bfb6-7ead43e49211 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:48.261312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:48.261312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:48.261312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:48.261312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:48.261312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:48.261312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:48.261312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:48.261312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:48.261312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:48.261312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:48.261312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:48.261312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:02:48.261312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:02:48.261312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:02:48.262351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:02:48.262351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:48.262351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:48.262351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:48.262351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:48.262351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:48.262351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:48.262351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:48.262351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:48.262351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:48.262351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:48.262351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:48.262351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:48.262351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:48.262351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:48.262351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:48.262351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:48.263497 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:02:48.263497 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:02:48.263497 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:02:48.263497 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:02:48.263497 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:02:48.263497 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:02:48.263497 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:48.263497 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:48.269660 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 386/759] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:48.269660 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdb6a9-e515-4b72-bfb6-7ead43e49211 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:48.278011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-5f0e7d00-23a9-42a0-9408-6cfd563cac42 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 13:02:48.278011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:48.278011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:02:48.278011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:02:48.278011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:02:48.278011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:02:48.278011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:02:48.278011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:02:48.278011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 13:02:48.278011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:48.278011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:02:48.278011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:48.278011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:48.278011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:48.278011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:48.278011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:48.278011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:48.284938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:48.284938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:48.284938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:48.284938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:48.284938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:48.284938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:48.284938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:02:48.284938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:02:48.284938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:02:48.284938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:02:48.284938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:48.284938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:48.284938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:48.284938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:48.284938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:48.284938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:48.286101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:48.286101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:48.286101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:48.286101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:48.286101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:48.286101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:48.286101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:48.286101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:48.286101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:48.286101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:48.286101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:02:48.286101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:02:48.286101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 13:02:48.286101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:48.286101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 374/760] 10.222.0.46 () {56 vars in 1129 bytes} [Wed Aug 10 13:02:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:48.287317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e7d00-23a9-42a0-9408-6cfd563cac42 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:48.338414 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:48.380616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:48.383914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdb6a9-e515-4b72-bfb6-7ead43e49211 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:48.396253 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e7d00-23a9-42a0-9408-6cfd563cac42 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:48.422230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17939beb-1766-45ce-95b7-035637065aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:48.422835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17939beb-1766-45ce-95b7-035637065aac None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:48.423179 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17939beb-1766-45ce-95b7-035637065aac None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:48.423459 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17939beb-1766-45ce-95b7-035637065aac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:48.424177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17939beb-1766-45ce-95b7-035637065aac None admin] RBAC: Adding query filter params (role.id=d9c9200468cb4f7ab6a23882bfb1f062, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=5c86ef66c9564e0395c325a84ca9c4a5) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:48.424484 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17939beb-1766-45ce-95b7-035637065aac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:48.425918 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17939beb-1766-45ce-95b7-035637065aac None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:48.431793 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 387/761] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:02:48 2022] GET /identity/v3/role_assignments?user.id=5c86ef66c9564e0395c325a84ca9c4a5&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=d9c9200468cb4f7ab6a23882bfb1f062 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:48.440759 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17939beb-1766-45ce-95b7-035637065aac None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:48.444660 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d0ccd-29bd-43fe-b19f-00d8f958f02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:48.445594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d0ccd-29bd-43fe-b19f-00d8f958f02d None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:48.445875 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d0ccd-29bd-43fe-b19f-00d8f958f02d None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:48.446208 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d0ccd-29bd-43fe-b19f-00d8f958f02d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:48.529590 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d0ccd-29bd-43fe-b19f-00d8f958f02d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:48.531627 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d0ccd-29bd-43fe-b19f-00d8f958f02d None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:48.553740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17939beb-1766-45ce-95b7-035637065aac None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:48.595425 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472f625-06e8-4a0b-9cd1-54bda44bf128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:48.596045 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472f625-06e8-4a0b-9cd1-54bda44bf128 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:48.596326 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472f625-06e8-4a0b-9cd1-54bda44bf128 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:48.596600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472f625-06e8-4a0b-9cd1-54bda44bf128 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:48.597301 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472f625-06e8-4a0b-9cd1-54bda44bf128 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:48.597606 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472f625-06e8-4a0b-9cd1-54bda44bf128 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:48.599176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472f625-06e8-4a0b-9cd1-54bda44bf128 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:48.601314 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:48.613184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 388/762] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:02:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:48.614152 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472f625-06e8-4a0b-9cd1-54bda44bf128 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:48.646051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:48.664300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 375/763] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 13:02:48.665312 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d0ccd-29bd-43fe-b19f-00d8f958f02d None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:48.747989 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472f625-06e8-4a0b-9cd1-54bda44bf128 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:48.777065 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d0ccd-29bd-43fe-b19f-00d8f958f02d None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:48.800274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a9a85-25fc-44e4-9eff-7f166e927240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:48.801553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a9a85-25fc-44e4-9eff-7f166e927240 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:48.802460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a9a85-25fc-44e4-9eff-7f166e927240 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:48.803087 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a9a85-25fc-44e4-9eff-7f166e927240 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:48.804049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a9a85-25fc-44e4-9eff-7f166e927240 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:48.804782 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a9a85-25fc-44e4-9eff-7f166e927240 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:48.806996 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a9a85-25fc-44e4-9eff-7f166e927240 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:48.812905 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c36b9-ac9f-4900-93f4-479ddfff4b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:48.813463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 389/764] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Aug 10 13:02:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:48.813582 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c36b9-ac9f-4900-93f4-479ddfff4b32 None admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:48.813760 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c36b9-ac9f-4900-93f4-479ddfff4b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:48.814019 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c36b9-ac9f-4900-93f4-479ddfff4b32 None admin] PATH_INFO: `/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/7fd0f76f24ea481191dfd65fff2376af/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:48.814930 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a9a85-25fc-44e4-9eff-7f166e927240 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:48.821242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c36b9-ac9f-4900-93f4-479ddfff4b32 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aa2ccddadb54dd9b88ccc6cec98ae37, user_id=7fd0f76f24ea481191dfd65fff2376af, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:48.822668 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c36b9-ac9f-4900-93f4-479ddfff4b32 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:48.847173 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 376/765] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:02:48 2022] PUT /identity/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/7fd0f76f24ea481191dfd65fff2376af/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:02:48.848755 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c36b9-ac9f-4900-93f4-479ddfff4b32 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:48.873821 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:48.925204 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:48.940220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a9a85-25fc-44e4-9eff-7f166e927240 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:49.020490 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b5670-9757-46dd-af79-6be802eab0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:49.021134 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b5670-9757-46dd-af79-6be802eab0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:49.021414 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b5670-9757-46dd-af79-6be802eab0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:49.021675 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b5670-9757-46dd-af79-6be802eab0f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:49.039568 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b5670-9757-46dd-af79-6be802eab0f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:49.041054 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b5670-9757-46dd-af79-6be802eab0f3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:49.048703 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c36b9-ac9f-4900-93f4-479ddfff4b32 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:49.067392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-3d4b5670-9757-46dd-af79-6be802eab0f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:49.067392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:49.067392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:49.067392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:49.067392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:49.067392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:49.067392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:49.067392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:49.067392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:49.067392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:49.067392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:49.067392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:49.067392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:49.067392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:49.067392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:49.067392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:49.068494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:49.068494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:49.068494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:49.068494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:49.068494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:49.068494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:49.068494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:49.068494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:49.068494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:49.068494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:49.068494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:49.068494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:49.068494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:49.068494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:49.068494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:49.068494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:49.068494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:49.070122 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:49.070122 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:49.070122 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:49.070122 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 390/766] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:49.074643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b5670-9757-46dd-af79-6be802eab0f3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:49.116215 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15afee39-6c49-451d-9bca-cb27f564fc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:49.116838 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afee39-6c49-451d-9bca-cb27f564fc6b None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:49.117612 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afee39-6c49-451d-9bca-cb27f564fc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:49.117892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afee39-6c49-451d-9bca-cb27f564fc6b None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:49.118820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15afee39-6c49-451d-9bca-cb27f564fc6b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:49.119197 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15afee39-6c49-451d-9bca-cb27f564fc6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:49.121261 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15afee39-6c49-451d-9bca-cb27f564fc6b None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:49.128493 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 377/767] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Aug 10 13:02:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:49.137879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15afee39-6c49-451d-9bca-cb27f564fc6b None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:49.219591 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b5670-9757-46dd-af79-6be802eab0f3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:49.243566 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:49.267926 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15afee39-6c49-451d-9bca-cb27f564fc6b None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:49.273479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f283f7-a267-49bb-9787-6d2eef427162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:49.274301 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f283f7-a267-49bb-9787-6d2eef427162 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:49.274732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f283f7-a267-49bb-9787-6d2eef427162 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:49.275175 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f283f7-a267-49bb-9787-6d2eef427162 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:49.276071 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f283f7-a267-49bb-9787-6d2eef427162 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:49.276544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f283f7-a267-49bb-9787-6d2eef427162 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:49.278159 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f283f7-a267-49bb-9787-6d2eef427162 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:49.296891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:49.303181 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 391/768] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:49.308369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba371c-b05b-47eb-8cfa-340abe91dc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:49.309438 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f283f7-a267-49bb-9787-6d2eef427162 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:49.310207 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba371c-b05b-47eb-8cfa-340abe91dc05 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:49.311039 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba371c-b05b-47eb-8cfa-340abe91dc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:49.311829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba371c-b05b-47eb-8cfa-340abe91dc05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:49.314332 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba371c-b05b-47eb-8cfa-340abe91dc05 None admin] RBAC: Adding query filter params (interface=public, service_id=3a82cae4deb74eac95d3bccc71dc5412, region_id=RegionOne) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:49.314823 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba371c-b05b-47eb-8cfa-340abe91dc05 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:49.316386 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba371c-b05b-47eb-8cfa-340abe91dc05 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:49.336405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 378/769] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Aug 10 13:02:49 2022] GET /identity/v3/endpoints?service_id=3a82cae4deb74eac95d3bccc71dc5412&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:02:49.337883 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d72e7f-c038-43d5-aa11-3c2f2bd2aa43 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:49.342421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d72e7f-c038-43d5-aa11-3c2f2bd2aa43 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:49.342940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d72e7f-c038-43d5-aa11-3c2f2bd2aa43 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:49.344916 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 379/770] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:49.345802 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d72e7f-c038-43d5-aa11-3c2f2bd2aa43 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:49.442481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f283f7-a267-49bb-9787-6d2eef427162 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:49.489897 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d72e7f-c038-43d5-aa11-3c2f2bd2aa43 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:49.494247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15d9dc-64e5-4a3b-bf49-2f221333cb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:49.495078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15d9dc-64e5-4a3b-bf49-2f221333cb35 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:49.495532 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15d9dc-64e5-4a3b-bf49-2f221333cb35 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:49.495947 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15d9dc-64e5-4a3b-bf49-2f221333cb35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:49.503325 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15d9dc-64e5-4a3b-bf49-2f221333cb35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:49.505560 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15d9dc-64e5-4a3b-bf49-2f221333cb35 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:49.517235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-1f15d9dc-64e5-4a3b-bf49-2f221333cb35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:49.517235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:49.517235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:49.517235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:49.517235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:49.517235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:49.517235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:49.517235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:49.517235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:49.517235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:49.517235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:49.517235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:49.517235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:02:49.517235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:02:49.517235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:02:49.518239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:02:49.518239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:49.518239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:49.518239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:49.518239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:49.518239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:49.518239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:49.518239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:49.518239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:49.518239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:49.518239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:49.518239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:49.518239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:49.518239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:49.518239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:49.518239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:49.518239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:49.519202 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:02:49.519202 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:02:49.519202 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:02:49.519202 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:02:49.519202 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:02:49.519202 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:02:49.519202 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:49.519202 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:49.526560 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 392/771] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:49.528115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f64b3-0935-4fbf-86cc-3693eeee6a22 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:49.528615 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f64b3-0935-4fbf-86cc-3693eeee6a22 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:49.529092 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f64b3-0935-4fbf-86cc-3693eeee6a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:49.532188 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768cd74-faa1-4833-8517-39cd7bd7c26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:49.533041 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768cd74-faa1-4833-8517-39cd7bd7c26f None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:49.533389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768cd74-faa1-4833-8517-39cd7bd7c26f None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:49.533728 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768cd74-faa1-4833-8517-39cd7bd7c26f None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:49.534398 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768cd74-faa1-4833-8517-39cd7bd7c26f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:49.535971 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768cd74-faa1-4833-8517-39cd7bd7c26f None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:49.547041 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 380/772] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Aug 10 13:02:49 2022] GET /identity/v3/services => generated 772 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:49.547041 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768cd74-faa1-4833-8517-39cd7bd7c26f None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:49.548537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:49.560095 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c46f64b3-0935-4fbf-86cc-3693eeee6a22 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:49.561602 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c46f64b3-0935-4fbf-86cc-3693eeee6a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:49.686812 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768cd74-faa1-4833-8517-39cd7bd7c26f None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:49.727712 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f48b6-317d-42c6-9278-654e1257234c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:49.728540 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f48b6-317d-42c6-9278-654e1257234c None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:49.728823 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f48b6-317d-42c6-9278-654e1257234c None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:49.729097 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f48b6-317d-42c6-9278-654e1257234c None admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:49.729795 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f48b6-317d-42c6-9278-654e1257234c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:49.730100 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f48b6-317d-42c6-9278-654e1257234c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:49.731750 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f48b6-317d-42c6-9278-654e1257234c None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:49.732991 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:49.749448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 381/773] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:02:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:49.755473 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f48b6-317d-42c6-9278-654e1257234c None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:49.767350 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 393/774] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:02:49.800069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f64b3-0935-4fbf-86cc-3693eeee6a22 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:49.830596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:49.908490 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f48b6-317d-42c6-9278-654e1257234c None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:49.952542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05f3a8-03fc-471f-87cd-09cb4c16f3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:49.953700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05f3a8-03fc-471f-87cd-09cb4c16f3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:49.954211 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05f3a8-03fc-471f-87cd-09cb4c16f3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:49.954686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05f3a8-03fc-471f-87cd-09cb4c16f3a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:49.955647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05f3a8-03fc-471f-87cd-09cb4c16f3a9 None admin] RBAC: Adding query filter params (role.id=434a1fd874d24b959bf48fe61633f240, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=182eec86daa44cd48d6ef1c38f58e89d) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:49.956180 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05f3a8-03fc-471f-87cd-09cb4c16f3a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:49.957987 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05f3a8-03fc-471f-87cd-09cb4c16f3a9 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:49.964699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 382/775] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:02:49 2022] GET /identity/v3/role_assignments?user.id=182eec86daa44cd48d6ef1c38f58e89d&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=434a1fd874d24b959bf48fe61633f240 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:49.983071 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f64b3-0935-4fbf-86cc-3693eeee6a22 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:50.021709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5f082-5606-46ca-8066-6667cc13250a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:50.022350 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5f082-5606-46ca-8066-6667cc13250a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:50.022628 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5f082-5606-46ca-8066-6667cc13250a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:50.022903 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5f082-5606-46ca-8066-6667cc13250a None admin] PATH_INFO: `/v3/services/network` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:50.023541 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5f082-5606-46ca-8066-6667cc13250a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:50.024919 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5f082-5606-46ca-8066-6667cc13250a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:50.034222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-82e5f082-5606-46ca-8066-6667cc13250a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 13:02:50.034222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:50.034222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:02:50.034222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:02:50.034222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:02:50.034222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:02:50.034222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:02:50.034222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:02:50.034222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 13:02:50.034222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:50.034222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:02:50.034222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:50.034222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:50.034222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:50.034222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:50.034222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:50.034222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:50.035311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:50.035311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:50.035311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:50.035311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:50.035311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:50.035311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:50.035311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:02:50.035311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:02:50.035311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:02:50.035311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:02:50.035311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:50.035311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:50.035311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:50.035311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:50.035311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:50.035311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:50.036252 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:50.036252 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:50.036252 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:50.036252 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:50.036252 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:50.036252 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:50.036252 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:50.036252 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:50.036252 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:50.036252 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:50.036252 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:02:50.036252 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:02:50.036252 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 13:02:50.036252 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:50.036252 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 394/776] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:49 2022] GET /identity/v3/services/network => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:02:50.043291 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05f3a8-03fc-471f-87cd-09cb4c16f3a9 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:50.167404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05f3a8-03fc-471f-87cd-09cb4c16f3a9 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:50.197065 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:50.212322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c79bb-8033-446f-9d3b-894242b2ba4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:50.213287 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c79bb-8033-446f-9d3b-894242b2ba4e None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:50.213797 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c79bb-8033-446f-9d3b-894242b2ba4e None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:50.214274 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c79bb-8033-446f-9d3b-894242b2ba4e None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:50.215154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c79bb-8033-446f-9d3b-894242b2ba4e None admin] RBAC: Adding query filter params (name=network) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:50.215663 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c79bb-8033-446f-9d3b-894242b2ba4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:50.217227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c79bb-8033-446f-9d3b-894242b2ba4e None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:50.223466 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 383/777] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 10 13:02:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:50.229525 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5f082-5606-46ca-8066-6667cc13250a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:50.304964 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:50.369085 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5f082-5606-46ca-8066-6667cc13250a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:50.420400 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332173a-9837-4453-911e-fd862fd297cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:50.421407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332173a-9837-4453-911e-fd862fd297cd None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:50.421911 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332173a-9837-4453-911e-fd862fd297cd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:50.422385 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332173a-9837-4453-911e-fd862fd297cd None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:50.423272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332173a-9837-4453-911e-fd862fd297cd None admin] RBAC: Adding query filter params (type=network) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:50.423796 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332173a-9837-4453-911e-fd862fd297cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:50.425468 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332173a-9837-4453-911e-fd862fd297cd None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:50.435702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 395/778] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 10 13:02:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:50.442358 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c79bb-8033-446f-9d3b-894242b2ba4e None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:50.572268 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c79bb-8033-446f-9d3b-894242b2ba4e None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:50.615143 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd91f6f-b2db-4e6b-a400-c91fa713f0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:50.616173 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd91f6f-b2db-4e6b-a400-c91fa713f0af None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:50.616758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd91f6f-b2db-4e6b-a400-c91fa713f0af None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:50.617232 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd91f6f-b2db-4e6b-a400-c91fa713f0af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:50.618154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd91f6f-b2db-4e6b-a400-c91fa713f0af None admin] RBAC: Adding query filter params (interface=public, service_id=98d844b4ccbd40b3a7c5d0d4646bb6b2, region_id=RegionOne) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:50.618669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd91f6f-b2db-4e6b-a400-c91fa713f0af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:50.620302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd91f6f-b2db-4e6b-a400-c91fa713f0af None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:50.626302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 384/779] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Aug 10 13:02:50 2022] GET /identity/v3/endpoints?service_id=98d844b4ccbd40b3a7c5d0d4646bb6b2&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:50.632144 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332173a-9837-4453-911e-fd862fd297cd None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:50.767554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332173a-9837-4453-911e-fd862fd297cd None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:50.794184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:50.824445 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07e630-c408-4376-8e7e-5ef07b613817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:50.825423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07e630-c408-4376-8e7e-5ef07b613817 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:50.825935 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07e630-c408-4376-8e7e-5ef07b613817 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:50.826406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07e630-c408-4376-8e7e-5ef07b613817 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:50.827235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07e630-c408-4376-8e7e-5ef07b613817 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:50.828826 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07e630-c408-4376-8e7e-5ef07b613817 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:50.839822 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 396/780] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Aug 10 13:02:50 2022] GET /identity/v3/services => generated 772 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:50.847361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7a59b-69b0-462b-ac58-47efe47ba35d None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:50.848891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7a59b-69b0-462b-ac58-47efe47ba35d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:50.849384 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7a59b-69b0-462b-ac58-47efe47ba35d None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:50.851089 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 385/781] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:50.856992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66824a-72b6-424b-9d54-f66dfab93b14 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:50.857279 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66824a-72b6-424b-9d54-f66dfab93b14 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:50.857563 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66824a-72b6-424b-9d54-f66dfab93b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:50.883740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3d66824a-72b6-424b-9d54-f66dfab93b14 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:50.884971 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3d66824a-72b6-424b-9d54-f66dfab93b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:50.985767 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 397/782] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:02:51.024958 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7a59b-69b0-462b-ac58-47efe47ba35d None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:51.127831 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:51.182300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7a59b-69b0-462b-ac58-47efe47ba35d None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:51.226537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b39bc4-508d-4004-b15a-5f09ffe58468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:51.227284 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b39bc4-508d-4004-b15a-5f09ffe58468 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:51.227563 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b39bc4-508d-4004-b15a-5f09ffe58468 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:51.227841 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b39bc4-508d-4004-b15a-5f09ffe58468 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:51.242052 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b39bc4-508d-4004-b15a-5f09ffe58468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:51.246940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-a1b39bc4-508d-4004-b15a-5f09ffe58468 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:02:51.246940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:51.246940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:51.246940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:51.246940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:51.246940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:51.246940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:51.246940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:51.246940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:51.246940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:51.246940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:51.246940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:51.246940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:51.246940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:51.246940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:51.246940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:51.247974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:51.247974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:51.247974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:51.247974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:51.247974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:51.247974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:51.247974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:51.247974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:51.247974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:51.247974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:51.247974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:51.247974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:51.247974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:51.247974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:51.247974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:51.247974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:51.248833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:51.248833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:51.248833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:51.248833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:51.248833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:51.248833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:51.248833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:51.248833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:51.248833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:51.248833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:51.248833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:02:51.248833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:51.248833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 386/783] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:02:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:51.254517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66824a-72b6-424b-9d54-f66dfab93b14 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:51.365779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66824a-72b6-424b-9d54-f66dfab93b14 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:51.401116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8328c5d-a2a3-407a-bde0-1dc3e8c8167b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:51.401657 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8328c5d-a2a3-407a-bde0-1dc3e8c8167b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:51.402296 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:51.402819 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8328c5d-a2a3-407a-bde0-1dc3e8c8167b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:51.403309 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8328c5d-a2a3-407a-bde0-1dc3e8c8167b None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:51.404219 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8328c5d-a2a3-407a-bde0-1dc3e8c8167b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:51.404887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8328c5d-a2a3-407a-bde0-1dc3e8c8167b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:51.406740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8328c5d-a2a3-407a-bde0-1dc3e8c8167b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:51.416760 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 398/784] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:02:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:02:51.424125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b39bc4-508d-4004-b15a-5f09ffe58468 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:51.559792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b39bc4-508d-4004-b15a-5f09ffe58468 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:51.587212 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:51.614772 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383028f-abb5-4406-97fc-265e9748b5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:51.615463 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383028f-abb5-4406-97fc-265e9748b5ac None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:51.615741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383028f-abb5-4406-97fc-265e9748b5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:51.616015 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383028f-abb5-4406-97fc-265e9748b5ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:51.627929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383028f-abb5-4406-97fc-265e9748b5ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:51.629932 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383028f-abb5-4406-97fc-265e9748b5ac None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:51.650645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-8383028f-abb5-4406-97fc-265e9748b5ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:51.650645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:51.650645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:51.650645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:51.650645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:51.650645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:51.650645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:51.650645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:51.650645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:51.650645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:51.650645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:51.650645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:51.650645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:51.650645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:51.650645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:51.650645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:51.651735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:51.651735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:51.651735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:51.651735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:51.651735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:51.651735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:51.651735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:51.651735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:51.651735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:51.651735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:51.651735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:51.651735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:51.651735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:51.651735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:51.651735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:51.651735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:51.651735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:51.652672 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:51.652672 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:51.652672 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:51.652672 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 387/785] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:51.657524 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8328c5d-a2a3-407a-bde0-1dc3e8c8167b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:51.667246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61655c96-e19b-4183-b833-a66db9149107 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:51.667849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61655c96-e19b-4183-b833-a66db9149107 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:51.668327 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61655c96-e19b-4183-b833-a66db9149107 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:51.670742 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 388/786] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:02:51.689358 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4df568-ef95-4987-bd12-77e803cdd33c None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:51.690059 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4df568-ef95-4987-bd12-77e803cdd33c None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:51.690732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4df568-ef95-4987-bd12-77e803cdd33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:51.712626 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-5b4df568-ef95-4987-bd12-77e803cdd33c None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:51.714160 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-5b4df568-ef95-4987-bd12-77e803cdd33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:51.792950 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8328c5d-a2a3-407a-bde0-1dc3e8c8167b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:51.833216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ddc96-2c4b-4ba1-849a-8dfc9f0f1fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:51.833830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ddc96-2c4b-4ba1-849a-8dfc9f0f1fcc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:51.834111 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ddc96-2c4b-4ba1-849a-8dfc9f0f1fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:51.834450 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ddc96-2c4b-4ba1-849a-8dfc9f0f1fcc None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:51.839042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ddc96-2c4b-4ba1-849a-8dfc9f0f1fcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:51.839042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ddc96-2c4b-4ba1-849a-8dfc9f0f1fcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:51.839042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ddc96-2c4b-4ba1-849a-8dfc9f0f1fcc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:51.852380 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 399/787] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:51.857621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ddc96-2c4b-4ba1-849a-8dfc9f0f1fcc None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:51.898793 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:51.900622 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 389/788] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:02:51.940186 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4df568-ef95-4987-bd12-77e803cdd33c None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:51.971689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ddc96-2c4b-4ba1-849a-8dfc9f0f1fcc None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:52.023824 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575286c-88dd-48ad-8d47-b9094c2be8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:52.024847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575286c-88dd-48ad-8d47-b9094c2be8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:52.025295 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575286c-88dd-48ad-8d47-b9094c2be8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:52.025759 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575286c-88dd-48ad-8d47-b9094c2be8c6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:52.043832 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575286c-88dd-48ad-8d47-b9094c2be8c6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:52.047155 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575286c-88dd-48ad-8d47-b9094c2be8c6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:52.061862 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-6575286c-88dd-48ad-8d47-b9094c2be8c6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 13:02:52.061862 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:52.061862 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:52.061862 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:52.061862 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:52.061862 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:52.061862 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:52.061862 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:52.061862 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:52.061862 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:52.061862 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:52.061862 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:52.061862 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:52.061862 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:52.061862 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:52.061862 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:52.062846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:52.062846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:52.062846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:52.062846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:52.062846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:52.062846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:52.062846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:52.062846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:52.062846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:52.062846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:52.062846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:52.062846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:52.062846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:52.062846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:52.062846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:52.062846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:52.062846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:52.062846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:52.063836 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:52.063836 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:52.063836 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:52.063836 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:52.063836 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:52.063836 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:52.063836 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:52.063836 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:52.063836 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 13:02:52.063836 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:52.066624 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 400/789] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:02:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:52.068659 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db68ae9-0e64-40f4-9b84-85980450fada None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:52.069193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db68ae9-0e64-40f4-9b84-85980450fada None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:52.069612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db68ae9-0e64-40f4-9b84-85980450fada None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:52.071271 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 401/790] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:52.075861 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db68ae9-0e64-40f4-9b84-85980450fada None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:52.108444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:52.112663 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4df568-ef95-4987-bd12-77e803cdd33c None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:52.151178 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ec407-6ba7-4ee3-a9aa-9aade279badf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:52.151955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ec407-6ba7-4ee3-a9aa-9aade279badf None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:52.152333 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ec407-6ba7-4ee3-a9aa-9aade279badf None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:52.152713 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ec407-6ba7-4ee3-a9aa-9aade279badf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:52.164415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ec407-6ba7-4ee3-a9aa-9aade279badf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:52.169290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-371ec407-6ba7-4ee3-a9aa-9aade279badf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:02:52.169290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:52.169290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:52.169290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:52.169290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:52.169290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:52.169290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:52.169290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:52.169290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:52.169290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:52.169290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:52.169290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:52.169290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:52.169290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:52.169290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:52.169290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:52.170464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:52.170464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:52.170464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:52.170464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:52.170464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:52.170464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:52.170464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:52.170464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:52.170464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:52.170464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:52.170464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:52.170464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:52.170464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:52.170464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:52.170464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:52.170464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:52.171415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:52.171415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:52.171415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:52.171415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:52.171415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:52.171415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:52.171415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:52.171415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:52.171415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:52.171415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:52.171415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:02:52.171415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:52.172087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 390/791] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:02:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:52.173009 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b672cc-9eae-4729-b10a-8fce1d1d8d16 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:52.173473 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b672cc-9eae-4729-b10a-8fce1d1d8d16 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:52.173844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b672cc-9eae-4729-b10a-8fce1d1d8d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:52.188885 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:52.195870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-68b672cc-9eae-4729-b10a-8fce1d1d8d16 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:52.197320 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-68b672cc-9eae-4729-b10a-8fce1d1d8d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:52.198007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db68ae9-0e64-40f4-9b84-85980450fada None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:52.235483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c849e-4519-4540-b296-4a6feda27078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:52.236475 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c849e-4519-4540-b296-4a6feda27078 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:52.236905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c849e-4519-4540-b296-4a6feda27078 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:52.237374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c849e-4519-4540-b296-4a6feda27078 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:52.238291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c849e-4519-4540-b296-4a6feda27078 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:52.239342 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c849e-4519-4540-b296-4a6feda27078 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:52.241167 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c849e-4519-4540-b296-4a6feda27078 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:52.260535 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 402/792] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Aug 10 13:02:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:52.261857 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c849e-4519-4540-b296-4a6feda27078 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:52.270177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 391/793] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:02:52.276390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b672cc-9eae-4729-b10a-8fce1d1d8d16 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:52.370573 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c849e-4519-4540-b296-4a6feda27078 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:52.397267 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:52.410604 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917834e-334a-4809-a641-a204a3ab28cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:52.410816 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b672cc-9eae-4729-b10a-8fce1d1d8d16 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:52.411600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917834e-334a-4809-a641-a204a3ab28cc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:52.412065 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917834e-334a-4809-a641-a204a3ab28cc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:52.412586 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917834e-334a-4809-a641-a204a3ab28cc None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:52.413517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917834e-334a-4809-a641-a204a3ab28cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:52.414039 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917834e-334a-4809-a641-a204a3ab28cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:52.415664 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917834e-334a-4809-a641-a204a3ab28cc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:52.425285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 403/794] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:02:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:52.426502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917834e-334a-4809-a641-a204a3ab28cc None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:52.444499 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:52.449129 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af589bd-e584-456c-a996-c8b0d746850d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:52.449698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af589bd-e584-456c-a996-c8b0d746850d None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:52.449973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af589bd-e584-456c-a996-c8b0d746850d None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:52.450308 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af589bd-e584-456c-a996-c8b0d746850d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:52.462965 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af589bd-e584-456c-a996-c8b0d746850d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:52.464498 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af589bd-e584-456c-a996-c8b0d746850d None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:52.480613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-3af589bd-e584-456c-a996-c8b0d746850d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:52.480613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:52.480613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:52.480613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:52.480613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:52.480613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:52.480613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:52.480613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:52.480613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:52.480613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:52.480613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:52.480613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:52.480613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:52.480613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:52.480613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:52.480613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:52.481814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:52.481814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:52.481814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:52.481814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:52.481814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:52.481814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:52.481814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:52.481814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:52.481814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:52.481814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:52.481814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:52.481814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:52.481814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:52.481814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:52.481814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:52.481814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:52.481814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:52.482937 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:52.482937 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:52.482937 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:52.486411 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 392/795] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:52.487302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af589bd-e584-456c-a996-c8b0d746850d None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:52.540014 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917834e-334a-4809-a641-a204a3ab28cc None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:52.575200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ef30e-9c7c-4daa-b3fa-fa823e4f99f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:52.575934 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ef30e-9c7c-4daa-b3fa-fa823e4f99f7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:52.576331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ef30e-9c7c-4daa-b3fa-fa823e4f99f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:52.576680 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ef30e-9c7c-4daa-b3fa-fa823e4f99f7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:52.577274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ef30e-9c7c-4daa-b3fa-fa823e4f99f7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:52.578631 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ef30e-9c7c-4daa-b3fa-fa823e4f99f7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:52.590106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-ba5ef30e-9c7c-4daa-b3fa-fa823e4f99f7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 13:02:52.590106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:52.590106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:02:52.590106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:02:52.590106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:02:52.590106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:02:52.590106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:02:52.590106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:02:52.590106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 13:02:52.590106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:52.590106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:02:52.590106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:52.590106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:52.590106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:52.590106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:52.590106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:52.590106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:52.591514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:52.591514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:52.591514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:52.591514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:52.591514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:52.591514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:52.591514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:02:52.591514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:02:52.591514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:02:52.591514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:02:52.591514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:52.591514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:52.591514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:52.591514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:52.591514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:52.591514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:52.592592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:52.592592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:52.592592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:52.592592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:52.592592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:52.592592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:52.592592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:52.592592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:52.592592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:52.592592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:52.592592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:02:52.592592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:02:52.592592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 13:02:52.592592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:52.592592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 404/796] 10.222.0.46 () {56 vars in 1129 bytes} [Wed Aug 10 13:02:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:52.593955 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7534f-e40a-4a89-9b3a-3ad51eac1865 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:52.593955 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7534f-e40a-4a89-9b3a-3ad51eac1865 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:52.594102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7534f-e40a-4a89-9b3a-3ad51eac1865 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:52.602828 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 405/797] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:52.602828 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7534f-e40a-4a89-9b3a-3ad51eac1865 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:52.620704 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af589bd-e584-456c-a996-c8b0d746850d None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:52.658388 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb01db-78b0-4596-934c-6a797896e25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:52.659214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb01db-78b0-4596-934c-6a797896e25d None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:52.659796 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb01db-78b0-4596-934c-6a797896e25d None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:52.660067 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb01db-78b0-4596-934c-6a797896e25d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:52.669564 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:52.671922 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb01db-78b0-4596-934c-6a797896e25d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:52.673997 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb01db-78b0-4596-934c-6a797896e25d None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:52.689686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-5bdb01db-78b0-4596-934c-6a797896e25d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:52.689686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:52.689686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:52.689686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:52.689686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:52.689686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:52.689686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:52.689686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:52.689686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:52.689686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:52.689686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:52.689686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:52.689686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:52.689686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:52.689686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:52.689686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:52.690678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:52.690678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:52.690678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:52.690678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:52.690678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:52.690678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:52.690678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:52.690678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:52.690678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:52.690678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:52.690678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:52.690678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:52.690678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:52.690678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:52.690678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:52.690678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:52.690678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:52.692163 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:52.692163 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:52.692163 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:52.692163 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 393/798] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:52.692163 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb01db-78b0-4596-934c-6a797896e25d None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:52.702906 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:52.726390 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7534f-e40a-4a89-9b3a-3ad51eac1865 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:52.762788 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab5dc7-e948-4347-b4a0-2e08087256fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:52.763420 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab5dc7-e948-4347-b4a0-2e08087256fe None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:52.763749 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab5dc7-e948-4347-b4a0-2e08087256fe None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:52.764017 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab5dc7-e948-4347-b4a0-2e08087256fe None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:52.764648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab5dc7-e948-4347-b4a0-2e08087256fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:52.764996 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab5dc7-e948-4347-b4a0-2e08087256fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:52.766547 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab5dc7-e948-4347-b4a0-2e08087256fe None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:52.784597 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 406/799] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:52.784597 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39508b58-f175-4e54-bb38-f85aebcef910 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:52.784597 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39508b58-f175-4e54-bb38-f85aebcef910 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:52.784597 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39508b58-f175-4e54-bb38-f85aebcef910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:52.801614 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-39508b58-f175-4e54-bb38-f85aebcef910 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:52.802829 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-39508b58-f175-4e54-bb38-f85aebcef910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:52.809696 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb01db-78b0-4596-934c-6a797896e25d None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:52.852644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2785095-f13d-46c1-82b3-e18aec547d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:52.853261 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2785095-f13d-46c1-82b3-e18aec547d55 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:52.853542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2785095-f13d-46c1-82b3-e18aec547d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:52.853815 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2785095-f13d-46c1-82b3-e18aec547d55 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:52.854451 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2785095-f13d-46c1-82b3-e18aec547d55 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:52.854757 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2785095-f13d-46c1-82b3-e18aec547d55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:52.856144 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2785095-f13d-46c1-82b3-e18aec547d55 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:52.861180 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 394/800] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Aug 10 13:02:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:52.861825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2785095-f13d-46c1-82b3-e18aec547d55 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:52.895184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 407/801] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:02:52.896420 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39508b58-f175-4e54-bb38-f85aebcef910 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:52.940816 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:52.974727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:53.008066 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2785095-f13d-46c1-82b3-e18aec547d55 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:53.029588 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39508b58-f175-4e54-bb38-f85aebcef910 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:53.048394 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369d742-9b4e-468d-9340-f98cc0940b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:53.048998 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369d742-9b4e-468d-9340-f98cc0940b4b None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:53.049276 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369d742-9b4e-468d-9340-f98cc0940b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:53.049545 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369d742-9b4e-468d-9340-f98cc0940b4b None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:53.050190 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369d742-9b4e-468d-9340-f98cc0940b4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:53.050491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369d742-9b4e-468d-9340-f98cc0940b4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:53.051962 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369d742-9b4e-468d-9340-f98cc0940b4b None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:53.070030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 395/802] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:53.070030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369d742-9b4e-468d-9340-f98cc0940b4b None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:53.071290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e532872-b744-47d8-bcde-55f03d5abcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:53.071945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e532872-b744-47d8-bcde-55f03d5abcbd None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:53.072224 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e532872-b744-47d8-bcde-55f03d5abcbd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:53.072495 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e532872-b744-47d8-bcde-55f03d5abcbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:53.080358 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e532872-b744-47d8-bcde-55f03d5abcbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:53.082138 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e532872-b744-47d8-bcde-55f03d5abcbd None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:53.095423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-4e532872-b744-47d8-bcde-55f03d5abcbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:53.095423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:53.095423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:53.095423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:53.095423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:53.095423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:53.095423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:53.095423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:53.095423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:53.095423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:53.095423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:53.095423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:53.095423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:02:53.095423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:02:53.095423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:02:53.096590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:02:53.096590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:53.096590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:53.096590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:53.096590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:53.096590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:53.096590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:53.096590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:53.096590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:53.096590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:53.096590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:53.096590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:53.096590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:53.096590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:53.096590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:53.096590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:53.096590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:53.097509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:02:53.097509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:02:53.097509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:02:53.097509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:02:53.097509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:02:53.097509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:02:53.097509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:53.097509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:53.097509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 408/803] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:53.097998 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e532872-b744-47d8-bcde-55f03d5abcbd None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:53.187051 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369d742-9b4e-468d-9340-f98cc0940b4b None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:53.205484 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:53.210728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e532872-b744-47d8-bcde-55f03d5abcbd None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:53.226018 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba1404-e4ee-4726-9f5d-6daea260e51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:53.226702 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba1404-e4ee-4726-9f5d-6daea260e51a None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:53.227111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba1404-e4ee-4726-9f5d-6daea260e51a None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:53.227477 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba1404-e4ee-4726-9f5d-6daea260e51a None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:53.228200 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba1404-e4ee-4726-9f5d-6daea260e51a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:53.228607 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba1404-e4ee-4726-9f5d-6daea260e51a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:53.230059 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba1404-e4ee-4726-9f5d-6daea260e51a None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:53.235127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 396/804] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Aug 10 13:02:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:53.238944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:53.240418 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba1404-e4ee-4726-9f5d-6daea260e51a None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:53.248917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e8682-7147-4c16-b13b-6c53f3dce5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:53.249647 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e8682-7147-4c16-b13b-6c53f3dce5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:53.249999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e8682-7147-4c16-b13b-6c53f3dce5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:53.250334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e8682-7147-4c16-b13b-6c53f3dce5f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:53.262584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e8682-7147-4c16-b13b-6c53f3dce5f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:53.268075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-228e8682-7147-4c16-b13b-6c53f3dce5f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:53.268075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:53.268075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:53.268075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:53.268075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:53.268075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:53.268075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:53.268075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:53.268075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:53.268075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:53.268075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:53.268075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:53.268075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:53.268075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:53.268075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:53.268075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:53.269230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:53.269230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:53.269230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:53.269230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:53.269230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:53.269230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:53.269230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:53.269230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:53.269230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:53.269230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:53.269230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:53.269230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:53.269230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:53.269230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:53.269230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:53.269230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:53.270899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:53.270899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:53.270899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:53.270899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:53.270899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:53.270899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:53.270899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:53.270899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:53.270899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:53.270899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:53.270899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:53.270899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:53.271656 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 409/805] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:02:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:53.272374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e8682-7147-4c16-b13b-6c53f3dce5f7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:53.355426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba1404-e4ee-4726-9f5d-6daea260e51a None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:53.379598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e8682-7147-4c16-b13b-6c53f3dce5f7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:53.391755 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a10b4-5c0d-4823-a23f-8f93bc186d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:53.392398 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a10b4-5c0d-4823-a23f-8f93bc186d43 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:53.392670 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a10b4-5c0d-4823-a23f-8f93bc186d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:53.392942 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a10b4-5c0d-4823-a23f-8f93bc186d43 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:53.401348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a10b4-5c0d-4823-a23f-8f93bc186d43 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:53.402780 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a10b4-5c0d-4823-a23f-8f93bc186d43 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:53.415338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-f24a10b4-5c0d-4823-a23f-8f93bc186d43 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 13:02:53.415338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:53.415338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:53.415338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:53.415338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:53.415338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:53.415338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:53.415338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:53.415338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:53.415338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:53.415338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:53.415338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:53.415338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:53.415338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:53.415338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:53.415338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:53.416345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:53.416345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:53.416345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:53.416345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:53.416345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:53.416345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:53.416345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:53.416345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:53.416345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:53.416345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:53.416345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:53.416345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:53.416345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:53.416345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:53.416345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:53.416345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:53.416345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:53.416345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:53.417304 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:53.417304 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:53.417304 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:53.417304 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:53.417304 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:53.417304 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:53.417304 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:53.417304 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:53.417304 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 13:02:53.417304 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:53.417847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d326b-46c8-4596-bde6-526af0e581fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:53.417847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d326b-46c8-4596-bde6-526af0e581fe None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:53.417847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d326b-46c8-4596-bde6-526af0e581fe None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:53.417847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d326b-46c8-4596-bde6-526af0e581fe None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:53.418115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d326b-46c8-4596-bde6-526af0e581fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:53.418115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d326b-46c8-4596-bde6-526af0e581fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:53.419028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d326b-46c8-4596-bde6-526af0e581fe None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:53.421147 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 397/806] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Aug 10 13:02:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:53.422069 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a10b4-5c0d-4823-a23f-8f93bc186d43 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:53.431551 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 410/807] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:02:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:53.432375 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d326b-46c8-4596-bde6-526af0e581fe None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:53.464745 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:53.484919 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:53.524107 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a10b4-5c0d-4823-a23f-8f93bc186d43 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:53.534834 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d326b-46c8-4596-bde6-526af0e581fe None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:53.556688 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff0d3b-47ad-49db-bda6-9112937fd16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:53.557290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff0d3b-47ad-49db-bda6-9112937fd16e None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:53.557564 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff0d3b-47ad-49db-bda6-9112937fd16e None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:53.557832 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff0d3b-47ad-49db-bda6-9112937fd16e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:53.558479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff0d3b-47ad-49db-bda6-9112937fd16e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:53.559857 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff0d3b-47ad-49db-bda6-9112937fd16e None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:53.570740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03c88b-d8d4-4c95-868b-bd8471d9c450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:53.571492 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03c88b-d8d4-4c95-868b-bd8471d9c450 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:53.571916 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03c88b-d8d4-4c95-868b-bd8471d9c450 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:53.572098 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03c88b-d8d4-4c95-868b-bd8471d9c450 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:53.572749 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03c88b-d8d4-4c95-868b-bd8471d9c450 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:53.573098 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03c88b-d8d4-4c95-868b-bd8471d9c450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:53.574688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03c88b-d8d4-4c95-868b-bd8471d9c450 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:53.581681 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 398/808] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:02:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:02:53.582511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff0d3b-47ad-49db-bda6-9112937fd16e None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:53.593227 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 411/809] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 10 13:02:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:53.595714 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144d347-d4c7-4ce6-93f1-8aa01acab2b0 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:53.596612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144d347-d4c7-4ce6-93f1-8aa01acab2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:53.597080 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144d347-d4c7-4ce6-93f1-8aa01acab2b0 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:53.599317 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 412/810] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:53.601446 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144d347-d4c7-4ce6-93f1-8aa01acab2b0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:53.709890 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:53.724351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff0d3b-47ad-49db-bda6-9112937fd16e None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:53.731419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144d347-d4c7-4ce6-93f1-8aa01acab2b0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:53.749487 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:53.764094 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8f3af-6323-4fe3-87e8-8658fa222153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:53.764691 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8f3af-6323-4fe3-87e8-8658fa222153 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:53.764970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8f3af-6323-4fe3-87e8-8658fa222153 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:53.765238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8f3af-6323-4fe3-87e8-8658fa222153 None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:53.766027 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8f3af-6323-4fe3-87e8-8658fa222153 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:53.766264 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8f3af-6323-4fe3-87e8-8658fa222153 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:53.767698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8f3af-6323-4fe3-87e8-8658fa222153 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:53.782060 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c6d75-bd1f-4023-956b-a46829b59ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:53.782727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c6d75-bd1f-4023-956b-a46829b59ec9 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:53.783045 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c6d75-bd1f-4023-956b-a46829b59ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:53.783304 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c6d75-bd1f-4023-956b-a46829b59ec9 None admin] PATH_INFO: `/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/5c86ef66c9564e0395c325a84ca9c4a5/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:53.785864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c6d75-bd1f-4023-956b-a46829b59ec9 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aa2ccddadb54dd9b88ccc6cec98ae37, user_id=5c86ef66c9564e0395c325a84ca9c4a5, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:53.787387 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c6d75-bd1f-4023-956b-a46829b59ec9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:53.790279 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 399/811] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Aug 10 13:02:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:53.790928 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8f3af-6323-4fe3-87e8-8658fa222153 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:53.802714 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 413/812] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:02:53 2022] PUT /identity/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/5c86ef66c9564e0395c325a84ca9c4a5/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:02:53.804673 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f0ca2-4d8f-4644-aa0e-48ed633077c1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:53.805167 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f0ca2-4d8f-4644-aa0e-48ed633077c1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:53.805689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f0ca2-4d8f-4644-aa0e-48ed633077c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:53.836370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d00f0ca2-4d8f-4644-aa0e-48ed633077c1 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:53.837699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d00f0ca2-4d8f-4644-aa0e-48ed633077c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:53.922553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 414/813] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:02:53.922553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f0ca2-4d8f-4644-aa0e-48ed633077c1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:53.929874 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8f3af-6323-4fe3-87e8-8658fa222153 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:54.005390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34e65c-18f0-4efe-a170-360c85219258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:54.005390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34e65c-18f0-4efe-a170-360c85219258 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:54.005390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34e65c-18f0-4efe-a170-360c85219258 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:54.005390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34e65c-18f0-4efe-a170-360c85219258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:54.021512 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34e65c-18f0-4efe-a170-360c85219258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:54.023058 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34e65c-18f0-4efe-a170-360c85219258 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:54.033692 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:54.038027 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f0ca2-4d8f-4644-aa0e-48ed633077c1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:54.042516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-6d34e65c-18f0-4efe-a170-360c85219258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:54.042516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:54.042516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:54.042516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:54.042516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:54.042516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:54.042516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:54.042516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:54.042516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:54.042516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:54.042516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:54.042516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:54.042516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:54.042516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:54.042516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:54.042516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:54.043741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:54.043741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:54.043741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:54.043741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:54.043741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:54.043741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:54.043741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:54.043741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:54.043741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:54.043741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:54.043741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:54.043741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:54.043741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:54.043741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:54.043741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:54.043741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:54.043741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:54.044665 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:54.044665 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:54.044665 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:54.044665 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 400/814] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:54.044908 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34e65c-18f0-4efe-a170-360c85219258 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:54.053842 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:54.077721 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6276c4f-ffaa-49bf-9220-f8ee4825ff9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:54.078336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6276c4f-ffaa-49bf-9220-f8ee4825ff9e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:54.078616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6276c4f-ffaa-49bf-9220-f8ee4825ff9e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:54.078888 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6276c4f-ffaa-49bf-9220-f8ee4825ff9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:54.153009 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6276c4f-ffaa-49bf-9220-f8ee4825ff9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:54.154517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6276c4f-ffaa-49bf-9220-f8ee4825ff9e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:54.178312 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34e65c-18f0-4efe-a170-360c85219258 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:54.225332 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b6c24-6f43-464d-80db-aec9737a578b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:54.226565 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b6c24-6f43-464d-80db-aec9737a578b None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:54.226845 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b6c24-6f43-464d-80db-aec9737a578b None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:54.227423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b6c24-6f43-464d-80db-aec9737a578b None admin] PATH_INFO: `/v3/services/network` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:54.228025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b6c24-6f43-464d-80db-aec9737a578b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:54.230608 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b6c24-6f43-464d-80db-aec9737a578b None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:54.242910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-977b6c24-6f43-464d-80db-aec9737a578b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 13:02:54.242910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:54.242910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:02:54.242910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:02:54.242910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:02:54.242910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:02:54.242910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:02:54.242910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:02:54.242910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 13:02:54.242910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:54.242910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:02:54.242910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:54.242910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:54.242910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:54.242910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:54.242910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:54.242910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:54.245031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:54.245031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:54.245031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:54.245031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:54.245031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:54.245031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:54.245031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:02:54.245031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:02:54.245031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:02:54.245031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:02:54.245031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:54.245031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:54.245031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:54.245031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:54.245031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:54.245031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:54.246455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:54.246455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:54.246455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:54.246455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:54.246455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:54.246455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:54.246455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:54.246455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:54.246455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:54.246455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:54.246455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:02:54.246455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:02:54.246455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 13:02:54.246455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:54.251103 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 401/815] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:54 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:54.251103 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b6c24-6f43-464d-80db-aec9737a578b None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:54.263716 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:54.273214 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 415/816] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 13:02:54.274280 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6276c4f-ffaa-49bf-9220-f8ee4825ff9e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:54.339387 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:54.390886 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b6c24-6f43-464d-80db-aec9737a578b None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:54.401707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6276c4f-ffaa-49bf-9220-f8ee4825ff9e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:54.438622 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3b1d3-a4fe-457a-aae2-a985873612b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:54.438919 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed3eb3-9bb7-4f2e-8d04-de9e5dbe3b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:54.439264 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3b1d3-a4fe-457a-aae2-a985873612b8 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:54.439542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3b1d3-a4fe-457a-aae2-a985873612b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:54.439780 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed3eb3-9bb7-4f2e-8d04-de9e5dbe3b46 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:54.439942 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3b1d3-a4fe-457a-aae2-a985873612b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:54.440425 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed3eb3-9bb7-4f2e-8d04-de9e5dbe3b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:54.440600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3b1d3-a4fe-457a-aae2-a985873612b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:54.440753 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3b1d3-a4fe-457a-aae2-a985873612b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:54.447034 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed3eb3-9bb7-4f2e-8d04-de9e5dbe3b46 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:54.447034 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed3eb3-9bb7-4f2e-8d04-de9e5dbe3b46 None admin] RBAC: Adding query filter params (name=network) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:54.447034 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed3eb3-9bb7-4f2e-8d04-de9e5dbe3b46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:54.447551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3b1d3-a4fe-457a-aae2-a985873612b8 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:54.447710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed3eb3-9bb7-4f2e-8d04-de9e5dbe3b46 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:54.449201 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 416/817] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 10 13:02:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:54.450125 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed3eb3-9bb7-4f2e-8d04-de9e5dbe3b46 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:54.465488 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 402/818] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:54.466692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3b1d3-a4fe-457a-aae2-a985873612b8 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:54.529708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:54.586672 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed3eb3-9bb7-4f2e-8d04-de9e5dbe3b46 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:54.594541 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3b1d3-a4fe-457a-aae2-a985873612b8 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:54.634230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99b842-9e65-4031-a607-d6870b848f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:54.635105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99b842-9e65-4031-a607-d6870b848f85 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:54.635535 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99b842-9e65-4031-a607-d6870b848f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:54.635924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99b842-9e65-4031-a607-d6870b848f85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:54.636406 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:54.647780 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae04344-54e8-4dc0-8568-717ac916a9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:54.648401 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae04344-54e8-4dc0-8568-717ac916a9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:54.648679 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae04344-54e8-4dc0-8568-717ac916a9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:54.648953 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae04344-54e8-4dc0-8568-717ac916a9d9 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:54.650149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae04344-54e8-4dc0-8568-717ac916a9d9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:54.650465 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae04344-54e8-4dc0-8568-717ac916a9d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:54.652209 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae04344-54e8-4dc0-8568-717ac916a9d9 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:54.652649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99b842-9e65-4031-a607-d6870b848f85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:54.654523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99b842-9e65-4031-a607-d6870b848f85 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:54.663185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 403/819] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 10 13:02:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:54.665802 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae04344-54e8-4dc0-8568-717ac916a9d9 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:54.672940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2d99b842-9e65-4031-a607-d6870b848f85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:54.672940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:54.672940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:54.672940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:54.672940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:54.672940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:54.672940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:54.672940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:54.672940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:54.672940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:54.672940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:54.672940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:54.672940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:54.672940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:54.672940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:54.672940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:54.674029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:54.674029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:54.674029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:54.674029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:54.674029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:54.674029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:54.674029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:54.674029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:54.674029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:54.674029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:54.674029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:54.674029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:54.674029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:54.674029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:54.674029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:54.674029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:54.674029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:54.674945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:54.674945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:54.674945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:54.678976 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 417/820] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:54.680134 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99b842-9e65-4031-a607-d6870b848f85 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:54.794366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae04344-54e8-4dc0-8568-717ac916a9d9 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:54.812386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99b842-9e65-4031-a607-d6870b848f85 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:54.834664 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:54.844020 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af1d23-6ddd-41e6-bdd0-793dc9f57a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:54.844804 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af1d23-6ddd-41e6-bdd0-793dc9f57a56 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:54.845396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af1d23-6ddd-41e6-bdd0-793dc9f57a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:54.845622 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af1d23-6ddd-41e6-bdd0-793dc9f57a56 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:54.854966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af1d23-6ddd-41e6-bdd0-793dc9f57a56 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:54.856857 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af1d23-6ddd-41e6-bdd0-793dc9f57a56 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:54.859329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbb9a3-72ec-4ba4-bb9b-7dd31796f901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:54.860846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbb9a3-72ec-4ba4-bb9b-7dd31796f901 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:54.861311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbb9a3-72ec-4ba4-bb9b-7dd31796f901 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:54.861729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbb9a3-72ec-4ba4-bb9b-7dd31796f901 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:54.862541 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbb9a3-72ec-4ba4-bb9b-7dd31796f901 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:54.864204 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbb9a3-72ec-4ba4-bb9b-7dd31796f901 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:54.871072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-30af1d23-6ddd-41e6-bdd0-793dc9f57a56 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 13:02:54.871072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:54.871072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:54.871072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:54.871072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:54.871072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:54.871072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:54.871072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:54.871072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:54.871072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:54.871072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:54.871072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:54.871072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:54.871072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:54.871072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:54.871072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:54.872289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:54.872289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:54.872289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:54.872289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:54.872289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:54.872289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:54.872289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:54.872289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:54.872289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:54.872289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:54.872289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:54.872289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:54.872289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:54.872289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:54.872289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:54.872289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:54.872289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:54.872289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:54.873473 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:54.873473 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:54.873473 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:54.873473 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:54.873473 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:54.873473 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:54.873473 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:54.873473 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:54.873473 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 13:02:54.873473 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:54.875158 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 404/821] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Aug 10 13:02:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:54.876166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af1d23-6ddd-41e6-bdd0-793dc9f57a56 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:54.907531 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 418/822] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:02:54 2022] POST /identity/v3/endpoints => generated 337 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:02:54.908867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbb9a3-72ec-4ba4-bb9b-7dd31796f901 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:54.995381 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:55.115029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af1d23-6ddd-41e6-bdd0-793dc9f57a56 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:55.122603 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbb9a3-72ec-4ba4-bb9b-7dd31796f901 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:55.156970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcb0d1-afe5-471b-b9a3-55dcc6c71f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:55.157692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcb0d1-afe5-471b-b9a3-55dcc6c71f3c None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:55.158033 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcb0d1-afe5-471b-b9a3-55dcc6c71f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:55.158314 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcb0d1-afe5-471b-b9a3-55dcc6c71f3c None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:55.158988 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fcb0d1-afe5-471b-b9a3-55dcc6c71f3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:55.159331 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fcb0d1-afe5-471b-b9a3-55dcc6c71f3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:55.161104 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fcb0d1-afe5-471b-b9a3-55dcc6c71f3c None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:55.166313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf11bd-7d61-4306-8f8f-f31707ba42a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:55.166942 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf11bd-7d61-4306-8f8f-f31707ba42a1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:55.167270 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf11bd-7d61-4306-8f8f-f31707ba42a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:55.167540 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf11bd-7d61-4306-8f8f-f31707ba42a1 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:55.168278 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf11bd-7d61-4306-8f8f-f31707ba42a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:55.168582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf11bd-7d61-4306-8f8f-f31707ba42a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:55.170017 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf11bd-7d61-4306-8f8f-f31707ba42a1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:55.177624 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 405/823] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:55.183633 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcb0d1-afe5-471b-b9a3-55dcc6c71f3c None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:55.195208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 419/824] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Aug 10 13:02:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:55.200523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf11bd-7d61-4306-8f8f-f31707ba42a1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:55.237901 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:55.311130 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcb0d1-afe5-471b-b9a3-55dcc6c71f3c None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:55.325071 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:55.338900 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf11bd-7d61-4306-8f8f-f31707ba42a1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:55.356798 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba9f52-80e2-4747-8825-79027467f9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:55.357741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba9f52-80e2-4747-8825-79027467f9cc None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:55.358027 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba9f52-80e2-4747-8825-79027467f9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:55.358302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba9f52-80e2-4747-8825-79027467f9cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:55.368948 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba9f52-80e2-4747-8825-79027467f9cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:55.371019 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba9f52-80e2-4747-8825-79027467f9cc None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:55.387227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-8cba9f52-80e2-4747-8825-79027467f9cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:55.387227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:55.387227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:55.387227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:55.387227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:55.387227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:55.387227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:55.387227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:55.387227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:55.387227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:55.387227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:55.387227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:55.387227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:02:55.387227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:02:55.387227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:02:55.388961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:02:55.388961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:55.388961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:55.388961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:55.388961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:55.388961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:55.388961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:55.388961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:55.388961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:55.388961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:55.388961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:55.388961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:55.388961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:55.388961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:55.388961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:55.388961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:55.388961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:55.390057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:02:55.390057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:02:55.390057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:02:55.390057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:02:55.390057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:02:55.390057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:02:55.390057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:55.390057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:55.390057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 406/825] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:02:55.390651 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0e164-ce29-4947-9a6d-e5e1f21d99cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:55.395191 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0e164-ce29-4947-9a6d-e5e1f21d99cc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:55.395560 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0e164-ce29-4947-9a6d-e5e1f21d99cc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:55.395958 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0e164-ce29-4947-9a6d-e5e1f21d99cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:55.400548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba9f52-80e2-4747-8825-79027467f9cc None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:55.408594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0e164-ce29-4947-9a6d-e5e1f21d99cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:55.411790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0e164-ce29-4947-9a6d-e5e1f21d99cc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:55.428915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-76a0e164-ce29-4947-9a6d-e5e1f21d99cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:55.428915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:55.428915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:55.428915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:55.428915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:55.428915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:55.428915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:55.428915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:55.428915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:55.428915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:55.428915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:55.428915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:55.428915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:55.428915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:55.428915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:55.428915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:55.429973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:55.429973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:55.429973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:55.429973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:55.429973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:55.429973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:55.429973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:55.429973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:55.429973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:55.429973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:55.429973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:55.429973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:55.429973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:55.429973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:55.429973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:55.429973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:55.429973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:55.430905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:55.430905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:55.430905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:55.430905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 420/826] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:55.436203 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0e164-ce29-4947-9a6d-e5e1f21d99cc None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:55.526369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:55.533073 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba9f52-80e2-4747-8825-79027467f9cc None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:55.553551 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0e164-ce29-4947-9a6d-e5e1f21d99cc None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:55.576923 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526063d-31dd-4b76-a272-dea8c3ab6a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:55.578064 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526063d-31dd-4b76-a272-dea8c3ab6a7c None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:55.578486 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526063d-31dd-4b76-a272-dea8c3ab6a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:55.578898 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526063d-31dd-4b76-a272-dea8c3ab6a7c None admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:55.580228 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526063d-31dd-4b76-a272-dea8c3ab6a7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:55.580687 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526063d-31dd-4b76-a272-dea8c3ab6a7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:55.582732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526063d-31dd-4b76-a272-dea8c3ab6a7c None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:55.591619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f310c1-beef-46c1-b8cc-6f9e3b2bdabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:55.592962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f310c1-beef-46c1-b8cc-6f9e3b2bdabb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:55.592962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f310c1-beef-46c1-b8cc-6f9e3b2bdabb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:55.593313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f310c1-beef-46c1-b8cc-6f9e3b2bdabb None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:55.594324 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f310c1-beef-46c1-b8cc-6f9e3b2bdabb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:55.594758 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f310c1-beef-46c1-b8cc-6f9e3b2bdabb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:55.596432 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f310c1-beef-46c1-b8cc-6f9e3b2bdabb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:55.600831 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 407/827] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:02:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:02:55.607361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526063d-31dd-4b76-a272-dea8c3ab6a7c None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:55.616480 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 421/828] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:55.621813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f310c1-beef-46c1-b8cc-6f9e3b2bdabb None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:55.646944 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:55.724405 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f310c1-beef-46c1-b8cc-6f9e3b2bdabb None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:55.729829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526063d-31dd-4b76-a272-dea8c3ab6a7c None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:55.760750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e053fb3-a342-474e-b60e-676775cad00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:55.761378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e053fb3-a342-474e-b60e-676775cad00d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:55.761652 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e053fb3-a342-474e-b60e-676775cad00d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:55.761918 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e053fb3-a342-474e-b60e-676775cad00d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:55.768332 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6614e7-45a2-4028-a31b-697c89ac05f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:55.768746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e053fb3-a342-474e-b60e-676775cad00d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:55.768942 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6614e7-45a2-4028-a31b-697c89ac05f7 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:55.769206 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6614e7-45a2-4028-a31b-697c89ac05f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:55.770001 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6614e7-45a2-4028-a31b-697c89ac05f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:55.770708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e053fb3-a342-474e-b60e-676775cad00d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:55.770806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6614e7-45a2-4028-a31b-697c89ac05f7 None admin] RBAC: Adding query filter params (role.id=d9c9200468cb4f7ab6a23882bfb1f062, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=7fd0f76f24ea481191dfd65fff2376af) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:55.771108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6614e7-45a2-4028-a31b-697c89ac05f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:55.772540 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:55.773823 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6614e7-45a2-4028-a31b-697c89ac05f7 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:55.782559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2e053fb3-a342-474e-b60e-676775cad00d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:55.782559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:55.782559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:55.782559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:55.782559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:55.782559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:55.782559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:55.782559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:55.782559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:55.782559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:55.782559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:55.782559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:55.782559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:02:55.782559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:02:55.782559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:02:55.783501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:02:55.783501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:55.783501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:55.783501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:55.783501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:55.783501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:55.783501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:55.783501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:55.783501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:55.783501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:55.783501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:55.783501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:55.783501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:55.783501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:55.783501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:55.783501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:55.783501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:55.784491 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:02:55.784491 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:02:55.784491 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:02:55.784491 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:02:55.784491 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:02:55.784491 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:02:55.784491 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:55.784491 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:55.787456 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 422/829] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:55.788147 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 408/830] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:02:55 2022] GET /identity/v3/role_assignments?user.id=7fd0f76f24ea481191dfd65fff2376af&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=d9c9200468cb4f7ab6a23882bfb1f062 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:02:55.789555 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f209e-d51f-4d09-aaea-d0cc226cb2cc None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:55.789844 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f209e-d51f-4d09-aaea-d0cc226cb2cc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:55.790116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f209e-d51f-4d09-aaea-d0cc226cb2cc None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:55.792069 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6614e7-45a2-4028-a31b-697c89ac05f7 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:55.796090 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 423/831] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:55.797771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe629178-90ec-4b1b-947e-a2e05d3cdcda None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:55.798285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe629178-90ec-4b1b-947e-a2e05d3cdcda None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:55.798756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe629178-90ec-4b1b-947e-a2e05d3cdcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:55.820097 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fe629178-90ec-4b1b-947e-a2e05d3cdcda None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:55.821381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fe629178-90ec-4b1b-947e-a2e05d3cdcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:55.906945 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:55.907436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 424/832] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:02:55.915936 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6614e7-45a2-4028-a31b-697c89ac05f7 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:55.923081 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe629178-90ec-4b1b-947e-a2e05d3cdcda None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:55.956248 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90f7f6-e55d-4eb0-80ea-2daafd4b50fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:55.957674 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90f7f6-e55d-4eb0-80ea-2daafd4b50fa None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:55.957948 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90f7f6-e55d-4eb0-80ea-2daafd4b50fa None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:55.958241 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90f7f6-e55d-4eb0-80ea-2daafd4b50fa None admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:55.959135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90f7f6-e55d-4eb0-80ea-2daafd4b50fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:55.959244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90f7f6-e55d-4eb0-80ea-2daafd4b50fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:55.960627 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90f7f6-e55d-4eb0-80ea-2daafd4b50fa None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:55.976867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 409/833] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:02:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:55.988404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90f7f6-e55d-4eb0-80ea-2daafd4b50fa None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:56.046676 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe629178-90ec-4b1b-947e-a2e05d3cdcda None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:56.076967 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:56.086932 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d4aad-0440-4c43-a18d-452bb4581228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:56.087704 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d4aad-0440-4c43-a18d-452bb4581228 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:56.087980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d4aad-0440-4c43-a18d-452bb4581228 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:56.088245 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d4aad-0440-4c43-a18d-452bb4581228 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:56.088855 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d4aad-0440-4c43-a18d-452bb4581228 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:56.090217 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d4aad-0440-4c43-a18d-452bb4581228 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:56.099696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-245d4aad-0440-4c43-a18d-452bb4581228 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 13:02:56.099696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:56.099696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:02:56.099696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:02:56.099696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:02:56.099696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:02:56.099696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:02:56.099696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:02:56.099696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 13:02:56.099696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:56.099696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:02:56.099696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:56.099696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:56.099696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:56.099696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:56.099696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:56.099696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:56.100742 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:56.100742 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:56.100742 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:56.100742 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:56.100742 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:56.100742 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:56.100742 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:02:56.100742 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:02:56.100742 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:02:56.100742 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:02:56.100742 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:56.100742 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:56.100742 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:56.100742 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:56.100742 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:56.100742 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:56.101619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:56.101619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:56.101619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:56.101619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:56.101619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:56.101619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:56.101619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:56.101619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:56.101619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:56.101619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:56.101619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:02:56.101619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:02:56.101619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 13:02:56.101619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:56.101619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 425/834] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 10 13:02:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:02:56.102447 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b29a8-88c6-476c-8376-518ac3a65f04 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:56.103176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b29a8-88c6-476c-8376-518ac3a65f04 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:56.103176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b29a8-88c6-476c-8376-518ac3a65f04 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:56.108101 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 426/835] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:56.108101 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b29a8-88c6-476c-8376-518ac3a65f04 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:56.113872 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90f7f6-e55d-4eb0-80ea-2daafd4b50fa None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:56.151480 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc9e78-651d-4417-943c-d855d9af9e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:56.152148 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc9e78-651d-4417-943c-d855d9af9e0c None admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:56.152762 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc9e78-651d-4417-943c-d855d9af9e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:56.152762 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc9e78-651d-4417-943c-d855d9af9e0c None admin] PATH_INFO: `/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/182eec86daa44cd48d6ef1c38f58e89d/roles/434a1fd874d24b959bf48fe61633f240` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:56.169002 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc9e78-651d-4417-943c-d855d9af9e0c None admin] RBAC: Authorizing `identity:create_grant(project_id=8aa2ccddadb54dd9b88ccc6cec98ae37, user_id=182eec86daa44cd48d6ef1c38f58e89d, role_id=434a1fd874d24b959bf48fe61633f240)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:56.170365 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc9e78-651d-4417-943c-d855d9af9e0c None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:56.198792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 410/836] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:02:55 2022] PUT /identity/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/182eec86daa44cd48d6ef1c38f58e89d/roles/434a1fd874d24b959bf48fe61633f240 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:02:56.198792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46162834-978b-43a3-a0d6-6dc9c6592b84 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:56.198792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46162834-978b-43a3-a0d6-6dc9c6592b84 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:56.198792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46162834-978b-43a3-a0d6-6dc9c6592b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:56.201765 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:56.218161 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-46162834-978b-43a3-a0d6-6dc9c6592b84 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:56.219842 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-46162834-978b-43a3-a0d6-6dc9c6592b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:56.248422 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b29a8-88c6-476c-8376-518ac3a65f04 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:56.298747 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309dc5f-b90b-45f0-a86b-9d22e88b9f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:56.299884 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309dc5f-b90b-45f0-a86b-9d22e88b9f3f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:56.300515 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309dc5f-b90b-45f0-a86b-9d22e88b9f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:56.301871 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309dc5f-b90b-45f0-a86b-9d22e88b9f3f None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:56.302841 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309dc5f-b90b-45f0-a86b-9d22e88b9f3f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:56.303407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309dc5f-b90b-45f0-a86b-9d22e88b9f3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:56.307422 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309dc5f-b90b-45f0-a86b-9d22e88b9f3f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:56.308638 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 411/837] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:02:56.324073 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 427/838] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 10 13:02:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:56.325331 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46162834-978b-43a3-a0d6-6dc9c6592b84 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:56.336721 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309dc5f-b90b-45f0-a86b-9d22e88b9f3f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:56.414037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:56.463345 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309dc5f-b90b-45f0-a86b-9d22e88b9f3f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:56.469090 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46162834-978b-43a3-a0d6-6dc9c6592b84 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:56.510478 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bce0d2-3952-4684-882e-33570f7835ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:56.511146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bce0d2-3952-4684-882e-33570f7835ff None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:56.511428 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bce0d2-3952-4684-882e-33570f7835ff None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:56.511703 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bce0d2-3952-4684-882e-33570f7835ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:56.515232 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26fd6f-1096-4fb2-a1f7-7c45d73ad5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:56.515843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26fd6f-1096-4fb2-a1f7-7c45d73ad5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:56.516117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26fd6f-1096-4fb2-a1f7-7c45d73ad5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:56.516411 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26fd6f-1096-4fb2-a1f7-7c45d73ad5f9 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:56.517047 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26fd6f-1096-4fb2-a1f7-7c45d73ad5f9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:56.517392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26fd6f-1096-4fb2-a1f7-7c45d73ad5f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:56.519028 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26fd6f-1096-4fb2-a1f7-7c45d73ad5f9 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:56.520790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:56.524864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bce0d2-3952-4684-882e-33570f7835ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:56.525535 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 412/839] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 10 13:02:56 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:02:56.532037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-08bce0d2-3952-4684-882e-33570f7835ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:02:56.532037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:56.532037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:56.532037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:56.532037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:56.532037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:56.532037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:56.532037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:56.532037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:56.532037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:56.532037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:56.532037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:56.532037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:56.532037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:56.532037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:56.532037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:56.533088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:56.533088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:56.533088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:56.533088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:56.533088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:56.533088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:56.533088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:56.533088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:56.533088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:56.533088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:56.533088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:56.533088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:56.533088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:56.533088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:56.533088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:56.533088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:56.533979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:56.533979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:56.533979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:56.533979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:56.533979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:56.533979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:56.533979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:56.533979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:56.533979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:56.533979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:56.533979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:02:56.533979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:56.533979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 428/840] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:02:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:02:56.541319 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26fd6f-1096-4fb2-a1f7-7c45d73ad5f9 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:56.678731 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26fd6f-1096-4fb2-a1f7-7c45d73ad5f9 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:56.726332 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0698dd-40f2-4c65-8220-4814c9569ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:56.726869 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0698dd-40f2-4c65-8220-4814c9569ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:56.727177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0698dd-40f2-4c65-8220-4814c9569ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:56.727530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0698dd-40f2-4c65-8220-4814c9569ba8 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:56.728199 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0698dd-40f2-4c65-8220-4814c9569ba8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:56.728547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0698dd-40f2-4c65-8220-4814c9569ba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:56.729893 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0698dd-40f2-4c65-8220-4814c9569ba8 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:56.739838 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 413/841] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:02:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:56.745530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bce0d2-3952-4684-882e-33570f7835ff None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:56.849563 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bce0d2-3952-4684-882e-33570f7835ff None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:56.865943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:56.884944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50982fbb-5dad-453f-a05e-50e9da843aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:56.885573 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50982fbb-5dad-453f-a05e-50e9da843aed None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:56.885896 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50982fbb-5dad-453f-a05e-50e9da843aed None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:56.886170 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50982fbb-5dad-453f-a05e-50e9da843aed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:56.898569 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50982fbb-5dad-453f-a05e-50e9da843aed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:56.900046 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50982fbb-5dad-453f-a05e-50e9da843aed None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:56.915145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-50982fbb-5dad-453f-a05e-50e9da843aed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:56.915145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:56.915145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:56.915145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:56.915145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:56.915145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:56.915145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:56.915145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:56.915145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:56.915145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:56.915145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:56.915145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:56.915145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:56.915145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:56.915145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:56.915145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:56.916200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:56.916200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:56.916200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:56.916200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:56.916200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:56.916200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:56.916200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:56.916200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:56.916200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:56.916200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:56.916200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:56.916200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:56.916200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:56.916200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:56.916200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:56.916200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:56.916200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:56.917115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:56.917115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:56.917115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:56.917115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 429/842] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:56.923501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0698dd-40f2-4c65-8220-4814c9569ba8 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:56.988405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:57.033755 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0698dd-40f2-4c65-8220-4814c9569ba8 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:57.071930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a739b-9d63-4021-8a28-c43bc5fb07de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:57.072556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a739b-9d63-4021-8a28-c43bc5fb07de None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:57.072835 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a739b-9d63-4021-8a28-c43bc5fb07de None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:57.073106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a739b-9d63-4021-8a28-c43bc5fb07de None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:57.073759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a739b-9d63-4021-8a28-c43bc5fb07de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:57.074062 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a739b-9d63-4021-8a28-c43bc5fb07de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:57.075489 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a739b-9d63-4021-8a28-c43bc5fb07de None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:57.089536 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 414/843] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:57.095305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50982fbb-5dad-453f-a05e-50e9da843aed None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:57.199992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50982fbb-5dad-453f-a05e-50e9da843aed None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:57.234975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fe44c-cfd5-400b-afb6-e845ea81ee62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:57.235987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fe44c-cfd5-400b-afb6-e845ea81ee62 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:57.236524 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fe44c-cfd5-400b-afb6-e845ea81ee62 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:57.237000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fe44c-cfd5-400b-afb6-e845ea81ee62 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:57.245790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fe44c-cfd5-400b-afb6-e845ea81ee62 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:57.247545 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fe44c-cfd5-400b-afb6-e845ea81ee62 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:57.258928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c61fe44c-cfd5-400b-afb6-e845ea81ee62 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 13:02:57.258928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:57.258928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:57.258928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:57.258928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:57.258928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:57.258928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:57.258928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:57.258928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:57.258928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:57.258928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:57.258928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:57.258928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:57.258928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:57.258928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:57.258928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:57.259929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:57.259929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:57.259929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:57.259929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:57.259929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:57.259929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:57.259929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:57.259929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:57.259929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:57.259929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:57.259929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:57.259929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:57.259929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:57.259929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:57.259929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:57.259929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:57.259929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:57.259929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:57.260886 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:57.260886 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:57.260886 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:57.260886 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:57.260886 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:57.260886 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:57.260886 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:57.260886 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:57.260886 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 13:02:57.260886 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:57.263632 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 430/844] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:02:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:57.270677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a739b-9d63-4021-8a28-c43bc5fb07de None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:57.378720 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a739b-9d63-4021-8a28-c43bc5fb07de None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:57.399886 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:57.414825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a539f4-a8b4-4a8c-bb5b-9ed3f0be757a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:57.415470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a539f4-a8b4-4a8c-bb5b-9ed3f0be757a None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:57.416195 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a539f4-a8b4-4a8c-bb5b-9ed3f0be757a None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:57.416469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a539f4-a8b4-4a8c-bb5b-9ed3f0be757a None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:57.417195 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a539f4-a8b4-4a8c-bb5b-9ed3f0be757a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:57.417500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a539f4-a8b4-4a8c-bb5b-9ed3f0be757a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:57.418909 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a539f4-a8b4-4a8c-bb5b-9ed3f0be757a None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:57.437281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 415/845] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Aug 10 13:02:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:57.444217 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fe44c-cfd5-400b-afb6-e845ea81ee62 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:57.475866 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:57.555334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fe44c-cfd5-400b-afb6-e845ea81ee62 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:57.589752 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c65c5-0051-4d5a-9fda-c1a2b75471be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:57.590358 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c65c5-0051-4d5a-9fda-c1a2b75471be None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:57.590639 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c65c5-0051-4d5a-9fda-c1a2b75471be None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:57.590911 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c65c5-0051-4d5a-9fda-c1a2b75471be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:57.664801 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c65c5-0051-4d5a-9fda-c1a2b75471be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:57.666254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c65c5-0051-4d5a-9fda-c1a2b75471be None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:57.695389 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:57.770879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 431/846] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:57 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 13:02:57.776673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a539f4-a8b4-4a8c-bb5b-9ed3f0be757a None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:57.885914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a539f4-a8b4-4a8c-bb5b-9ed3f0be757a None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:57.921743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434b472-caf8-4352-b742-e2358f4ec666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:57.922734 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434b472-caf8-4352-b742-e2358f4ec666 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:57.923265 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434b472-caf8-4352-b742-e2358f4ec666 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:57.923741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434b472-caf8-4352-b742-e2358f4ec666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:57.934956 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434b472-caf8-4352-b742-e2358f4ec666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:57.936608 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434b472-caf8-4352-b742-e2358f4ec666 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:57.952339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-8434b472-caf8-4352-b742-e2358f4ec666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:57.952339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:57.952339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:57.952339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:57.952339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:57.952339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:57.952339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:57.952339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:57.952339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:57.952339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:57.952339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:57.952339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:57.952339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:57.952339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:57.952339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:57.952339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:57.953349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:57.953349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:57.953349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:57.953349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:57.953349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:57.953349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:57.953349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:57.953349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:57.953349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:57.953349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:57.953349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:57.953349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:57.953349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:57.953349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:57.953349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:57.953349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:57.953349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:57.954248 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:57.954248 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:57.954248 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:57.956320 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 416/847] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:57.962746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c65c5-0051-4d5a-9fda-c1a2b75471be None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:58.077022 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c65c5-0051-4d5a-9fda-c1a2b75471be None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:58.098393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770b837-d443-427e-8e67-5d2882ea12b6 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:58.098734 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770b837-d443-427e-8e67-5d2882ea12b6 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:58.098939 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770b837-d443-427e-8e67-5d2882ea12b6 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:58.100554 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 417/848] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:58.104945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:58.106022 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8ed03-8e34-4095-95f8-272ccbe6349f None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:58.106345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8ed03-8e34-4095-95f8-272ccbe6349f None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:58.106664 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8ed03-8e34-4095-95f8-272ccbe6349f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:58.120471 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba335fb-938c-46d0-94e1-251b96ea7eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:58.121091 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba335fb-938c-46d0-94e1-251b96ea7eee None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:58.121934 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba335fb-938c-46d0-94e1-251b96ea7eee None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:58.122213 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba335fb-938c-46d0-94e1-251b96ea7eee None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:58.123034 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba335fb-938c-46d0-94e1-251b96ea7eee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:58.123545 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba335fb-938c-46d0-94e1-251b96ea7eee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:58.124982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba335fb-938c-46d0-94e1-251b96ea7eee None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:58.127024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-74c8ed03-8e34-4095-95f8-272ccbe6349f None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:58.128303 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-74c8ed03-8e34-4095-95f8-272ccbe6349f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:58.140346 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 432/849] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:58.145955 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba335fb-938c-46d0-94e1-251b96ea7eee None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:58.158712 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:58.223787 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 418/850] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:02:58.245904 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8ed03-8e34-4095-95f8-272ccbe6349f None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:58.263712 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba335fb-938c-46d0-94e1-251b96ea7eee None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:58.313269 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8beaa-c632-4d57-b746-3eb1b775fd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:58.314511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8beaa-c632-4d57-b746-3eb1b775fd14 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:58.315292 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8beaa-c632-4d57-b746-3eb1b775fd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:58.316241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8beaa-c632-4d57-b746-3eb1b775fd14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:58.326902 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8beaa-c632-4d57-b746-3eb1b775fd14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:58.329110 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8beaa-c632-4d57-b746-3eb1b775fd14 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:58.346813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-f5c8beaa-c632-4d57-b746-3eb1b775fd14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:58.346813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:58.346813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:58.346813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:58.346813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:58.346813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:58.346813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:58.346813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:58.346813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:58.346813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:58.346813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:58.346813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:58.346813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:02:58.346813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:02:58.346813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:02:58.347835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:02:58.347835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:58.347835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:58.347835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:58.347835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:58.347835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:58.347835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:58.347835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:58.347835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:58.347835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:58.347835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:58.347835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:58.347835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:58.347835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:58.347835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:58.347835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:58.347835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:58.348741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:02:58.348741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:02:58.348741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:02:58.348741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:02:58.348741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:02:58.348741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:02:58.348741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:02:58.348741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:58.355771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 433/851] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:02:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:02:58.357424 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8beaa-c632-4d57-b746-3eb1b775fd14 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:58.367493 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8ed03-8e34-4095-95f8-272ccbe6349f None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:58.406221 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba9403-634e-4474-b98f-a8f30e5aa7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:58.406773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba9403-634e-4474-b98f-a8f30e5aa7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:58.407057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba9403-634e-4474-b98f-a8f30e5aa7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:58.407330 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba9403-634e-4474-b98f-a8f30e5aa7e6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:58.407923 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba9403-634e-4474-b98f-a8f30e5aa7e6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:58.409262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba9403-634e-4474-b98f-a8f30e5aa7e6 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:58.410416 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:58.418950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-8aba9403-634e-4474-b98f-a8f30e5aa7e6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 13:02:58.418950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:58.418950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:02:58.418950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:02:58.418950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:02:58.418950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:02:58.418950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:02:58.418950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:02:58.418950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 13:02:58.418950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:58.418950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:02:58.418950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:58.418950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:58.418950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:58.418950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:58.418950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:58.419982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:58.419982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:58.419982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:58.419982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:58.419982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:58.419982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:58.419982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:58.419982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:02:58.419982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:02:58.419982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:02:58.419982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:02:58.419982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:58.419982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:58.419982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:58.419982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:58.419982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:58.419982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:58.420866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:58.420866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:58.420866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:58.420866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:58.420866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:58.420866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:58.420866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:58.420866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:58.420866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:58.420866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:58.420866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:02:58.420866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:02:58.420866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 13:02:58.420866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:58.420866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 419/852] 10.222.0.46 () {56 vars in 1132 bytes} [Wed Aug 10 13:02:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:02:58.422293 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7acf4-da56-4725-89ae-f70b69274a6b None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:58.422293 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7acf4-da56-4725-89ae-f70b69274a6b None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:58.422293 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7acf4-da56-4725-89ae-f70b69274a6b None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:58.423141 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 420/853] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:58.427816 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7acf4-da56-4725-89ae-f70b69274a6b None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:58.455588 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:58.474495 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8beaa-c632-4d57-b746-3eb1b775fd14 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:58.511120 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889eed3-5626-48a2-bb55-161fb701e0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:58.511967 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889eed3-5626-48a2-bb55-161fb701e0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:58.512078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889eed3-5626-48a2-bb55-161fb701e0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:58.512270 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889eed3-5626-48a2-bb55-161fb701e0f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:58.512943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889eed3-5626-48a2-bb55-161fb701e0f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:58.513246 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889eed3-5626-48a2-bb55-161fb701e0f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:58.514669 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889eed3-5626-48a2-bb55-161fb701e0f7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:58.527750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 434/854] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:02:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:58.528836 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3089f-2569-4e29-ada1-a588ac0ca241 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:58.529119 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3089f-2569-4e29-ada1-a588ac0ca241 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:58.529392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3089f-2569-4e29-ada1-a588ac0ca241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:58.544982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7acf4-da56-4725-89ae-f70b69274a6b None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:58.547762 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-15e3089f-2569-4e29-ada1-a588ac0ca241 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:58.548949 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-15e3089f-2569-4e29-ada1-a588ac0ca241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:58.583435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d52a7-3fe6-4217-b379-6e9fa8fd95d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:58.584082 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d52a7-3fe6-4217-b379-6e9fa8fd95d4 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:58.584390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d52a7-3fe6-4217-b379-6e9fa8fd95d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:58.584615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d52a7-3fe6-4217-b379-6e9fa8fd95d4 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:58.585228 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d52a7-3fe6-4217-b379-6e9fa8fd95d4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:58.585634 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d52a7-3fe6-4217-b379-6e9fa8fd95d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:58.587142 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d52a7-3fe6-4217-b379-6e9fa8fd95d4 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:58.597353 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 421/855] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Aug 10 13:02:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:58.597353 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d52a7-3fe6-4217-b379-6e9fa8fd95d4 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:58.628300 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 435/856] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:02:58.629821 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3089f-2569-4e29-ada1-a588ac0ca241 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:58.672736 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:58.703594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:58.716498 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d52a7-3fe6-4217-b379-6e9fa8fd95d4 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:58.733517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3089f-2569-4e29-ada1-a588ac0ca241 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:58.751207 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85132a-512a-47b6-9976-e93052a68258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:58.751808 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85132a-512a-47b6-9976-e93052a68258 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:58.752083 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85132a-512a-47b6-9976-e93052a68258 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:58.752348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85132a-512a-47b6-9976-e93052a68258 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:58.753055 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85132a-512a-47b6-9976-e93052a68258 None admin] RBAC: Adding query filter params (role.id=d9c9200468cb4f7ab6a23882bfb1f062, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=5c86ef66c9564e0395c325a84ca9c4a5) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:58.753354 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85132a-512a-47b6-9976-e93052a68258 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:58.755424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85132a-512a-47b6-9976-e93052a68258 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:58.761407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 422/857] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:02:58 2022] GET /identity/v3/role_assignments?user.id=5c86ef66c9564e0395c325a84ca9c4a5&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=d9c9200468cb4f7ab6a23882bfb1f062 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:58.762628 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9dbae-749d-42c3-be47-8b697dd816dd None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:58.762911 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9dbae-749d-42c3-be47-8b697dd816dd None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:58.763214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9dbae-749d-42c3-be47-8b697dd816dd None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:58.764401 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 423/858] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:02:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:02:58.765104 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9dbae-749d-42c3-be47-8b697dd816dd None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:58.774330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47230ad0-f787-4346-9ff0-00a035bc277b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:58.775254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47230ad0-f787-4346-9ff0-00a035bc277b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:58.775713 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47230ad0-f787-4346-9ff0-00a035bc277b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:58.776143 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47230ad0-f787-4346-9ff0-00a035bc277b None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:58.776802 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47230ad0-f787-4346-9ff0-00a035bc277b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:58.777107 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47230ad0-f787-4346-9ff0-00a035bc277b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:58.778531 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47230ad0-f787-4346-9ff0-00a035bc277b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:58.784455 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 436/859] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Aug 10 13:02:58 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:58.785819 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46de36-318f-4146-8469-86f8e2b310f7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:58.786104 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46de36-318f-4146-8469-86f8e2b310f7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:58.786378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46de36-318f-4146-8469-86f8e2b310f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:58.816021 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5a46de36-318f-4146-8469-86f8e2b310f7 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:02:58.817954 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5a46de36-318f-4146-8469-86f8e2b310f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:02:58.906599 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 437/860] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:02:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:02:58.920015 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9dbae-749d-42c3-be47-8b697dd816dd None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:58.929711 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46de36-318f-4146-8469-86f8e2b310f7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:58.964917 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5459a-29cd-4658-8376-4f00b76e88cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:58.965808 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5459a-29cd-4658-8376-4f00b76e88cd None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:58.965808 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5459a-29cd-4658-8376-4f00b76e88cd None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:58.966060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5459a-29cd-4658-8376-4f00b76e88cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:58.973948 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:58.982518 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5459a-29cd-4658-8376-4f00b76e88cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:02:58.988057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-a5c5459a-29cd-4658-8376-4f00b76e88cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:58.988057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:58.988057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:58.988057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:58.988057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:58.988057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:58.988057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:58.988057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:58.988057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:58.988057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:58.988057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:58.988057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:58.988057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:02:58.988057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:02:58.988057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:02:58.988057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:02:58.989656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:02:58.989656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:02:58.989656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:02:58.989656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:02:58.989656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:58.989656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:58.989656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:58.989656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:58.989656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:58.989656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:58.989656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:58.989656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:58.989656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:58.989656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:58.989656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:58.989656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:58.990651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:58.990651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:58.990651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:58.990651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:58.990651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:02:58.990651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:02:58.990651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:02:58.990651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:02:58.990651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:02:58.990651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:02:58.990651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:02:58.990651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:02:58.990651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 424/861] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:02:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:58.998981 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5459a-29cd-4658-8376-4f00b76e88cd None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:59.021309 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:59.077316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46de36-318f-4146-8469-86f8e2b310f7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:59.118694 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fefd94-3d90-4412-8f90-ec609b402fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:59.119401 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fefd94-3d90-4412-8f90-ec609b402fbb None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:59.119683 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fefd94-3d90-4412-8f90-ec609b402fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:59.120046 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fefd94-3d90-4412-8f90-ec609b402fbb None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:59.120626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fefd94-3d90-4412-8f90-ec609b402fbb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:59.122261 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fefd94-3d90-4412-8f90-ec609b402fbb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:59.129354 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5459a-29cd-4658-8376-4f00b76e88cd None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:59.140637 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 438/862] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 10 13:02:58 2022] POST /identity/v3/services => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:02:59.183780 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efb973-55f2-4910-b54a-dd778cc9e512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:59.184372 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efb973-55f2-4910-b54a-dd778cc9e512 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:59.184651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efb973-55f2-4910-b54a-dd778cc9e512 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:59.184918 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efb973-55f2-4910-b54a-dd778cc9e512 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:59.185597 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efb973-55f2-4910-b54a-dd778cc9e512 None admin] RBAC: Adding query filter params (name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:59.185898 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efb973-55f2-4910-b54a-dd778cc9e512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:59.187300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efb973-55f2-4910-b54a-dd778cc9e512 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:59.198879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 425/863] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 10 13:02:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:02:59.205326 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fefd94-3d90-4412-8f90-ec609b402fbb None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:59.311749 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:59.323287 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fefd94-3d90-4412-8f90-ec609b402fbb None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:59.362620 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e29388-7a11-4a27-a83f-36383bdea941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:59.363336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e29388-7a11-4a27-a83f-36383bdea941 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:59.363637 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e29388-7a11-4a27-a83f-36383bdea941 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:59.363879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e29388-7a11-4a27-a83f-36383bdea941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:59.377325 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e29388-7a11-4a27-a83f-36383bdea941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:59.379454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e29388-7a11-4a27-a83f-36383bdea941 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:59.396891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-d4e29388-7a11-4a27-a83f-36383bdea941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:59.396891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:59.396891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:59.396891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:59.396891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:59.396891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:59.396891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:59.396891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:59.396891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:59.396891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:59.396891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:59.396891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:59.396891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:02:59.396891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:02:59.396891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:02:59.396891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:02:59.397931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:59.397931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:59.397931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:59.397931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:59.397931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:59.397931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:59.397931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:59.397931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:59.397931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:59.397931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:59.397931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:59.397931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:59.397931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:59.397931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:59.397931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:59.397931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:59.397931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:02:59.398947 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:02:59.398947 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:02:59.398947 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:59.402673 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 439/864] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:59.404039 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efb973-55f2-4910-b54a-dd778cc9e512 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:59.480252 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:59.513833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efb973-55f2-4910-b54a-dd778cc9e512 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:59.548802 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ead72b-0714-4b21-825b-e91bb128af05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:59.549420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ead72b-0714-4b21-825b-e91bb128af05 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:59.549701 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ead72b-0714-4b21-825b-e91bb128af05 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:59.549971 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ead72b-0714-4b21-825b-e91bb128af05 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:59.551185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ead72b-0714-4b21-825b-e91bb128af05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:59.551497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ead72b-0714-4b21-825b-e91bb128af05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:59.552878 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ead72b-0714-4b21-825b-e91bb128af05 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:59.566327 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 426/865] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:59.572244 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e29388-7a11-4a27-a83f-36383bdea941 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:59.675244 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e29388-7a11-4a27-a83f-36383bdea941 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:59.709548 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072d997-a8ff-4d31-8489-76e84d05be47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:59.710411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072d997-a8ff-4d31-8489-76e84d05be47 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:59.710867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072d997-a8ff-4d31-8489-76e84d05be47 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:59.711308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072d997-a8ff-4d31-8489-76e84d05be47 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:59.719309 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072d997-a8ff-4d31-8489-76e84d05be47 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:59.720909 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072d997-a8ff-4d31-8489-76e84d05be47 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:59.732678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-0072d997-a8ff-4d31-8489-76e84d05be47 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 13:02:59.732678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:02:59.732678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:02:59.732678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:02:59.732678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:02:59.732678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:02:59.732678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:02:59.732678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:02:59.732678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:02:59.732678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:02:59.732678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:02:59.732678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:02:59.732678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:02:59.732678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:02:59.732678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:02:59.732678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:02:59.733790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:02:59.733790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:02:59.733790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:02:59.733790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:59.733790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:02:59.733790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:02:59.733790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:02:59.733790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:02:59.733790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:02:59.733790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:02:59.733790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:02:59.733790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:02:59.733790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:02:59.733790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:02:59.733790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:02:59.733790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:02:59.733790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:02:59.733790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:02:59.734944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:02:59.734944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:02:59.734944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:02:59.734944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:02:59.734944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:02:59.734944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:02:59.734944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:02:59.734944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:02:59.734944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 13:02:59.734944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:02:59.737031 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 440/866] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Aug 10 13:02:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:02:59.747109 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ead72b-0714-4b21-825b-e91bb128af05 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:59.854551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ead72b-0714-4b21-825b-e91bb128af05 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:02:59.891396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:59.898092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f9092-96f1-43ea-a2a8-ca4d4a445b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:02:59.898708 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f9092-96f1-43ea-a2a8-ca4d4a445b9f None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:02:59.898988 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f9092-96f1-43ea-a2a8-ca4d4a445b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:02:59.899304 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f9092-96f1-43ea-a2a8-ca4d4a445b9f None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:02:59.900035 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f9092-96f1-43ea-a2a8-ca4d4a445b9f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:02:59.900338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f9092-96f1-43ea-a2a8-ca4d4a445b9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:02:59.901761 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f9092-96f1-43ea-a2a8-ca4d4a445b9f None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:02:59.920817 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 427/867] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Aug 10 13:02:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:02:59.926427 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072d997-a8ff-4d31-8489-76e84d05be47 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:02:59.930479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:00.042013 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072d997-a8ff-4d31-8489-76e84d05be47 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:00.077159 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84b042-b8b9-43dc-bdd2-56d8f7479592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:00.077774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84b042-b8b9-43dc-bdd2-56d8f7479592 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:00.078051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84b042-b8b9-43dc-bdd2-56d8f7479592 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:00.078324 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84b042-b8b9-43dc-bdd2-56d8f7479592 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:00.151824 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84b042-b8b9-43dc-bdd2-56d8f7479592 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:00.153282 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84b042-b8b9-43dc-bdd2-56d8f7479592 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:00.155936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:00.254857 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 441/868] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:02:59 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 13:03:00.260155 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f9092-96f1-43ea-a2a8-ca4d4a445b9f None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:00.364921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f9092-96f1-43ea-a2a8-ca4d4a445b9f None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:00.407145 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87f254-2f0a-4526-84d0-9a13fd99eca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:00.407779 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87f254-2f0a-4526-84d0-9a13fd99eca7 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:00.408050 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87f254-2f0a-4526-84d0-9a13fd99eca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:00.408321 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87f254-2f0a-4526-84d0-9a13fd99eca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:00.419660 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87f254-2f0a-4526-84d0-9a13fd99eca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:00.421168 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87f254-2f0a-4526-84d0-9a13fd99eca7 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:00.437572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-3f87f254-2f0a-4526-84d0-9a13fd99eca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:00.437572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:00.437572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:00.437572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:00.437572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:00.437572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:00.437572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:00.437572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:00.437572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:00.437572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:00.437572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:00.437572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:00.437572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:03:00.437572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:03:00.437572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:03:00.437572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:03:00.438553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:00.438553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:00.438553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:00.438553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:00.438553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:00.438553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:00.438553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:00.438553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:00.438553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:00.438553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:00.438553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:00.438553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:00.438553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:00.438553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:00.438553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:00.438553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:00.438553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:03:00.439495 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:03:00.439495 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:00.439495 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:00.439495 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 428/869] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:00.445018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84b042-b8b9-43dc-bdd2-56d8f7479592 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:00.545973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84b042-b8b9-43dc-bdd2-56d8f7479592 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:00.548323 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:00.584460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba3181-8bdd-4bdc-84cd-fd99e81209bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:00.585064 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba3181-8bdd-4bdc-84cd-fd99e81209bf None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:00.585339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba3181-8bdd-4bdc-84cd-fd99e81209bf None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:00.585605 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba3181-8bdd-4bdc-84cd-fd99e81209bf None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:00.586242 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba3181-8bdd-4bdc-84cd-fd99e81209bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:00.586538 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba3181-8bdd-4bdc-84cd-fd99e81209bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:00.587933 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba3181-8bdd-4bdc-84cd-fd99e81209bf None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:00.604964 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 442/870] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:00.606302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87f254-2f0a-4526-84d0-9a13fd99eca7 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:00.649521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:00.709061 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87f254-2f0a-4526-84d0-9a13fd99eca7 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:00.744679 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93ebee-89d4-48fd-a2cc-fcdf8ff091a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:00.745307 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93ebee-89d4-48fd-a2cc-fcdf8ff091a8 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:00.745583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93ebee-89d4-48fd-a2cc-fcdf8ff091a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:00.745851 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93ebee-89d4-48fd-a2cc-fcdf8ff091a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:00.753500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93ebee-89d4-48fd-a2cc-fcdf8ff091a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:00.754849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93ebee-89d4-48fd-a2cc-fcdf8ff091a8 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:00.766491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-5c93ebee-89d4-48fd-a2cc-fcdf8ff091a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:03:00.766491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:00.766491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:00.766491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:00.766491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:00.766491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:00.766491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:00.766491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:00.766491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:00.766491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:00.766491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:00.766491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:00.766491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:03:00.766491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:03:00.766491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:03:00.767475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:03:00.767475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:00.767475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:00.767475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:00.767475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:00.767475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:00.767475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:00.767475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:00.767475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:00.767475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:00.767475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:00.767475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:00.767475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:00.767475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:00.767475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:00.767475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:00.767475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:00.768385 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:03:00.768385 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:03:00.768385 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:03:00.768385 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:03:00.768385 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:03:00.768385 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:03:00.768385 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:03:00.768385 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:00.768385 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 429/871] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:03:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:00.773515 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba3181-8bdd-4bdc-84cd-fd99e81209bf None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:00.881217 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba3181-8bdd-4bdc-84cd-fd99e81209bf None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:00.916900 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da01a0c-c2f1-4b13-b5ec-89325319ed26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:00.917511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da01a0c-c2f1-4b13-b5ec-89325319ed26 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:00.917793 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da01a0c-c2f1-4b13-b5ec-89325319ed26 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:00.918069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da01a0c-c2f1-4b13-b5ec-89325319ed26 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:00.918761 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da01a0c-c2f1-4b13-b5ec-89325319ed26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:00.919093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da01a0c-c2f1-4b13-b5ec-89325319ed26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:00.923739 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da01a0c-c2f1-4b13-b5ec-89325319ed26 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:00.934039 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 443/872] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:03:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:00.939759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93ebee-89d4-48fd-a2cc-fcdf8ff091a8 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:01.014771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7205b0a-b392-49a2-b5cf-ffd26c0df424 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:01.019066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7205b0a-b392-49a2-b5cf-ffd26c0df424 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:01.019066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7205b0a-b392-49a2-b5cf-ffd26c0df424 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:01.019066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 444/873] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:01.021888 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56ffc3-e087-4ea3-9f36-79703fc9b421 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:01.022172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56ffc3-e087-4ea3-9f36-79703fc9b421 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:01.022442 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56ffc3-e087-4ea3-9f36-79703fc9b421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:01.040588 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3d56ffc3-e087-4ea3-9f36-79703fc9b421 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:01.041822 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3d56ffc3-e087-4ea3-9f36-79703fc9b421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:01.057927 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:01.063623 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:01.064119 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93ebee-89d4-48fd-a2cc-fcdf8ff091a8 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:01.101875 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cfb70-27c8-431b-81aa-5718b4f6698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:01.102482 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cfb70-27c8-431b-81aa-5718b4f6698e None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:01.102759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cfb70-27c8-431b-81aa-5718b4f6698e None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:01.103120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cfb70-27c8-431b-81aa-5718b4f6698e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:01.103844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cfb70-27c8-431b-81aa-5718b4f6698e None admin] RBAC: Adding query filter params (role.id=434a1fd874d24b959bf48fe61633f240, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=182eec86daa44cd48d6ef1c38f58e89d) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:01.104154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cfb70-27c8-431b-81aa-5718b4f6698e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:01.105731 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cfb70-27c8-431b-81aa-5718b4f6698e None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:01.114201 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 430/874] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:03:00 2022] GET /identity/v3/role_assignments?user.id=182eec86daa44cd48d6ef1c38f58e89d&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=434a1fd874d24b959bf48fe61633f240 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:01.115471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0513d-801b-49ed-b391-1b1e3e796752 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:01.115754 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0513d-801b-49ed-b391-1b1e3e796752 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:01.116022 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0513d-801b-49ed-b391-1b1e3e796752 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:01.117527 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 431/875] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:01.123258 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2afcf5-4eb6-4250-9f96-e335fc94b9c5 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:01.123507 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2afcf5-4eb6-4250-9f96-e335fc94b9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:01.123763 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2afcf5-4eb6-4250-9f96-e335fc94b9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:01.137732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 445/876] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:01 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 13:03:01.147120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-7f2afcf5-4eb6-4250-9f96-e335fc94b9c5 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:01.149756 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7f2afcf5-4eb6-4250-9f96-e335fc94b9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:01.162442 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56ffc3-e087-4ea3-9f36-79703fc9b421 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:01.256819 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 432/877] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:01 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 13:03:01.285003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2afcf5-4eb6-4250-9f96-e335fc94b9c5 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:01.307812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56ffc3-e087-4ea3-9f36-79703fc9b421 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:01.361840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2e7b2-4b7c-4392-aaee-d57db228e07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:01.363096 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2e7b2-4b7c-4392-aaee-d57db228e07c None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:01.363221 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2e7b2-4b7c-4392-aaee-d57db228e07c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:01.363462 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2e7b2-4b7c-4392-aaee-d57db228e07c None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:01.364266 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2e7b2-4b7c-4392-aaee-d57db228e07c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:01.365671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2e7b2-4b7c-4392-aaee-d57db228e07c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:01.382813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 446/878] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 10 13:03:01 2022] POST /identity/v3/services => generated 269 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:03:01.384108 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed46573-c9f1-415d-8b0a-5bc21d53ef19 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:01.384394 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed46573-c9f1-415d-8b0a-5bc21d53ef19 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:01.384670 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed46573-c9f1-415d-8b0a-5bc21d53ef19 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:01.392108 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 447/879] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:01.398825 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce6d3f-7053-4632-8456-84495b5cf1ab None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:01.399132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce6d3f-7053-4632-8456-84495b5cf1ab None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:01.399410 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce6d3f-7053-4632-8456-84495b5cf1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:01.418050 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:01.427947 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2afcf5-4eb6-4250-9f96-e335fc94b9c5 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:01.431214 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a5ce6d3f-7053-4632-8456-84495b5cf1ab None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:01.432459 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a5ce6d3f-7053-4632-8456-84495b5cf1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:01.443924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:01.483239 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c5698-e021-4d74-9fee-46c269e047d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:01.484320 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c5698-e021-4d74-9fee-46c269e047d7 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:01.484839 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c5698-e021-4d74-9fee-46c269e047d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:01.485322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c5698-e021-4d74-9fee-46c269e047d7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:01.486151 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c5698-e021-4d74-9fee-46c269e047d7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:01.489632 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c5698-e021-4d74-9fee-46c269e047d7 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:01.500844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-087c5698-e021-4d74-9fee-46c269e047d7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 13:03:01.500844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:01.500844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:03:01.500844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:03:01.500844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:03:01.500844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:03:01.500844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:03:01.500844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:01.500844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 13:03:01.500844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:01.500844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:03:01.500844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:01.500844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:01.500844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:01.500844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:01.500844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:01.500844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:01.502068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:01.502068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:01.502068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:01.502068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:01.502068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:01.502068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:01.502068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:03:01.502068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:03:01.502068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:03:01.502068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:03:01.502068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:01.502068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:01.502068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:01.502068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:01.502068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:01.502068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:01.502941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:01.502941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:01.502941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:01.502941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:01.502941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:01.502941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:01.502941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:01.502941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:01.502941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:01.502941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:01.502941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:03:01.502941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:01.502941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 13:03:01.502941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:01.505959 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 433/880] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Aug 10 13:03:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:01.510689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 448/881] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 13:03:01.520939 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c5698-e021-4d74-9fee-46c269e047d7 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:01.533494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce6d3f-7053-4632-8456-84495b5cf1ab None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:01.663575 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c5698-e021-4d74-9fee-46c269e047d7 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:01.667456 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce6d3f-7053-4632-8456-84495b5cf1ab None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:01.705222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41745dbf-6341-4071-b39a-542b9b14f95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:01.705953 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41745dbf-6341-4071-b39a-542b9b14f95f None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:01.706256 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41745dbf-6341-4071-b39a-542b9b14f95f None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:01.706611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41745dbf-6341-4071-b39a-542b9b14f95f None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:01.707334 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41745dbf-6341-4071-b39a-542b9b14f95f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:01.707640 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41745dbf-6341-4071-b39a-542b9b14f95f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:01.709093 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41745dbf-6341-4071-b39a-542b9b14f95f None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:01.711742 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c294c1-cb08-4d4c-9aba-0889ed0295dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:01.712372 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c294c1-cb08-4d4c-9aba-0889ed0295dc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:01.712648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c294c1-cb08-4d4c-9aba-0889ed0295dc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:01.712915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c294c1-cb08-4d4c-9aba-0889ed0295dc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:01.713494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c294c1-cb08-4d4c-9aba-0889ed0295dc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:01.714520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 434/882] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Aug 10 13:03:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:01.715014 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c294c1-cb08-4d4c-9aba-0889ed0295dc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:01.720349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41745dbf-6341-4071-b39a-542b9b14f95f None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:01.725002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-73c294c1-cb08-4d4c-9aba-0889ed0295dc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 13:03:01.725002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:01.725002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:03:01.725002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:03:01.725002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:03:01.725002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:03:01.725002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:03:01.725002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:01.725002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 13:03:01.725002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:01.725002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:03:01.725002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:01.725002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:01.725002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:01.725002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:01.725002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:01.725002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:01.726042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:01.726042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:01.726042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:01.726042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:01.726042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:01.726042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:01.726042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:03:01.726042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:03:01.726042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:03:01.726042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:03:01.726042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:01.726042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:01.726042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:01.726042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:01.726042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:01.726042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:01.726891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:01.726891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:01.726891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:01.726891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:01.726891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:01.726891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:01.726891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:01.726891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:01.726891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:01.726891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:01.726891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:03:01.726891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:01.726891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 13:03:01.726891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:01.727689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 449/883] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 10 13:03:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:01.732548 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c294c1-cb08-4d4c-9aba-0889ed0295dc None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:01.742391 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:01.749332 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:01.829341 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41745dbf-6341-4071-b39a-542b9b14f95f None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:01.865393 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c294c1-cb08-4d4c-9aba-0889ed0295dc None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:01.866942 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc920b31-a1c2-4c1d-8eea-f35b2f00b9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:01.867655 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc920b31-a1c2-4c1d-8eea-f35b2f00b9ff None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:01.868029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc920b31-a1c2-4c1d-8eea-f35b2f00b9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:01.868369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc920b31-a1c2-4c1d-8eea-f35b2f00b9ff None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:01.869558 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc920b31-a1c2-4c1d-8eea-f35b2f00b9ff None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:01.869558 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc920b31-a1c2-4c1d-8eea-f35b2f00b9ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:01.870817 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc920b31-a1c2-4c1d-8eea-f35b2f00b9ff None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:01.883489 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 435/884] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Aug 10 13:03:01 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:01.907125 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d098d-fbc7-4af8-9ed6-5000779fec4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:01.908099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d098d-fbc7-4af8-9ed6-5000779fec4a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:01.908558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d098d-fbc7-4af8-9ed6-5000779fec4a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:01.909006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d098d-fbc7-4af8-9ed6-5000779fec4a None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:01.909978 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d098d-fbc7-4af8-9ed6-5000779fec4a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:01.911060 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d098d-fbc7-4af8-9ed6-5000779fec4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:01.912698 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d098d-fbc7-4af8-9ed6-5000779fec4a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:01.919226 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 450/885] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 10 13:03:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:01.931223 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc920b31-a1c2-4c1d-8eea-f35b2f00b9ff None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:02.031404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:02.053735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc920b31-a1c2-4c1d-8eea-f35b2f00b9ff None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:02.092589 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d6126-0404-4a20-a4c5-1d2c36404034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:02.093200 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d6126-0404-4a20-a4c5-1d2c36404034 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:02.093729 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d6126-0404-4a20-a4c5-1d2c36404034 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:02.094004 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d6126-0404-4a20-a4c5-1d2c36404034 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:02.094619 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d6126-0404-4a20-a4c5-1d2c36404034 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:02.094915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d6126-0404-4a20-a4c5-1d2c36404034 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:02.096363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d6126-0404-4a20-a4c5-1d2c36404034 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:02.103143 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 436/886] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 10 13:03:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:02.108963 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d098d-fbc7-4af8-9ed6-5000779fec4a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:02.184584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:02.215440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d098d-fbc7-4af8-9ed6-5000779fec4a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:02.248731 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3af8a-2121-4efd-99e6-4a08fe10491c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:02.249332 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3af8a-2121-4efd-99e6-4a08fe10491c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:02.249652 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3af8a-2121-4efd-99e6-4a08fe10491c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:02.249922 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3af8a-2121-4efd-99e6-4a08fe10491c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:02.250611 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3af8a-2121-4efd-99e6-4a08fe10491c None admin] RBAC: Adding query filter params (interface=public, service_id=864429592dd348d5a29fd35d7d4776b4, region_id=RegionOne) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:02.250911 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3af8a-2121-4efd-99e6-4a08fe10491c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:02.252295 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3af8a-2121-4efd-99e6-4a08fe10491c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:02.261505 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 451/887] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Aug 10 13:03:02 2022] GET /identity/v3/endpoints?service_id=864429592dd348d5a29fd35d7d4776b4&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:02.267039 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d6126-0404-4a20-a4c5-1d2c36404034 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:02.374123 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d6126-0404-4a20-a4c5-1d2c36404034 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:02.414504 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1b647-7bec-4489-b83b-a2d5b6f74c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:02.415507 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1b647-7bec-4489-b83b-a2d5b6f74c6a None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:02.415991 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1b647-7bec-4489-b83b-a2d5b6f74c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:02.416496 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1b647-7bec-4489-b83b-a2d5b6f74c6a None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:02.417308 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1b647-7bec-4489-b83b-a2d5b6f74c6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:02.418870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1b647-7bec-4489-b83b-a2d5b6f74c6a None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:02.425938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 437/888] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Aug 10 13:03:02 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:03:03.320552 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049e8be-d707-4b1c-8262-dbd944dce30c None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:03.321079 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049e8be-d707-4b1c-8262-dbd944dce30c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:03.321356 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049e8be-d707-4b1c-8262-dbd944dce30c None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:03.322758 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 452/889] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:03.328540 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20634f0-3fc5-4080-b46a-8fccc47a91c9 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:03.329102 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20634f0-3fc5-4080-b46a-8fccc47a91c9 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:03.329639 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20634f0-3fc5-4080-b46a-8fccc47a91c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:03.349829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-c20634f0-3fc5-4080-b46a-8fccc47a91c9 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:03.351405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c20634f0-3fc5-4080-b46a-8fccc47a91c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:03.355760 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:03.427973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 438/890] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:03.450705 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049e8be-d707-4b1c-8262-dbd944dce30c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:03.561609 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049e8be-d707-4b1c-8262-dbd944dce30c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:03.599866 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a52236-008f-49c0-829e-8fc1613f2640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:03.600424 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a52236-008f-49c0-829e-8fc1613f2640 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:03.600708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a52236-008f-49c0-829e-8fc1613f2640 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:03.600980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a52236-008f-49c0-829e-8fc1613f2640 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:03.604021 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:03.614362 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a52236-008f-49c0-829e-8fc1613f2640 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:03:03.619103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-06a52236-008f-49c0-829e-8fc1613f2640 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 13:03:03.619103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:03.619103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:03.619103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:03.619103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:03.619103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:03.619103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:03.619103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:03.619103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:03.619103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:03.619103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:03.619103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:03.619103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:03:03.619103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:03:03.619103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:03:03.619103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:03:03.620093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:03:03.620093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:03:03.620093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:03:03.620093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:03:03.620093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:03.620093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:03.620093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:03.620093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:03.620093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:03.620093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:03.620093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:03.620093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:03.620093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:03.620093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:03.620093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:03.620093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:03.620972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:03.620972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:03.620972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:03.620972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:03.620972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:03:03.620972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:03:03.620972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:03:03.620972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:03:03.620972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:03:03.620972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:03:03.620972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 13:03:03.620972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:03.620972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 453/891] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Aug 10 13:03:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:03.626439 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20634f0-3fc5-4080-b46a-8fccc47a91c9 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:03.651962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9316b9a-eba7-43e7-97f0-b1718215d462 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:03.652759 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9316b9a-eba7-43e7-97f0-b1718215d462 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:03.653293 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9316b9a-eba7-43e7-97f0-b1718215d462 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:03.655861 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 454/892] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:03:03.662718 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91181ae7-11b2-4829-af02-d47effd35f49 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:03.663453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91181ae7-11b2-4829-af02-d47effd35f49 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:03.664207 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91181ae7-11b2-4829-af02-d47effd35f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:03.694246 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-91181ae7-11b2-4829-af02-d47effd35f49 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:03.696693 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-91181ae7-11b2-4829-af02-d47effd35f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:03.791237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20634f0-3fc5-4080-b46a-8fccc47a91c9 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:03.811056 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 455/893] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 13:03:03.839395 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91181ae7-11b2-4829-af02-d47effd35f49 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:03.840577 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592d47a-d3c4-4fe1-8094-16fbec7ac646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:03.841386 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592d47a-d3c4-4fe1-8094-16fbec7ac646 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:03.841864 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592d47a-d3c4-4fe1-8094-16fbec7ac646 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:03.842291 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592d47a-d3c4-4fe1-8094-16fbec7ac646 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:03.843127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592d47a-d3c4-4fe1-8094-16fbec7ac646 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:03.843884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592d47a-d3c4-4fe1-8094-16fbec7ac646 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:03.845424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592d47a-d3c4-4fe1-8094-16fbec7ac646 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:03.859600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 439/894] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Aug 10 13:03:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:03.861771 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592d47a-d3c4-4fe1-8094-16fbec7ac646 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:03.865346 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:03.982472 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91181ae7-11b2-4829-af02-d47effd35f49 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:03.982945 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592d47a-d3c4-4fe1-8094-16fbec7ac646 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:04.017437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:04.026178 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41489acd-acaf-4b55-b8d5-4f2b6c7a1f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:04.027173 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41489acd-acaf-4b55-b8d5-4f2b6c7a1f04 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:04.027637 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41489acd-acaf-4b55-b8d5-4f2b6c7a1f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:04.028088 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41489acd-acaf-4b55-b8d5-4f2b6c7a1f04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:04.030864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4e0ec-0905-4d26-8972-649fe480b73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:04.031974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4e0ec-0905-4d26-8972-649fe480b73f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:04.032330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4e0ec-0905-4d26-8972-649fe480b73f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:04.032678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4e0ec-0905-4d26-8972-649fe480b73f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:04.033359 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4e0ec-0905-4d26-8972-649fe480b73f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:04.034864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4e0ec-0905-4d26-8972-649fe480b73f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:04.042598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41489acd-acaf-4b55-b8d5-4f2b6c7a1f04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:04.044428 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41489acd-acaf-4b55-b8d5-4f2b6c7a1f04 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:04.046383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c6e4e0ec-0905-4d26-8972-649fe480b73f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 13:03:04.046383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:04.046383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:03:04.046383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:03:04.046383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:03:04.046383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:03:04.046383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:03:04.046383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:04.046383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 13:03:04.046383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:04.046383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:03:04.046383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:04.046383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:04.046383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:04.046383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:04.046383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:04.047369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:04.047369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:04.047369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:04.047369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:04.047369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:04.047369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:04.047369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:04.047369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:03:04.047369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:03:04.047369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:03:04.047369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:03:04.047369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:04.047369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:04.047369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:04.047369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:04.047369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:04.047369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:04.048298 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:04.048298 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:04.048298 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:04.048298 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:04.048298 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:04.048298 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:04.048298 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:04.048298 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:04.048298 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:04.048298 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:04.048298 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:03:04.048298 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:04.048298 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 13:03:04.048298 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:04.051165 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 456/895] 10.222.0.46 () {56 vars in 1132 bytes} [Wed Aug 10 13:03:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:04.055552 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4e0ec-0905-4d26-8972-649fe480b73f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:04.066420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-41489acd-acaf-4b55-b8d5-4f2b6c7a1f04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:04.066420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:04.066420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:04.066420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:04.066420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:04.066420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:04.066420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:04.066420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:04.066420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:04.066420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:04.066420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:04.066420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:04.066420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:03:04.066420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:03:04.066420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:03:04.066420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:03:04.067494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:04.067494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:04.067494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:04.067494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:04.067494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:04.067494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:04.067494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:04.067494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:04.067494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:04.067494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:04.067494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:04.067494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:04.067494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:04.067494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:04.067494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:04.067494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:04.067494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:03:04.068404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:03:04.068404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:04.068404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:04.069138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 440/896] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:04.070674 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035dcc4-7e62-4049-83f7-23e1637f4545 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:04.071188 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035dcc4-7e62-4049-83f7-23e1637f4545 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:04.071680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035dcc4-7e62-4049-83f7-23e1637f4545 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:04.073276 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 441/897] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:04.074281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035dcc4-7e62-4049-83f7-23e1637f4545 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:04.150669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:04.177755 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4e0ec-0905-4d26-8972-649fe480b73f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:04.203439 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035dcc4-7e62-4049-83f7-23e1637f4545 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:04.215048 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299708d9-4320-4a46-896f-c58dc5fe761a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:04.215694 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299708d9-4320-4a46-896f-c58dc5fe761a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:04.215946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299708d9-4320-4a46-896f-c58dc5fe761a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:04.216222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299708d9-4320-4a46-896f-c58dc5fe761a None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:04.216891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299708d9-4320-4a46-896f-c58dc5fe761a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:04.217177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299708d9-4320-4a46-896f-c58dc5fe761a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:04.218864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299708d9-4320-4a46-896f-c58dc5fe761a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:04.229506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 457/898] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Aug 10 13:03:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:04.229506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcb22e-72ac-49ad-b267-16731d093ba6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:04.229506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcb22e-72ac-49ad-b267-16731d093ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:04.229506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcb22e-72ac-49ad-b267-16731d093ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:04.246488 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-37fcb22e-72ac-49ad-b267-16731d093ba6 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:04.247853 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-37fcb22e-72ac-49ad-b267-16731d093ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:04.250255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac154de0-c356-4cac-b6ae-815226153bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:04.250884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac154de0-c356-4cac-b6ae-815226153bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:04.251217 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac154de0-c356-4cac-b6ae-815226153bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:04.251488 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac154de0-c356-4cac-b6ae-815226153bb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:04.252150 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac154de0-c356-4cac-b6ae-815226153bb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:04.252450 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac154de0-c356-4cac-b6ae-815226153bb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:04.254478 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac154de0-c356-4cac-b6ae-815226153bb5 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:04.268040 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 442/899] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:04.273469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac154de0-c356-4cac-b6ae-815226153bb5 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:04.305467 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:04.327048 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 458/900] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:04.327048 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcb22e-72ac-49ad-b267-16731d093ba6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:04.398193 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac154de0-c356-4cac-b6ae-815226153bb5 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:04.414796 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:04.440537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cbd15-bef5-4024-a138-9fb6a3cb4849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:04.441204 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcb22e-72ac-49ad-b267-16731d093ba6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:04.441292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cbd15-bef5-4024-a138-9fb6a3cb4849 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:04.441530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cbd15-bef5-4024-a138-9fb6a3cb4849 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:04.441707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cbd15-bef5-4024-a138-9fb6a3cb4849 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:04.442348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189cbd15-bef5-4024-a138-9fb6a3cb4849 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:04.442727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189cbd15-bef5-4024-a138-9fb6a3cb4849 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:04.444236 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189cbd15-bef5-4024-a138-9fb6a3cb4849 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:04.454184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 443/901] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Aug 10 13:03:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:04.455034 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cbd15-bef5-4024-a138-9fb6a3cb4849 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:04.478054 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f4d6c-428d-404c-bad8-ecfcd656d6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:04.478689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f4d6c-428d-404c-bad8-ecfcd656d6ce None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:04.478967 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f4d6c-428d-404c-bad8-ecfcd656d6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:04.479267 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f4d6c-428d-404c-bad8-ecfcd656d6ce None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:04.487374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f4d6c-428d-404c-bad8-ecfcd656d6ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:04.489700 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f4d6c-428d-404c-bad8-ecfcd656d6ce None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:04.503945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-506f4d6c-428d-404c-bad8-ecfcd656d6ce None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 13:03:04.503945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:04.503945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:04.503945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:04.503945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:04.503945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:04.503945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:04.503945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:04.503945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:04.503945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:04.503945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:04.503945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:04.503945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:03:04.503945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:03:04.503945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:03:04.503945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:03:04.505160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:04.505160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:04.505160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:03:04.505160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:03:04.505160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:03:04.505160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:03:04.505160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:04.505160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:04.505160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:04.505160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:04.505160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:04.505160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:04.505160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:04.505160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:04.505160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:04.505160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:04.505160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:04.505160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:04.506163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:04.506163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:04.506163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:03:04.506163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:03:04.506163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:03:04.506163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:03:04.506163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:03:04.506163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:03:04.506163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 13:03:04.506163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:04.506163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 459/902] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Aug 10 13:03:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:04.506163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f4d6c-428d-404c-bad8-ecfcd656d6ce None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:04.552332 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:04.558066 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cbd15-bef5-4024-a138-9fb6a3cb4849 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:04.591661 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7853a9d-19f0-4ac4-9433-eed92bbdd8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:04.592271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7853a9d-19f0-4ac4-9433-eed92bbdd8cf None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:04.592549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7853a9d-19f0-4ac4-9433-eed92bbdd8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:04.592821 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7853a9d-19f0-4ac4-9433-eed92bbdd8cf None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:04.593711 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7853a9d-19f0-4ac4-9433-eed92bbdd8cf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:04.595145 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7853a9d-19f0-4ac4-9433-eed92bbdd8cf None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:04.608366 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f4d6c-428d-404c-bad8-ecfcd656d6ce None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:04.610463 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 444/903] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 10 13:03:04 2022] POST /identity/v3/services => generated 241 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:03:04.611797 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2fc0c-7dd9-4afc-a4bb-019a84f7d4bb None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:04.611973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2fc0c-7dd9-4afc-a4bb-019a84f7d4bb None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:04.612251 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2fc0c-7dd9-4afc-a4bb-019a84f7d4bb None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:04.615147 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 445/904] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:04.616230 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2fc0c-7dd9-4afc-a4bb-019a84f7d4bb None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:04.657522 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405391ea-c439-4c34-bcf4-7bcb7ebc6821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:04.658141 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405391ea-c439-4c34-bcf4-7bcb7ebc6821 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:04.658420 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405391ea-c439-4c34-bcf4-7bcb7ebc6821 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:04.658689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405391ea-c439-4c34-bcf4-7bcb7ebc6821 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:04.659530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405391ea-c439-4c34-bcf4-7bcb7ebc6821 None admin] RBAC: Adding query filter params (interface=public, service_id=52e4c3e8249f4101af755f0550a30376, region_id=RegionOne) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:04.660356 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405391ea-c439-4c34-bcf4-7bcb7ebc6821 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:04.661810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405391ea-c439-4c34-bcf4-7bcb7ebc6821 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:04.665961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:04.675069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 460/905] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Aug 10 13:03:04 2022] GET /identity/v3/endpoints?service_id=52e4c3e8249f4101af755f0550a30376&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:04.675069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a3081-57aa-4d9e-a40a-244fe174d417 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:04.675069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a3081-57aa-4d9e-a40a-244fe174d417 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:04.675069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a3081-57aa-4d9e-a40a-244fe174d417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:04.695398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-111a3081-57aa-4d9e-a40a-244fe174d417 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:04.696662 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-111a3081-57aa-4d9e-a40a-244fe174d417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:04.758753 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2fc0c-7dd9-4afc-a4bb-019a84f7d4bb None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:04.792725 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 461/906] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:04.793498 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a3081-57aa-4d9e-a40a-244fe174d417 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:04.811414 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3d977-45b4-48df-8941-0a8fce54a28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:04.812453 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3d977-45b4-48df-8941-0a8fce54a28a None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:04.813048 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3d977-45b4-48df-8941-0a8fce54a28a None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:04.813328 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3d977-45b4-48df-8941-0a8fce54a28a None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:04.814307 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3d977-45b4-48df-8941-0a8fce54a28a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:04.814618 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3d977-45b4-48df-8941-0a8fce54a28a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:04.816125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3d977-45b4-48df-8941-0a8fce54a28a None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:04.834876 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:04.839324 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 446/907] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Aug 10 13:03:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:04.839681 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3d977-45b4-48df-8941-0a8fce54a28a None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:04.909678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a3081-57aa-4d9e-a40a-244fe174d417 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:04.936361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:04.943507 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3d977-45b4-48df-8941-0a8fce54a28a None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:04.946631 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2bbff-e26f-4f91-88f2-434f0f47d88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:04.947265 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2bbff-e26f-4f91-88f2-434f0f47d88b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:04.947541 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2bbff-e26f-4f91-88f2-434f0f47d88b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:04.947809 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2bbff-e26f-4f91-88f2-434f0f47d88b None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:04.948410 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2bbff-e26f-4f91-88f2-434f0f47d88b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:04.949772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2bbff-e26f-4f91-88f2-434f0f47d88b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:04.957102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 462/908] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Aug 10 13:03:04 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:03:04.957902 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2bbff-e26f-4f91-88f2-434f0f47d88b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:05.007454 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3999f76-04b3-4654-9a9e-9c1935bd2bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:05.008364 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3999f76-04b3-4654-9a9e-9c1935bd2bcd None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:05.008818 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3999f76-04b3-4654-9a9e-9c1935bd2bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:05.009279 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3999f76-04b3-4654-9a9e-9c1935bd2bcd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:05.010154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3999f76-04b3-4654-9a9e-9c1935bd2bcd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:05.011564 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3999f76-04b3-4654-9a9e-9c1935bd2bcd None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:05.021738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-b3999f76-04b3-4654-9a9e-9c1935bd2bcd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 13:03:05.021738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:05.021738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:03:05.021738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:03:05.021738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:03:05.021738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:03:05.021738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:03:05.021738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:05.021738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 13:03:05.021738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:05.021738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:03:05.021738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:05.021738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:05.021738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:05.021738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:05.021738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:05.021738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:05.022840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:05.022840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:05.022840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:05.022840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:05.022840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:05.022840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:05.022840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:03:05.022840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:03:05.022840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:03:05.022840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:03:05.022840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:05.022840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:05.022840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:05.022840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:05.022840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:05.022840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:05.024108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:05.024108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:05.024108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:05.024108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:05.024108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:05.024108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:05.024108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:05.024108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:05.024108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:05.024108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:05.024108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:03:05.024108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:05.024108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 13:03:05.024108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:05.024108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 447/909] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 10 13:03:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:05.029222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3999f76-04b3-4654-9a9e-9c1935bd2bcd None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:05.081526 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:05.086668 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2bbff-e26f-4f91-88f2-434f0f47d88b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:05.131913 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc0404-8506-4fc7-a51c-c69ea855bd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:05.132852 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc0404-8506-4fc7-a51c-c69ea855bd51 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:05.133307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc0404-8506-4fc7-a51c-c69ea855bd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:05.133806 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc0404-8506-4fc7-a51c-c69ea855bd51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:05.167958 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3999f76-04b3-4654-9a9e-9c1935bd2bcd None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:05.209715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fa0a0-ccae-4368-b0aa-19e525ac49b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:05.210362 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fa0a0-ccae-4368-b0aa-19e525ac49b6 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:05.210666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc0404-8506-4fc7-a51c-c69ea855bd51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:05.210797 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fa0a0-ccae-4368-b0aa-19e525ac49b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:05.211059 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fa0a0-ccae-4368-b0aa-19e525ac49b6 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:05.211749 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fa0a0-ccae-4368-b0aa-19e525ac49b6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:05.212117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fa0a0-ccae-4368-b0aa-19e525ac49b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:05.213011 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc0404-8506-4fc7-a51c-c69ea855bd51 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:05.213596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fa0a0-ccae-4368-b0aa-19e525ac49b6 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:05.220271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 448/910] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 10 13:03:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:05.227964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fa0a0-ccae-4368-b0aa-19e525ac49b6 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:05.279378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:05.340975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:05.348284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 463/911] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:03:04 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 13:03:05.353406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc0404-8506-4fc7-a51c-c69ea855bd51 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:05.366153 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fa0a0-ccae-4368-b0aa-19e525ac49b6 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:05.417079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d7238-6c16-45ef-9e9d-7ff5ef2f2c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:05.417700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d7238-6c16-45ef-9e9d-7ff5ef2f2c87 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:05.417980 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d7238-6c16-45ef-9e9d-7ff5ef2f2c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:05.418256 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d7238-6c16-45ef-9e9d-7ff5ef2f2c87 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:05.418891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d7238-6c16-45ef-9e9d-7ff5ef2f2c87 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:05.419232 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d7238-6c16-45ef-9e9d-7ff5ef2f2c87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:05.420630 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d7238-6c16-45ef-9e9d-7ff5ef2f2c87 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:05.427183 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 449/912] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 10 13:03:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:05.435934 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d7238-6c16-45ef-9e9d-7ff5ef2f2c87 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:05.482680 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc0404-8506-4fc7-a51c-c69ea855bd51 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:05.528273 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddfe61-a726-4969-95e8-907642c3d272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:05.529366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:05.530700 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddfe61-a726-4969-95e8-907642c3d272 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:05.531130 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddfe61-a726-4969-95e8-907642c3d272 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:05.531699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddfe61-a726-4969-95e8-907642c3d272 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:05.543755 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d7238-6c16-45ef-9e9d-7ff5ef2f2c87 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:05.547249 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddfe61-a726-4969-95e8-907642c3d272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:05.548768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddfe61-a726-4969-95e8-907642c3d272 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:05.571187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-82ddfe61-a726-4969-95e8-907642c3d272 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:05.571187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:05.571187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:05.571187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:05.571187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:05.571187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:05.571187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:05.571187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:05.571187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:05.571187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:05.571187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:05.571187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:05.571187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:03:05.571187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:03:05.571187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:03:05.571187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:03:05.572215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:05.572215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:05.572215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:05.572215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:05.572215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:05.572215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:05.572215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:05.572215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:05.572215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:05.572215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:05.572215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:05.572215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:05.572215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:05.572215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:05.572215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:05.572215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:05.572215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:03:05.573126 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:03:05.573126 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:05.573126 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:05.579804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 464/913] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:05.581283 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddfe61-a726-4969-95e8-907642c3d272 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:05.591152 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e5a46-fa12-4804-8f74-d4327a714b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:05.591756 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e5a46-fa12-4804-8f74-d4327a714b00 None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:05.592029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e5a46-fa12-4804-8f74-d4327a714b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:05.592297 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e5a46-fa12-4804-8f74-d4327a714b00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:05.592947 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e5a46-fa12-4804-8f74-d4327a714b00 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:05.594553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e5a46-fa12-4804-8f74-d4327a714b00 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:05.620428 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 450/914] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:03:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:03:05.653631 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:05.712851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddfe61-a726-4969-95e8-907642c3d272 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:05.757624 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18605382-1192-4421-a231-0c3c8a5bdd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:05.758154 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18605382-1192-4421-a231-0c3c8a5bdd98 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:05.758443 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18605382-1192-4421-a231-0c3c8a5bdd98 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:05.758697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18605382-1192-4421-a231-0c3c8a5bdd98 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:05.759387 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18605382-1192-4421-a231-0c3c8a5bdd98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:05.759716 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18605382-1192-4421-a231-0c3c8a5bdd98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:05.761089 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18605382-1192-4421-a231-0c3c8a5bdd98 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:05.775409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 465/915] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:05.781549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e5a46-fa12-4804-8f74-d4327a714b00 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:05.894326 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e5a46-fa12-4804-8f74-d4327a714b00 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:05.930113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe89f95-a276-4a18-9e2d-bf87a0ac3f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:05.930739 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe89f95-a276-4a18-9e2d-bf87a0ac3f63 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:05.931031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe89f95-a276-4a18-9e2d-bf87a0ac3f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:05.931308 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe89f95-a276-4a18-9e2d-bf87a0ac3f63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:05.938026 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe89f95-a276-4a18-9e2d-bf87a0ac3f63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:05.939534 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe89f95-a276-4a18-9e2d-bf87a0ac3f63 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:05.951500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-afe89f95-a276-4a18-9e2d-bf87a0ac3f63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:03:05.951500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:05.951500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:05.951500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:05.951500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:05.951500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:05.951500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:05.951500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:05.951500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:05.951500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:05.951500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:05.951500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:05.951500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:03:05.951500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:03:05.951500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:03:05.952474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:03:05.952474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:05.952474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:05.952474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:05.952474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:05.952474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:05.952474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:05.952474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:05.952474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:05.952474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:05.952474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:05.952474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:05.952474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:05.952474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:05.952474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:05.952474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:05.952474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:05.953427 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:03:05.953427 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:03:05.953427 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:03:05.953427 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:03:05.953427 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:03:05.953427 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:03:05.953427 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:03:05.953427 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:05.953427 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 451/916] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:03:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:05.960329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18605382-1192-4421-a231-0c3c8a5bdd98 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:06.066277 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18605382-1192-4421-a231-0c3c8a5bdd98 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:06.087376 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:06.101640 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154a717-80ab-4aa5-9e7c-4f9ac6235277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:06.102247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154a717-80ab-4aa5-9e7c-4f9ac6235277 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:06.102520 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154a717-80ab-4aa5-9e7c-4f9ac6235277 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:06.102789 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154a717-80ab-4aa5-9e7c-4f9ac6235277 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:06.103507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154a717-80ab-4aa5-9e7c-4f9ac6235277 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:06.103872 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154a717-80ab-4aa5-9e7c-4f9ac6235277 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:06.105302 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154a717-80ab-4aa5-9e7c-4f9ac6235277 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:06.118383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 466/917] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:03:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:06.124569 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe89f95-a276-4a18-9e2d-bf87a0ac3f63 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:06.139397 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:06.238483 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe89f95-a276-4a18-9e2d-bf87a0ac3f63 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:06.273633 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefc900-116e-46b5-9440-f60410a2e3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:06.274238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefc900-116e-46b5-9440-f60410a2e3ea None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:06.274511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefc900-116e-46b5-9440-f60410a2e3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:06.274777 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefc900-116e-46b5-9440-f60410a2e3ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:06.275519 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefc900-116e-46b5-9440-f60410a2e3ea None admin] RBAC: Adding query filter params (role.id=4bbe1d7eee2c44329a4173574fab0f68, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=182eec86daa44cd48d6ef1c38f58e89d) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:06.275819 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefc900-116e-46b5-9440-f60410a2e3ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:06.277291 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefc900-116e-46b5-9440-f60410a2e3ea None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:06.283303 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 452/918] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:03:06 2022] GET /identity/v3/role_assignments?user.id=182eec86daa44cd48d6ef1c38f58e89d&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=4bbe1d7eee2c44329a4173574fab0f68 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:06.726007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a076c32-b4fb-4a70-83a6-43fa54f56fc2 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:06.726570 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a076c32-b4fb-4a70-83a6-43fa54f56fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:06.726570 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a076c32-b4fb-4a70-83a6-43fa54f56fc2 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:06.728205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 467/919] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:06.733735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50717a-c583-4933-a5ba-f241122b66a5 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:06.734593 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50717a-c583-4933-a5ba-f241122b66a5 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:06.735106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50717a-c583-4933-a5ba-f241122b66a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:06.754967 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-9d50717a-c583-4933-a5ba-f241122b66a5 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:06.756173 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-9d50717a-c583-4933-a5ba-f241122b66a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:06.831321 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:06.839169 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 453/920] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:06.863526 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a076c32-b4fb-4a70-83a6-43fa54f56fc2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:06.994290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a076c32-b4fb-4a70-83a6-43fa54f56fc2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:07.030187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84156ab-e185-40db-a92f-49a9960e1013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:07.030831 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84156ab-e185-40db-a92f-49a9960e1013 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:07.031142 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84156ab-e185-40db-a92f-49a9960e1013 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:07.031418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84156ab-e185-40db-a92f-49a9960e1013 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:07.032015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84156ab-e185-40db-a92f-49a9960e1013 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:07.033403 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84156ab-e185-40db-a92f-49a9960e1013 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:07.043710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b84156ab-e185-40db-a92f-49a9960e1013 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 13:03:07.043710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:07.043710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:03:07.043710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:03:07.043710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:03:07.043710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:03:07.043710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:03:07.043710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:07.043710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 13:03:07.043710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:07.043710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:03:07.043710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:07.043710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:07.043710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:07.043710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:07.043710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:07.043710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:07.044778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:07.044778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:07.044778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:07.044778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:07.044778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:07.044778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:07.044778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:03:07.044778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:03:07.044778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:03:07.044778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:03:07.044778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:07.044778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:07.044778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:07.044778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:07.044778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:07.044778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:07.045654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:07.045654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:07.045654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:07.045654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:07.045654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:07.045654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:07.045654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:07.045654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:07.045654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:07.045654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:07.045654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:03:07.045654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:07.045654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 13:03:07.045654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:07.045654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 468/921] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Aug 10 13:03:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:07.053289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50717a-c583-4933-a5ba-f241122b66a5 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:07.162319 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50717a-c583-4933-a5ba-f241122b66a5 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:07.201779 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cd7df-af36-42fa-9340-95a42b984866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:07.202754 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cd7df-af36-42fa-9340-95a42b984866 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:07.203298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cd7df-af36-42fa-9340-95a42b984866 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:07.203768 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cd7df-af36-42fa-9340-95a42b984866 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:07.204603 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645cd7df-af36-42fa-9340-95a42b984866 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:07.205107 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645cd7df-af36-42fa-9340-95a42b984866 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:07.206725 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645cd7df-af36-42fa-9340-95a42b984866 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:07.212545 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 454/922] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Aug 10 13:03:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:07.218728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84156ab-e185-40db-a92f-49a9960e1013 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:07.256527 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397770e-ac39-4964-811c-28c0ad6e9792 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:07.257138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397770e-ac39-4964-811c-28c0ad6e9792 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:07.257479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:07.257831 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397770e-ac39-4964-811c-28c0ad6e9792 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:07.259692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 455/923] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:03:07.265352 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cc8d8-e4ef-4ef2-b98d-9b020ba5367f None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:07.265947 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cc8d8-e4ef-4ef2-b98d-9b020ba5367f None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:07.266422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cc8d8-e4ef-4ef2-b98d-9b020ba5367f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:07.285237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-8f6cc8d8-e4ef-4ef2-b98d-9b020ba5367f None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:07.286859 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-8f6cc8d8-e4ef-4ef2-b98d-9b020ba5367f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:07.347688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84156ab-e185-40db-a92f-49a9960e1013 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:07.352076 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:07.371137 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 456/924] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 13:03:07.387312 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cc8d8-e4ef-4ef2-b98d-9b020ba5367f None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:07.387608 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a283a9-040f-4ae8-ba7d-3681982cd2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:07.388285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a283a9-040f-4ae8-ba7d-3681982cd2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:07.388571 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a283a9-040f-4ae8-ba7d-3681982cd2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:07.388843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a283a9-040f-4ae8-ba7d-3681982cd2a7 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:07.389547 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a283a9-040f-4ae8-ba7d-3681982cd2a7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:07.389853 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a283a9-040f-4ae8-ba7d-3681982cd2a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:07.391415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a283a9-040f-4ae8-ba7d-3681982cd2a7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:07.403043 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 469/925] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Aug 10 13:03:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:07.403898 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a283a9-040f-4ae8-ba7d-3681982cd2a7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:07.537412 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:07.539216 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cc8d8-e4ef-4ef2-b98d-9b020ba5367f None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:07.546179 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a283a9-040f-4ae8-ba7d-3681982cd2a7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:07.577996 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903480b9-d6ee-40d8-8e25-d734cf4474bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:07.578984 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903480b9-d6ee-40d8-8e25-d734cf4474bd None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:07.579504 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903480b9-d6ee-40d8-8e25-d734cf4474bd None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:07.579973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903480b9-d6ee-40d8-8e25-d734cf4474bd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:07.580795 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903480b9-d6ee-40d8-8e25-d734cf4474bd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:07.582470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903480b9-d6ee-40d8-8e25-d734cf4474bd None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:07.591641 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6c8d6-5501-4d5a-96bd-20fbc0ade030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:07.592288 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6c8d6-5501-4d5a-96bd-20fbc0ade030 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:07.592580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6c8d6-5501-4d5a-96bd-20fbc0ade030 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:07.592929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6c8d6-5501-4d5a-96bd-20fbc0ade030 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:07.593404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-903480b9-d6ee-40d8-8e25-d734cf4474bd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 13:03:07.593404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:07.593404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:03:07.593404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:03:07.593404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:03:07.593404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:03:07.593404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:03:07.593404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:07.593404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 13:03:07.593404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:07.593404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:03:07.593404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:07.593404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:07.593404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:07.593404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:07.593404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:07.594567 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:07.594567 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:07.594567 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:07.594567 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:07.594567 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:07.594567 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:07.594567 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:07.594567 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:03:07.594567 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:03:07.594567 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:03:07.594567 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:03:07.594567 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:07.594567 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:07.594567 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:07.594567 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:07.594567 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:07.594567 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:07.595825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:07.595825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:07.595825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:07.595825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:07.595825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:07.595825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:07.595825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:07.595825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:07.595825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:07.595825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:07.595825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:03:07.595825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:07.595825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 13:03:07.595825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:07.596574 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6c8d6-5501-4d5a-96bd-20fbc0ade030 None admin] RBAC: Adding query filter params (interface=public, service_id=42219464af934d3888e3b76184f801b7, region_id=RegionOne) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:07.596574 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6c8d6-5501-4d5a-96bd-20fbc0ade030 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:07.596574 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6c8d6-5501-4d5a-96bd-20fbc0ade030 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:07.606586 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 470/927] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Aug 10 13:03:07 2022] GET /identity/v3/endpoints?service_id=42219464af934d3888e3b76184f801b7&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:07.606906 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 457/927] 10.222.0.46 () {56 vars in 1132 bytes} [Wed Aug 10 13:03:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:07.607897 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6c8d6-5501-4d5a-96bd-20fbc0ade030 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:07.610219 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903480b9-d6ee-40d8-8e25-d734cf4474bd None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:07.687382 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:07.729499 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6c8d6-5501-4d5a-96bd-20fbc0ade030 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:07.746658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903480b9-d6ee-40d8-8e25-d734cf4474bd None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:07.768088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cd45e-17c3-4689-a0c9-d846b14af537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:07.769662 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cd45e-17c3-4689-a0c9-d846b14af537 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:07.770145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cd45e-17c3-4689-a0c9-d846b14af537 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:07.770644 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cd45e-17c3-4689-a0c9-d846b14af537 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:07.771494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cd45e-17c3-4689-a0c9-d846b14af537 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:07.773092 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cd45e-17c3-4689-a0c9-d846b14af537 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:07.784911 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 471/928] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Aug 10 13:03:07 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:03:07.794104 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2779e-40cc-4218-8bdf-1ce478e4d5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:07.794713 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2779e-40cc-4218-8bdf-1ce478e4d5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:07.795019 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2779e-40cc-4218-8bdf-1ce478e4d5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:07.795299 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2779e-40cc-4218-8bdf-1ce478e4d5d5 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:07.796009 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2779e-40cc-4218-8bdf-1ce478e4d5d5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:07.796367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2779e-40cc-4218-8bdf-1ce478e4d5d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:07.797819 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2779e-40cc-4218-8bdf-1ce478e4d5d5 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:07.804736 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 458/929] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Aug 10 13:03:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:07.811555 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cd45e-17c3-4689-a0c9-d846b14af537 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:07.831300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c798e68-b82a-4b6d-b6ff-3cb4b2a58544 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:07.831633 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c798e68-b82a-4b6d-b6ff-3cb4b2a58544 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:07.831876 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c798e68-b82a-4b6d-b6ff-3cb4b2a58544 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:07.837459 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 459/930] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:03:07.839330 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c570236-3a43-425c-823c-c71a167cc2b7 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:07.839619 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c570236-3a43-425c-823c-c71a167cc2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:07.839985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c570236-3a43-425c-823c-c71a167cc2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:07.845339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:07.860821 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-2c570236-3a43-425c-823c-c71a167cc2b7 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:07.862051 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-2c570236-3a43-425c-823c-c71a167cc2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:07.947852 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cd45e-17c3-4689-a0c9-d846b14af537 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:07.968960 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 460/931] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 13:03:07.994938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c570236-3a43-425c-823c-c71a167cc2b7 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:07.998228 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf16387-6da7-41b4-ae72-31d002a73576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:07.998854 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf16387-6da7-41b4-ae72-31d002a73576 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:07.999179 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf16387-6da7-41b4-ae72-31d002a73576 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:07.999452 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf16387-6da7-41b4-ae72-31d002a73576 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:08.000093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf16387-6da7-41b4-ae72-31d002a73576 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:08.000391 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf16387-6da7-41b4-ae72-31d002a73576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:08.001775 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf16387-6da7-41b4-ae72-31d002a73576 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:08.011045 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 472/932] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Aug 10 13:03:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:08.016415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf16387-6da7-41b4-ae72-31d002a73576 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:08.071451 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:08.151289 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:08.157762 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c570236-3a43-425c-823c-c71a167cc2b7 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:08.169636 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf16387-6da7-41b4-ae72-31d002a73576 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:08.202457 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce795ca6-4931-4a70-90ff-64e5793e0a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:08.203543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce795ca6-4931-4a70-90ff-64e5793e0a29 None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:08.204167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce795ca6-4931-4a70-90ff-64e5793e0a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:08.204694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce795ca6-4931-4a70-90ff-64e5793e0a29 None admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:08.205606 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce795ca6-4931-4a70-90ff-64e5793e0a29 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:08.207989 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35330bc-c3c7-4861-8b0f-890bfda24fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:08.208154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce795ca6-4931-4a70-90ff-64e5793e0a29 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:08.208600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35330bc-c3c7-4861-8b0f-890bfda24fd1 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:08.208887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35330bc-c3c7-4861-8b0f-890bfda24fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:08.209160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35330bc-c3c7-4861-8b0f-890bfda24fd1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:08.209832 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35330bc-c3c7-4861-8b0f-890bfda24fd1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:08.211233 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35330bc-c3c7-4861-8b0f-890bfda24fd1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:08.212164 dv-cinder-836027-5-smb devstack@keystone.service[80297]: WARNING keystone.server.flask.common [None req-ce795ca6-4931-4a70-90ff-64e5793e0a29 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 10 13:03:08.231300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.sql.core [None req-ce795ca6-4931-4a70-90ff-64e5793e0a29 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 13:03:08.231300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 10 13:03:08.231300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [parameters: {'id': '4c7dc61b402349a185167556f3721267', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 10 13:03:08.231300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80297) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 13:03:08.248241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 473/933] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:03:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:03:08.251238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-ce795ca6-4931-4a70-90ff-64e5793e0a29 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4c7dc61b402349a185167556f3721267.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4c7dc61b402349a185167556f3721267. Aug 10 13:03:08.251238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:08.251238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 13:03:08.251238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 13:03:08.251238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 13:03:08.251238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 13:03:08.251238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 13:03:08.251238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 13:03:08.251238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 13:03:08.251238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application conn.query(q) Aug 10 13:03:08.251238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 13:03:08.251238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 13:03:08.251238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 13:03:08.252120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application result.read() Aug 10 13:03:08.252120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 13:03:08.252120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 13:03:08.252120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 13:03:08.252120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 13:03:08.252120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 13:03:08.252120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 13:03:08.252120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 13:03:08.252120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 13:03:08.252120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 13:03:08.252120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:08.252120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 13:03:08.252120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:08.252120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:08.252120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 13:03:08.252120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 13:03:08.252120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 10 13:03:08.252120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 10 13:03:08.253122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 13:03:08.253122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application next(self.gen) Aug 10 13:03:08.253122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 13:03:08.253122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application yield resource Aug 10 13:03:08.253122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 13:03:08.253122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application next(self.gen) Aug 10 13:03:08.253122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 13:03:08.253122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 13:03:08.253122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 13:03:08.253122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 13:03:08.253122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 13:03:08.253122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise self.value Aug 10 13:03:08.253122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 13:03:08.253122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 13:03:08.253122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 13:03:08.253122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application session.commit() Aug 10 13:03:08.253122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 13:03:08.254613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 13:03:08.254613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 13:03:08.254613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 13:03:08.254613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 13:03:08.254613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self.session.flush() Aug 10 13:03:08.254613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 13:03:08.254613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 13:03:08.254613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 13:03:08.254613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 13:03:08.254613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 13:03:08.254613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application compat.raise_( Aug 10 13:03:08.254613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 13:03:08.254613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception Aug 10 13:03:08.254613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 13:03:08.254613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 13:03:08.254613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 13:03:08.254613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 13:03:08.256405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 13:03:08.256405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 13:03:08.256405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 13:03:08.256405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 13:03:08.256405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 10 13:03:08.256405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 10 13:03:08.256405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 13:03:08.256405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 13:03:08.256405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 13:03:08.256405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 13:03:08.256405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 13:03:08.256405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 13:03:08.256405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 13:03:08.256405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 13:03:08.256405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 13:03:08.258396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 13:03:08.258396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 13:03:08.258396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception Aug 10 13:03:08.258396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 13:03:08.258396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 13:03:08.258396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 13:03:08.258396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 13:03:08.258396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 13:03:08.258396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 13:03:08.258396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 13:03:08.258396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application conn.query(q) Aug 10 13:03:08.258396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 13:03:08.258396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 13:03:08.258396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 13:03:08.258396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application result.read() Aug 10 13:03:08.258396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 13:03:08.258396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 13:03:08.260600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 13:03:08.260600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 13:03:08.260600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 13:03:08.260600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 13:03:08.260600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 13:03:08.260600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 13:03:08.260600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 13:03:08.260600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 10 13:03:08.260600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [parameters: {'id': '4c7dc61b402349a185167556f3721267', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 10 13:03:08.260600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 13:03:08.260600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:08.260600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:03:08.260600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:08.260600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:08.260600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 10 13:03:08.262773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 10 13:03:08.262773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 13:03:08.262773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 13:03:08.262773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 10 13:03:08.262773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:08.262773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:03:08.262773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:08.262773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:08.262773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:08.262773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:08.262773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:08.262773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:08.262773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:08.262773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:08.262773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:08.262773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:08.262773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:08.265103 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:08.265103 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 10 13:03:08.265103 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 10 13:03:08.265103 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:08.265103 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:08.265103 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 10 13:03:08.265103 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 10 13:03:08.265103 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4c7dc61b402349a185167556f3721267. Aug 10 13:03:08.265103 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:08.265103 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 461/934] 10.222.0.46 () {60 vars in 1140 bytes} [Wed Aug 10 13:03:07 2022] POST /identity/v3/projects => generated 262 bytes in 264 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:08.266550 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35330bc-c3c7-4861-8b0f-890bfda24fd1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:08.355819 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ac20a-a052-4aa0-b993-100641495324 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:08.356135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ac20a-a052-4aa0-b993-100641495324 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:08.356313 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ac20a-a052-4aa0-b993-100641495324 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:08.365492 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 462/935] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:08 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:08.366918 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b170a7-67e1-4698-9672-662608b9425f None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:08.367231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b170a7-67e1-4698-9672-662608b9425f None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:08.367507 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b170a7-67e1-4698-9672-662608b9425f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:08.387036 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35330bc-c3c7-4861-8b0f-890bfda24fd1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:08.388780 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-66b170a7-67e1-4698-9672-662608b9425f None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:08.390509 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-66b170a7-67e1-4698-9672-662608b9425f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:08.430858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f15857-da0a-4031-8c85-4fb97cd946d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:08.431546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f15857-da0a-4031-8c85-4fb97cd946d7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:08.431905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f15857-da0a-4031-8c85-4fb97cd946d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:08.432270 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f15857-da0a-4031-8c85-4fb97cd946d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:08.443928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f15857-da0a-4031-8c85-4fb97cd946d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:08.445436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f15857-da0a-4031-8c85-4fb97cd946d7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:08.449722 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:08.463543 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-66f15857-da0a-4031-8c85-4fb97cd946d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:03:08.463543 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:08.463543 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:08.463543 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:08.463543 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:08.463543 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:08.463543 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:08.463543 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:08.463543 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:08.463543 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:08.463543 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:08.463543 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:08.463543 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:03:08.463543 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:03:08.463543 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:03:08.464729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:03:08.464729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:08.464729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:08.464729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:08.464729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:08.464729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:08.464729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:08.464729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:08.464729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:08.464729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:08.464729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:08.464729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:08.464729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:08.464729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:08.464729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:08.464729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:08.464729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:08.465792 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:03:08.465792 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:03:08.465792 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:03:08.465792 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:03:08.465792 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:03:08.465792 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:03:08.465792 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:03:08.465792 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:08.465792 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 474/936] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:03:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:08.472575 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f15857-da0a-4031-8c85-4fb97cd946d7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:08.487478 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 463/937] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:08.510766 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b170a7-67e1-4698-9672-662608b9425f None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:08.567032 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:08.602680 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f15857-da0a-4031-8c85-4fb97cd946d7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:08.640132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a8bef-5b43-4dab-9c75-f9749839f586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:08.641048 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a8bef-5b43-4dab-9c75-f9749839f586 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:08.641511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a8bef-5b43-4dab-9c75-f9749839f586 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:08.642468 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a8bef-5b43-4dab-9c75-f9749839f586 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:08.643618 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a8bef-5b43-4dab-9c75-f9749839f586 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:08.644682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a8bef-5b43-4dab-9c75-f9749839f586 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:08.646869 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a8bef-5b43-4dab-9c75-f9749839f586 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:08.656476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b170a7-67e1-4698-9672-662608b9425f None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:08.670029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 475/938] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 10 13:03:08 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:08.709255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ff3df-7c22-4356-8a7f-6c5e8ae6e3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:08.710258 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ff3df-7c22-4356-8a7f-6c5e8ae6e3db None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:08.710718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ff3df-7c22-4356-8a7f-6c5e8ae6e3db None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:08.711191 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ff3df-7c22-4356-8a7f-6c5e8ae6e3db None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:08.726796 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ff3df-7c22-4356-8a7f-6c5e8ae6e3db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:03:08.732042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-988ff3df-7c22-4356-8a7f-6c5e8ae6e3db None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 13:03:08.732042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:08.732042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:08.732042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:08.732042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:08.732042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:08.732042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:08.732042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:08.732042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:08.732042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:08.732042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:08.732042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:08.732042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:03:08.732042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:03:08.732042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:03:08.732042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:03:08.733136 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:03:08.733136 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:03:08.733136 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:03:08.733136 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:03:08.733136 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:08.733136 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:08.733136 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:08.733136 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:08.733136 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:08.733136 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:08.733136 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:08.733136 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:08.733136 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:08.733136 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:08.733136 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:08.733136 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:08.734017 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:08.734017 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:08.734017 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:08.734017 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:08.734017 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:03:08.734017 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:03:08.734017 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:03:08.734017 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:03:08.734017 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:03:08.734017 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:03:08.734017 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 13:03:08.734017 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:08.737044 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 464/939] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Aug 10 13:03:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:08.744385 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a8bef-5b43-4dab-9c75-f9749839f586 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:08.825018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:08.874961 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a8bef-5b43-4dab-9c75-f9749839f586 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:08.913184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04c176-3a62-457e-b598-a495bfbe9ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:08.913745 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04c176-3a62-457e-b598-a495bfbe9ffb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:08.914021 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04c176-3a62-457e-b598-a495bfbe9ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:08.914290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04c176-3a62-457e-b598-a495bfbe9ffb None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:08.914964 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04c176-3a62-457e-b598-a495bfbe9ffb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:08.915295 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04c176-3a62-457e-b598-a495bfbe9ffb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:08.916679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04c176-3a62-457e-b598-a495bfbe9ffb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:08.926245 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 476/940] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Aug 10 13:03:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:08.931911 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ff3df-7c22-4356-8a7f-6c5e8ae6e3db None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:09.049932 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:09.056406 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ff3df-7c22-4356-8a7f-6c5e8ae6e3db None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:09.091657 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e2315-7962-48f9-b948-29c971361ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:09.092284 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e2315-7962-48f9-b948-29c971361ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:09.092560 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e2315-7962-48f9-b948-29c971361ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:09.092824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e2315-7962-48f9-b948-29c971361ef3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:09.104429 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e2315-7962-48f9-b948-29c971361ef3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:09.106003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e2315-7962-48f9-b948-29c971361ef3 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:09.121805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-af8e2315-7962-48f9-b948-29c971361ef3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:09.121805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:09.121805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:09.121805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:09.121805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:09.121805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:09.121805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:09.121805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:09.121805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:09.121805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:09.121805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:09.121805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:09.121805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:03:09.121805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:03:09.121805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:03:09.121805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:03:09.122854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:09.122854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:09.122854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:09.122854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:09.122854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:09.122854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:09.122854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:09.122854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:09.122854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:09.122854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:09.122854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:09.122854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:09.122854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:09.122854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:09.122854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:09.122854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:09.122854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:03:09.123810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:03:09.123810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:09.123810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:09.123810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 465/941] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:09.128807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04c176-3a62-457e-b598-a495bfbe9ffb None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:09.235195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04c176-3a62-457e-b598-a495bfbe9ffb None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:09.256613 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:09.271628 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa5025-2047-4f11-9aa0-315cc34b539b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:09.273904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa5025-2047-4f11-9aa0-315cc34b539b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:09.274441 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa5025-2047-4f11-9aa0-315cc34b539b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:09.275088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa5025-2047-4f11-9aa0-315cc34b539b None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:09.276069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa5025-2047-4f11-9aa0-315cc34b539b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:09.276858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa5025-2047-4f11-9aa0-315cc34b539b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:09.278254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa5025-2047-4f11-9aa0-315cc34b539b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:09.295206 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 477/942] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:09.300073 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e2315-7962-48f9-b948-29c971361ef3 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:09.406577 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e2315-7962-48f9-b948-29c971361ef3 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:09.441655 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354d0ef-4381-4a04-97ae-d5803d9f7eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:09.442282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354d0ef-4381-4a04-97ae-d5803d9f7eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:09.442555 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354d0ef-4381-4a04-97ae-d5803d9f7eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:09.442820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354d0ef-4381-4a04-97ae-d5803d9f7eb3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:09.450690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354d0ef-4381-4a04-97ae-d5803d9f7eb3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:09.452187 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354d0ef-4381-4a04-97ae-d5803d9f7eb3 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:09.464580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-d354d0ef-4381-4a04-97ae-d5803d9f7eb3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 13:03:09.464580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:09.464580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:09.464580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:09.464580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:09.464580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:09.464580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:09.464580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:09.464580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:09.464580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:09.464580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:09.464580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:09.464580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:03:09.464580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:03:09.464580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:03:09.464580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:03:09.465584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:09.465584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:09.465584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:03:09.465584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:03:09.465584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:03:09.465584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:03:09.465584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:09.465584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:09.465584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:09.465584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:09.465584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:09.465584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:09.465584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:09.465584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:09.465584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:09.465584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:09.465584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:09.465584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:09.466789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:09.466789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:09.466789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:03:09.466789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:03:09.466789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:03:09.466789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:03:09.466789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:03:09.466789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:03:09.466789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 13:03:09.466789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:09.466789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 466/943] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Aug 10 13:03:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:09.474643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa5025-2047-4f11-9aa0-315cc34b539b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:09.581265 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa5025-2047-4f11-9aa0-315cc34b539b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:09.617563 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95197fb0-c15f-40ea-ae22-db5180de1a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:09.618557 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95197fb0-c15f-40ea-ae22-db5180de1a19 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:09.619076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95197fb0-c15f-40ea-ae22-db5180de1a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:09.619562 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95197fb0-c15f-40ea-ae22-db5180de1a19 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:09.620500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95197fb0-c15f-40ea-ae22-db5180de1a19 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:09.621028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95197fb0-c15f-40ea-ae22-db5180de1a19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:09.622662 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95197fb0-c15f-40ea-ae22-db5180de1a19 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:09.646635 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 478/944] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Aug 10 13:03:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:09.652114 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354d0ef-4381-4a04-97ae-d5803d9f7eb3 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:09.667449 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:09.758683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354d0ef-4381-4a04-97ae-d5803d9f7eb3 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:09.795115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822a3a5-d74d-4cc8-b5df-38d29c62de6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:09.795763 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822a3a5-d74d-4cc8-b5df-38d29c62de6b None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:09.796037 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822a3a5-d74d-4cc8-b5df-38d29c62de6b None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:09.796306 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822a3a5-d74d-4cc8-b5df-38d29c62de6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:09.807959 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822a3a5-d74d-4cc8-b5df-38d29c62de6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:09.809393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822a3a5-d74d-4cc8-b5df-38d29c62de6b None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:09.824697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-a822a3a5-d74d-4cc8-b5df-38d29c62de6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:09.824697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:09.824697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:09.824697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:09.824697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:09.824697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:09.824697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:09.824697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:09.824697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:09.824697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:09.824697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:09.824697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:09.824697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:03:09.824697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:03:09.824697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:03:09.824697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:03:09.825715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:09.825715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:09.825715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:09.825715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:09.825715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:09.825715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:09.825715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:09.825715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:09.825715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:09.825715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:09.825715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:09.825715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:09.825715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:09.825715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:09.825715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:09.825715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:09.825715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:03:09.826843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:03:09.826843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:09.826843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:09.826843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 467/945] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:09.833965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95197fb0-c15f-40ea-ae22-db5180de1a19 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:09.878763 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:09.953491 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95197fb0-c15f-40ea-ae22-db5180de1a19 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:10.005261 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120cea8-c033-4c78-8fe4-879ebaba84d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:10.005872 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120cea8-c033-4c78-8fe4-879ebaba84d3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:10.006145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120cea8-c033-4c78-8fe4-879ebaba84d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:10.006413 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120cea8-c033-4c78-8fe4-879ebaba84d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:10.006946 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f06e5-f7e3-4781-9348-5a915555da02 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:10.007420 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120cea8-c033-4c78-8fe4-879ebaba84d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:10.007420 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120cea8-c033-4c78-8fe4-879ebaba84d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:10.007985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f06e5-f7e3-4781-9348-5a915555da02 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:10.008458 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f06e5-f7e3-4781-9348-5a915555da02 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:10.008867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120cea8-c033-4c78-8fe4-879ebaba84d3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:10.014400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 468/946] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:03:10.016482 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a22c4-aa75-4ed9-bc5f-882650010bd3 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:10.016972 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a22c4-aa75-4ed9-bc5f-882650010bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:10.017446 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a22c4-aa75-4ed9-bc5f-882650010bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:10.023073 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 479/947] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:10.028421 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120cea8-c033-4c78-8fe4-879ebaba84d3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:10.039153 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-2c9a22c4-aa75-4ed9-bc5f-882650010bd3 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:10.040365 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-2c9a22c4-aa75-4ed9-bc5f-882650010bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:10.115818 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:10.135370 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 469/948] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:10.157902 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a22c4-aa75-4ed9-bc5f-882650010bd3 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:10.159647 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:10.164415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120cea8-c033-4c78-8fe4-879ebaba84d3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:10.199553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ecc3c-ef57-467a-87a3-9e94bbed73e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:10.200204 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ecc3c-ef57-467a-87a3-9e94bbed73e1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:10.200468 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ecc3c-ef57-467a-87a3-9e94bbed73e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:10.200740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ecc3c-ef57-467a-87a3-9e94bbed73e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:10.208676 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ecc3c-ef57-467a-87a3-9e94bbed73e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:10.210115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ecc3c-ef57-467a-87a3-9e94bbed73e1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:10.222969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-fc0ecc3c-ef57-467a-87a3-9e94bbed73e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:03:10.222969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:10.222969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:10.222969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:10.222969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:10.222969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:10.222969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:10.222969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:10.222969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:10.222969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:10.222969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:10.222969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:10.222969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:03:10.222969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:03:10.222969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:03:10.223946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:03:10.223946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:10.223946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:10.223946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:10.223946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:10.223946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:10.223946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:10.223946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:10.223946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:10.223946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:10.223946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:10.223946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:10.223946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:10.223946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:10.223946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:10.223946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:10.223946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:10.224874 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:03:10.224874 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:03:10.224874 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:03:10.224874 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:03:10.224874 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:03:10.224874 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:03:10.224874 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:03:10.224874 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:10.229003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 480/949] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:03:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:10.230280 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ecc3c-ef57-467a-87a3-9e94bbed73e1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:10.272758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a22c4-aa75-4ed9-bc5f-882650010bd3 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:10.332389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df6ae9-8962-41ea-99d9-f9119f576ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:10.333966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df6ae9-8962-41ea-99d9-f9119f576ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:10.334728 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df6ae9-8962-41ea-99d9-f9119f576ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:10.335501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df6ae9-8962-41ea-99d9-f9119f576ba4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:10.336817 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df6ae9-8962-41ea-99d9-f9119f576ba4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:10.339151 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df6ae9-8962-41ea-99d9-f9119f576ba4 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:10.346571 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ecc3c-ef57-467a-87a3-9e94bbed73e1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:10.350556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-e3df6ae9-8962-41ea-99d9-f9119f576ba4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 13:03:10.350556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:10.350556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:03:10.350556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:03:10.350556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:03:10.350556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:03:10.350556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:03:10.350556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:10.350556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 13:03:10.350556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:10.350556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:03:10.350556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:10.350556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:10.350556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:10.350556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:10.350556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:10.350556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:10.351732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:10.351732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:10.351732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:10.351732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:10.351732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:10.351732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:10.351732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:03:10.351732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:03:10.351732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:03:10.351732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:03:10.351732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:10.351732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:10.351732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:10.351732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:10.351732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:10.351732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:10.352583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:10.352583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:10.352583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:10.352583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:10.352583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:10.352583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:10.352583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:10.352583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:10.352583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:10.352583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:10.352583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:03:10.352583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:10.352583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 13:03:10.352583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:10.360617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 470/950] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Aug 10 13:03:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:10.361972 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df6ae9-8962-41ea-99d9-f9119f576ba4 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:10.389335 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a97014-76f5-4d01-8c57-52114c622e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:10.389918 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a97014-76f5-4d01-8c57-52114c622e81 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:10.390195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a97014-76f5-4d01-8c57-52114c622e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:10.390514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a97014-76f5-4d01-8c57-52114c622e81 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:10.391425 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a97014-76f5-4d01-8c57-52114c622e81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:10.391623 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a97014-76f5-4d01-8c57-52114c622e81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:10.393074 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a97014-76f5-4d01-8c57-52114c622e81 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:10.411856 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 481/951] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:03:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:10.414043 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a97014-76f5-4d01-8c57-52114c622e81 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:10.435701 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:10.438251 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:10.489188 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df6ae9-8962-41ea-99d9-f9119f576ba4 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:10.524698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892f80e-ba4e-4730-937e-aea804fc83c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:10.525300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892f80e-ba4e-4730-937e-aea804fc83c0 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:10.525571 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892f80e-ba4e-4730-937e-aea804fc83c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:10.525834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892f80e-ba4e-4730-937e-aea804fc83c0 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:10.526221 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a97014-76f5-4d01-8c57-52114c622e81 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:10.526451 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892f80e-ba4e-4730-937e-aea804fc83c0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:10.526746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892f80e-ba4e-4730-937e-aea804fc83c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:10.528138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892f80e-ba4e-4730-937e-aea804fc83c0 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:10.535790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 471/952] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Aug 10 13:03:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:10.537000 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180ffba-dc78-4103-9e61-a17478f28673 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:10.537281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180ffba-dc78-4103-9e61-a17478f28673 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:10.537554 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180ffba-dc78-4103-9e61-a17478f28673 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:10.538882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 472/953] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:10.543661 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180ffba-dc78-4103-9e61-a17478f28673 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:10.570584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d230bc6-f82e-41cb-8aa5-354359648a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:10.571288 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d230bc6-f82e-41cb-8aa5-354359648a2e None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:10.571569 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d230bc6-f82e-41cb-8aa5-354359648a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:10.571853 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d230bc6-f82e-41cb-8aa5-354359648a2e None admin] PATH_INFO: `/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/182eec86daa44cd48d6ef1c38f58e89d/roles/4bbe1d7eee2c44329a4173574fab0f68` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:10.574690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d230bc6-f82e-41cb-8aa5-354359648a2e None admin] RBAC: Authorizing `identity:create_grant(project_id=8aa2ccddadb54dd9b88ccc6cec98ae37, user_id=182eec86daa44cd48d6ef1c38f58e89d, role_id=4bbe1d7eee2c44329a4173574fab0f68)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:10.576233 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d230bc6-f82e-41cb-8aa5-354359648a2e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:10.589029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 482/954] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:03:10 2022] PUT /identity/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/182eec86daa44cd48d6ef1c38f58e89d/roles/4bbe1d7eee2c44329a4173574fab0f68 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:03:10.590222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68674ed-ed87-4c85-9056-4c92aaaaf0e5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:10.590506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68674ed-ed87-4c85-9056-4c92aaaaf0e5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:10.590780 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68674ed-ed87-4c85-9056-4c92aaaaf0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:10.610426 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b68674ed-ed87-4c85-9056-4c92aaaaf0e5 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:10.612470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b68674ed-ed87-4c85-9056-4c92aaaaf0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:10.679821 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180ffba-dc78-4103-9e61-a17478f28673 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:10.694184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 483/955] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:10.704386 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:10.723778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68674ed-ed87-4c85-9056-4c92aaaaf0e5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:10.726290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8500d9e-7a90-4b4b-bfcf-5e4bc8e620b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:10.726918 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8500d9e-7a90-4b4b-bfcf-5e4bc8e620b8 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:10.727270 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8500d9e-7a90-4b4b-bfcf-5e4bc8e620b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:10.727541 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8500d9e-7a90-4b4b-bfcf-5e4bc8e620b8 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:10.728991 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8500d9e-7a90-4b4b-bfcf-5e4bc8e620b8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:10.728991 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8500d9e-7a90-4b4b-bfcf-5e4bc8e620b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:10.729950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8500d9e-7a90-4b4b-bfcf-5e4bc8e620b8 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:10.736302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 473/956] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Aug 10 13:03:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:10.741977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:10.744905 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8500d9e-7a90-4b4b-bfcf-5e4bc8e620b8 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:10.858937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68674ed-ed87-4c85-9056-4c92aaaaf0e5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:10.870894 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8500d9e-7a90-4b4b-bfcf-5e4bc8e620b8 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:10.901346 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb82937-096d-4f7a-bdd7-1fb12824d2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:10.902092 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb82937-096d-4f7a-bdd7-1fb12824d2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:10.902370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb82937-096d-4f7a-bdd7-1fb12824d2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:10.902647 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb82937-096d-4f7a-bdd7-1fb12824d2c3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:10.903254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb82937-096d-4f7a-bdd7-1fb12824d2c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:10.904630 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb82937-096d-4f7a-bdd7-1fb12824d2c3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:10.908317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88435c2a-b0fa-442c-a090-8303b4d53c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:10.909177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88435c2a-b0fa-442c-a090-8303b4d53c4f None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:10.909744 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88435c2a-b0fa-442c-a090-8303b4d53c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:10.910238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88435c2a-b0fa-442c-a090-8303b4d53c4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:10.911145 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88435c2a-b0fa-442c-a090-8303b4d53c4f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:10.912692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88435c2a-b0fa-442c-a090-8303b4d53c4f None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:10.913316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-bdb82937-096d-4f7a-bdd7-1fb12824d2c3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 13:03:10.913316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:10.913316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:03:10.913316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:03:10.913316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:03:10.913316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:03:10.913316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:03:10.913316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:10.913316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 13:03:10.913316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:10.913316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:03:10.913316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:10.913316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:10.913316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:10.913316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:10.913316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:10.913316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:10.914407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:10.914407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:10.914407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:10.914407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:10.914407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:10.914407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:10.914407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:03:10.914407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:03:10.914407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:03:10.914407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:03:10.914407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:10.914407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:10.914407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:10.914407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:10.914407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:10.914407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:10.915558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:10.915558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:10.915558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:10.915558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:10.915558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:10.915558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:10.915558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:10.915558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:10.915558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:10.915558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:10.915558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:03:10.915558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:10.915558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 13:03:10.915558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:10.915558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 484/957] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:03:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:10.916420 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf721b-e370-4416-b844-005ac71b4ffb None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:10.916420 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf721b-e370-4416-b844-005ac71b4ffb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:10.916420 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf721b-e370-4416-b844-005ac71b4ffb None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:10.917653 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 485/958] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:10.920113 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf721b-e370-4416-b844-005ac71b4ffb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:10.943392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 474/959] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:03:10 2022] POST /identity/v3/endpoints => generated 349 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:03:10.944582 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb3b45-76d0-4351-b93e-c14fb8323607 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:10.945158 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb3b45-76d0-4351-b93e-c14fb8323607 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:10.945158 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb3b45-76d0-4351-b93e-c14fb8323607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:10.969853 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-edcb3b45-76d0-4351-b93e-c14fb8323607 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:10.971114 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-edcb3b45-76d0-4351-b93e-c14fb8323607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:11.006554 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:11.012360 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:11.061501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf721b-e370-4416-b844-005ac71b4ffb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:11.071051 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 475/960] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:11.094049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb3b45-76d0-4351-b93e-c14fb8323607 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:11.111091 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bf3b0-7a52-46b5-bb31-3abdf8696866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:11.112069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bf3b0-7a52-46b5-bb31-3abdf8696866 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:11.112069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bf3b0-7a52-46b5-bb31-3abdf8696866 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:11.112393 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bf3b0-7a52-46b5-bb31-3abdf8696866 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:11.113055 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7bf3b0-7a52-46b5-bb31-3abdf8696866 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:11.113396 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7bf3b0-7a52-46b5-bb31-3abdf8696866 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:11.114821 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7bf3b0-7a52-46b5-bb31-3abdf8696866 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:11.120553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 486/961] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 10 13:03:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:11.125931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bf3b0-7a52-46b5-bb31-3abdf8696866 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:11.224841 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb3b45-76d0-4351-b93e-c14fb8323607 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:11.254007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bf3b0-7a52-46b5-bb31-3abdf8696866 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:11.260751 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd3bdf-771c-4740-bd99-d414e9a3939c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:11.261680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd3bdf-771c-4740-bd99-d414e9a3939c None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:11.262113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd3bdf-771c-4740-bd99-d414e9a3939c None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:11.262546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd3bdf-771c-4740-bd99-d414e9a3939c None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:11.263365 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd3bdf-771c-4740-bd99-d414e9a3939c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:11.264942 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd3bdf-771c-4740-bd99-d414e9a3939c None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:11.279972 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.sql.core [None req-c6fd3bdf-771c-4740-bd99-d414e9a3939c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 13:03:11.279972 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 10 13:03:11.279972 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [parameters: {'user_id': 'a470b139c3194b8c857e7e336ec33d6d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 10 13:03:11.279972 dv-cinder-836027-5-smb devstack@keystone.service[80297]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80297) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 13:03:11.286743 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:11.288060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-c6fd3bdf-771c-4740-bd99-d414e9a3939c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 10 13:03:11.288060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:11.288060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 13:03:11.288060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 13:03:11.288060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 13:03:11.288060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 13:03:11.288060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 13:03:11.288060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 13:03:11.288060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 13:03:11.288060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application conn.query(q) Aug 10 13:03:11.288060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 13:03:11.288060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 13:03:11.288060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 13:03:11.288060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application result.read() Aug 10 13:03:11.288060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 13:03:11.289699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 13:03:11.289699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 13:03:11.289699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 13:03:11.289699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 13:03:11.289699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 13:03:11.289699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 13:03:11.289699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 13:03:11.289699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 13:03:11.289699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:11.289699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 13:03:11.289699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:11.289699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:11.289699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 13:03:11.289699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 13:03:11.289699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 10 13:03:11.289699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 10 13:03:11.289699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 13:03:11.289699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application next(self.gen) Aug 10 13:03:11.291134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 13:03:11.291134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application yield resource Aug 10 13:03:11.291134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 13:03:11.291134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application next(self.gen) Aug 10 13:03:11.291134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 13:03:11.291134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 13:03:11.291134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 13:03:11.291134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 13:03:11.291134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 13:03:11.291134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise self.value Aug 10 13:03:11.291134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 13:03:11.291134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 13:03:11.291134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 13:03:11.291134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application session.commit() Aug 10 13:03:11.291134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 13:03:11.291134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 13:03:11.291134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 13:03:11.292214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 13:03:11.292214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 13:03:11.292214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self.session.flush() Aug 10 13:03:11.292214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 13:03:11.292214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 13:03:11.292214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 13:03:11.292214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 13:03:11.292214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 13:03:11.292214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application compat.raise_( Aug 10 13:03:11.292214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 13:03:11.292214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception Aug 10 13:03:11.292214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 13:03:11.292214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 13:03:11.292214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 13:03:11.292214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 13:03:11.292214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 13:03:11.292214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 13:03:11.293246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 13:03:11.293246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 13:03:11.293246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 10 13:03:11.293246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 10 13:03:11.293246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 13:03:11.293246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 13:03:11.293246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 13:03:11.293246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 13:03:11.293246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 13:03:11.293246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 13:03:11.293246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 13:03:11.293246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 13:03:11.293246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 13:03:11.293246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 13:03:11.293246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 13:03:11.293246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception Aug 10 13:03:11.294131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 13:03:11.294131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 13:03:11.294131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 13:03:11.294131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 13:03:11.294131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 13:03:11.294131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 13:03:11.294131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 13:03:11.294131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application conn.query(q) Aug 10 13:03:11.294131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 13:03:11.294131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 13:03:11.294131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 13:03:11.294131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application result.read() Aug 10 13:03:11.294131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 13:03:11.294131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 13:03:11.294131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 13:03:11.294131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 13:03:11.295030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 13:03:11.295030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 13:03:11.295030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 13:03:11.295030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 13:03:11.295030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 13:03:11.295030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 10 13:03:11.295030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a470b139c3194b8c857e7e336ec33d6d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 10 13:03:11.295030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 13:03:11.295030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:11.295030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:03:11.295030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:11.295030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:11.295030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:11.295030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:11.295030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:11.295924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:11.295924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:11.295924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:11.295924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:11.295924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:11.295924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:11.295924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:11.295924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 10 13:03:11.295924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 10 13:03:11.295924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:11.295924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:11.295924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:03:11.295924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:03:11.295924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:03:11.295924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:03:11.295924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 10 13:03:11.295924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 10 13:03:11.297005 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 10 13:03:11.297005 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 10 13:03:11.297005 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 13:03:11.297005 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 13:03:11.297005 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 10 13:03:11.297005 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:11.297352 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c834e-1ba2-4ac7-adfc-0e2ae16ffd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:11.297352 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c834e-1ba2-4ac7-adfc-0e2ae16ffd8f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:11.297352 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c834e-1ba2-4ac7-adfc-0e2ae16ffd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:11.297352 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c834e-1ba2-4ac7-adfc-0e2ae16ffd8f None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:11.297618 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c834e-1ba2-4ac7-adfc-0e2ae16ffd8f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:11.297618 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c834e-1ba2-4ac7-adfc-0e2ae16ffd8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:11.297618 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c834e-1ba2-4ac7-adfc-0e2ae16ffd8f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:11.304650 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 476/962] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Aug 10 13:03:11 2022] POST /identity/v3/users => generated 160 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:11.306138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd3bdf-771c-4740-bd99-d414e9a3939c None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:11.307780 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 487/963] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 10 13:03:11 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:11.341696 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:11.434673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd3bdf-771c-4740-bd99-d414e9a3939c None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:11.474053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d88b39-dbef-4294-bb5f-ded3609c409a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:11.474698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d88b39-dbef-4294-bb5f-ded3609c409a None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:11.475073 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d88b39-dbef-4294-bb5f-ded3609c409a None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:11.475278 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d88b39-dbef-4294-bb5f-ded3609c409a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:11.482906 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d88b39-dbef-4294-bb5f-ded3609c409a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:11.484597 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d88b39-dbef-4294-bb5f-ded3609c409a None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:11.497770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-f7d88b39-dbef-4294-bb5f-ded3609c409a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 13:03:11.497770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:11.497770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:11.497770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:11.497770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:11.497770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:11.497770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:11.497770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:11.497770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:11.497770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:11.497770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:11.497770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:11.497770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:03:11.497770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:03:11.497770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:03:11.497770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:03:11.498758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:11.498758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:11.498758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:03:11.498758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:03:11.498758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:03:11.498758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:03:11.498758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:11.498758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:11.498758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:11.498758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:11.498758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:11.498758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:11.498758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:11.498758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:11.498758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:11.498758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:11.498758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:11.498758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:11.500471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:11.500471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:11.500471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:03:11.500471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:03:11.500471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:03:11.500471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:03:11.500471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:03:11.500471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:03:11.500471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 13:03:11.500471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:11.500471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 477/964] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:03:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:11.504998 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c834e-1ba2-4ac7-adfc-0e2ae16ffd8f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:11.614263 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c834e-1ba2-4ac7-adfc-0e2ae16ffd8f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:11.650169 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8967eb4-d727-4eb1-bada-000518766b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:11.651243 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8967eb4-d727-4eb1-bada-000518766b2b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:11.651801 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8967eb4-d727-4eb1-bada-000518766b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:11.652273 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8967eb4-d727-4eb1-bada-000518766b2b None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:11.653193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8967eb4-d727-4eb1-bada-000518766b2b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:11.653720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8967eb4-d727-4eb1-bada-000518766b2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:11.655715 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8967eb4-d727-4eb1-bada-000518766b2b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:11.693481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 488/965] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 10 13:03:11 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:12.700465 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb2d14-8a49-4af0-a5f8-2907fc7c183e None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:12.701030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb2d14-8a49-4af0-a5f8-2907fc7c183e None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:12.701030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb2d14-8a49-4af0-a5f8-2907fc7c183e None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:12.705346 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 478/966] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:12.711069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ce87f-09e3-414b-b66e-9035fd0c6e22 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:12.711900 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ce87f-09e3-414b-b66e-9035fd0c6e22 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:12.712316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ce87f-09e3-414b-b66e-9035fd0c6e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:12.730529 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4a2ce87f-09e3-414b-b66e-9035fd0c6e22 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:12.731740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4a2ce87f-09e3-414b-b66e-9035fd0c6e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:12.785622 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:12.804835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 489/967] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:12.828370 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb2d14-8a49-4af0-a5f8-2907fc7c183e None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:12.922829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:12.940428 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb2d14-8a49-4af0-a5f8-2907fc7c183e None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:12.975792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51f0fc-b8f9-47a2-8c7c-744534538474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:12.976332 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51f0fc-b8f9-47a2-8c7c-744534538474 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:12.976608 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51f0fc-b8f9-47a2-8c7c-744534538474 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:12.976873 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51f0fc-b8f9-47a2-8c7c-744534538474 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:12.989978 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51f0fc-b8f9-47a2-8c7c-744534538474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:03:12.994849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-5a51f0fc-b8f9-47a2-8c7c-744534538474 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 13:03:12.994849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:12.994849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:12.994849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:12.994849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:12.994849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:12.994849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:12.994849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:12.994849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:12.994849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:12.994849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:12.994849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:12.994849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:03:12.994849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:03:12.994849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:03:12.994849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:03:12.995846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:03:12.995846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:03:12.995846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:03:12.995846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:03:12.995846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:12.995846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:12.995846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:12.995846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:12.995846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:12.995846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:12.995846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:12.995846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:12.995846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:12.995846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:12.995846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:12.995846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:13.001547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:13.001547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:13.001547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:13.001547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:13.001547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:03:13.001547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:03:13.001547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:03:13.001547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:03:13.001547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:03:13.001547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:03:13.001547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 13:03:13.001547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:13.001547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 479/968] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Aug 10 13:03:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:13.005711 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ce87f-09e3-414b-b66e-9035fd0c6e22 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:13.058800 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d03e-ccbf-47b6-998b-38c207570b02 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:13.059164 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d03e-ccbf-47b6-998b-38c207570b02 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:13.059382 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d03e-ccbf-47b6-998b-38c207570b02 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:13.060981 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 480/969] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:03:13.066023 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb95f8b-ce6f-4f48-9161-6d2c78b131f4 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:13.066323 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb95f8b-ce6f-4f48-9161-6d2c78b131f4 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:13.066570 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb95f8b-ce6f-4f48-9161-6d2c78b131f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:13.084987 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-1bb95f8b-ce6f-4f48-9161-6d2c78b131f4 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:13.086786 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-1bb95f8b-ce6f-4f48-9161-6d2c78b131f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:13.113334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ce87f-09e3-414b-b66e-9035fd0c6e22 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:13.151966 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdbacd-3139-46ef-9e1d-d1a7a282dfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:13.152594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdbacd-3139-46ef-9e1d-d1a7a282dfff None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:13.152869 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdbacd-3139-46ef-9e1d-d1a7a282dfff None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:13.153137 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdbacd-3139-46ef-9e1d-d1a7a282dfff None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:13.153806 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bdbacd-3139-46ef-9e1d-d1a7a282dfff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:13.154105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bdbacd-3139-46ef-9e1d-d1a7a282dfff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:13.155515 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bdbacd-3139-46ef-9e1d-d1a7a282dfff None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:13.157315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 481/970] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 13:03:13.165692 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 490/971] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Aug 10 13:03:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:13.171257 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb95f8b-ce6f-4f48-9161-6d2c78b131f4 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:13.182408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdbacd-3139-46ef-9e1d-d1a7a282dfff None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:13.229430 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:13.256028 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:13.284019 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb95f8b-ce6f-4f48-9161-6d2c78b131f4 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:13.288055 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdbacd-3139-46ef-9e1d-d1a7a282dfff None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:13.321311 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a34a75-9c52-419b-b6b9-5d8d24894ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:13.321942 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a34a75-9c52-419b-b6b9-5d8d24894ace None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:13.322218 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a34a75-9c52-419b-b6b9-5d8d24894ace None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:13.322494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a34a75-9c52-419b-b6b9-5d8d24894ace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:13.324633 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56da881-f0c7-4090-b98f-f43242fd94b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:13.325262 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56da881-f0c7-4090-b98f-f43242fd94b1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:13.325537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56da881-f0c7-4090-b98f-f43242fd94b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:13.325800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56da881-f0c7-4090-b98f-f43242fd94b1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:13.326372 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56da881-f0c7-4090-b98f-f43242fd94b1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:13.327773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56da881-f0c7-4090-b98f-f43242fd94b1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:13.334671 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a34a75-9c52-419b-b6b9-5d8d24894ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:13.336383 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a34a75-9c52-419b-b6b9-5d8d24894ace None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:13.336751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-f56da881-f0c7-4090-b98f-f43242fd94b1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 13:03:13.336751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:13.336751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:03:13.336751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:03:13.336751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:03:13.336751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:03:13.336751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:03:13.336751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:13.336751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 13:03:13.336751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:13.336751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:03:13.336751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:13.336751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:13.336751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:13.336751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:13.336751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:13.336751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:13.337988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:13.337988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:13.337988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:13.337988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:13.337988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:13.337988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:13.337988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:03:13.337988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:03:13.337988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:03:13.337988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:03:13.337988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:13.337988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:13.337988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:13.337988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:13.337988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:13.337988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:13.339049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:13.339049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:13.339049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:13.339049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:13.339049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:13.339049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:13.339049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:13.339049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:13.339049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:13.339049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:13.339049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:03:13.339049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:13.339049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 13:03:13.339049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:13.342860 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 491/972] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Aug 10 13:03:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:13.344037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56da881-f0c7-4090-b98f-f43242fd94b1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:13.357572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-b5a34a75-9c52-419b-b6b9-5d8d24894ace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:13.357572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:13.357572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:13.357572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:13.357572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:13.357572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:13.357572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:13.357572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:13.357572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:13.357572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:13.357572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:13.357572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:13.357572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:03:13.357572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:03:13.357572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:03:13.357572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:03:13.358743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:13.358743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:13.358743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:13.358743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:13.358743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:13.358743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:13.358743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:13.358743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:13.358743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:13.358743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:13.358743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:13.358743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:13.358743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:13.358743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:13.358743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:13.358743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:13.358743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:03:13.359906 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:03:13.359906 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:13.359906 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:13.361613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 482/973] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:13.367046 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a34a75-9c52-419b-b6b9-5d8d24894ace None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:13.455440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56da881-f0c7-4090-b98f-f43242fd94b1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:13.467186 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:13.468158 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a34a75-9c52-419b-b6b9-5d8d24894ace None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:13.493515 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845a831-d88c-4266-bb46-a36abe449b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:13.494040 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845a831-d88c-4266-bb46-a36abe449b75 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:13.494414 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845a831-d88c-4266-bb46-a36abe449b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:13.494672 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845a831-d88c-4266-bb46-a36abe449b75 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:13.495243 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845a831-d88c-4266-bb46-a36abe449b75 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:13.496003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845a831-d88c-4266-bb46-a36abe449b75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:13.496526 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:13.498272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845a831-d88c-4266-bb46-a36abe449b75 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:13.505673 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 492/974] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Aug 10 13:03:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:13.506897 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0b2b3-ece1-4fd4-9cce-03eabfa2038e None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:13.507224 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0b2b3-ece1-4fd4-9cce-03eabfa2038e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:13.507501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0b2b3-ece1-4fd4-9cce-03eabfa2038e None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:13.507894 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b71305-eb3e-4b99-8d47-47947b5db1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:13.508893 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 493/975] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:13.509261 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b71305-eb3e-4b99-8d47-47947b5db1ee None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:13.509738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b71305-eb3e-4b99-8d47-47947b5db1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:13.510292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b71305-eb3e-4b99-8d47-47947b5db1ee None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:13.511213 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0b2b3-ece1-4fd4-9cce-03eabfa2038e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:13.511568 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b71305-eb3e-4b99-8d47-47947b5db1ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:13.512097 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b71305-eb3e-4b99-8d47-47947b5db1ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:13.514551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b71305-eb3e-4b99-8d47-47947b5db1ee None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:13.529506 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 483/976] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:13.531637 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb7ff8-4efd-408f-ba3b-af9729148de1 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:13.532095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb7ff8-4efd-408f-ba3b-af9729148de1 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:13.532523 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb7ff8-4efd-408f-ba3b-af9729148de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:13.560172 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-fddb7ff8-4efd-408f-ba3b-af9729148de1 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:13.561984 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-fddb7ff8-4efd-408f-ba3b-af9729148de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:13.621777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0b2b3-ece1-4fd4-9cce-03eabfa2038e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:13.644522 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 484/977] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:13.645442 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb7ff8-4efd-408f-ba3b-af9729148de1 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:13.660561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6258b-2518-453e-9cf6-907e5775c9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:13.661191 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6258b-2518-453e-9cf6-907e5775c9de None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:13.661450 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6258b-2518-453e-9cf6-907e5775c9de None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:13.661719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6258b-2518-453e-9cf6-907e5775c9de None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:13.662348 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6258b-2518-453e-9cf6-907e5775c9de None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:13.662644 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6258b-2518-453e-9cf6-907e5775c9de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:13.664035 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6258b-2518-453e-9cf6-907e5775c9de None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:13.674724 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 494/978] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Aug 10 13:03:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:13.676275 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6258b-2518-453e-9cf6-907e5775c9de None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:13.719607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:13.762214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb7ff8-4efd-408f-ba3b-af9729148de1 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:13.780704 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:13.789432 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6258b-2518-453e-9cf6-907e5775c9de None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:13.798886 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0586558-756e-4c30-ad28-41b60c16ccf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:13.799537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0586558-756e-4c30-ad28-41b60c16ccf0 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:13.799813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0586558-756e-4c30-ad28-41b60c16ccf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:13.800622 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0586558-756e-4c30-ad28-41b60c16ccf0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:13.807774 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0586558-756e-4c30-ad28-41b60c16ccf0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:13.809253 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0586558-756e-4c30-ad28-41b60c16ccf0 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:13.821289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-e0586558-756e-4c30-ad28-41b60c16ccf0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 13:03:13.821289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:13.821289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:13.821289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:13.821289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:13.821289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:13.821289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:13.821289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:13.821289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:13.821289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:13.821289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:13.821289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:13.821289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:03:13.821289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:03:13.821289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:03:13.821289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:03:13.822342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:13.822342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:13.822342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:03:13.822342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:03:13.822342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:03:13.822342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:03:13.822342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:13.822342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:13.822342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:13.822342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:13.822342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:13.822342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:13.822342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:13.822342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:13.822342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:13.822342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:13.822342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:13.822342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:13.823329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:13.823329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:13.823329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:03:13.823329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:03:13.823329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:03:13.823329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:03:13.823329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:03:13.823329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:03:13.823329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 13:03:13.823329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:13.823329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 485/979] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Aug 10 13:03:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:13.823329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0586558-756e-4c30-ad28-41b60c16ccf0 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:13.828785 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676773e-f971-4d66-9ad6-87f36b3ff69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:13.829410 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676773e-f971-4d66-9ad6-87f36b3ff69d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:13.829687 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676773e-f971-4d66-9ad6-87f36b3ff69d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:13.829959 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676773e-f971-4d66-9ad6-87f36b3ff69d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:13.830676 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676773e-f971-4d66-9ad6-87f36b3ff69d None admin] RBAC: Adding query filter params (interface=admin, service_id=42219464af934d3888e3b76184f801b7, region_id=RegionOne) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:13.831099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676773e-f971-4d66-9ad6-87f36b3ff69d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:13.832388 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676773e-f971-4d66-9ad6-87f36b3ff69d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:13.837729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 495/980] 10.222.0.46 () {56 vars in 1249 bytes} [Wed Aug 10 13:03:13 2022] GET /identity/v3/endpoints?service_id=42219464af934d3888e3b76184f801b7&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:13.838513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676773e-f971-4d66-9ad6-87f36b3ff69d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:13.923385 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0586558-756e-4c30-ad28-41b60c16ccf0 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:13.938641 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676773e-f971-4d66-9ad6-87f36b3ff69d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:13.940186 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:13.958390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde78025-cc74-4d3e-85a4-47bb266de066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:13.959013 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde78025-cc74-4d3e-85a4-47bb266de066 None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:13.959307 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde78025-cc74-4d3e-85a4-47bb266de066 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:13.959583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde78025-cc74-4d3e-85a4-47bb266de066 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:13.960231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde78025-cc74-4d3e-85a4-47bb266de066 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:13.961584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde78025-cc74-4d3e-85a4-47bb266de066 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:13.974898 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8b053-37d2-4d5e-acf2-d3963e07ad3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:13.975545 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8b053-37d2-4d5e-acf2-d3963e07ad3e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:13.975827 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8b053-37d2-4d5e-acf2-d3963e07ad3e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:13.976098 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8b053-37d2-4d5e-acf2-d3963e07ad3e None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:13.976824 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8b053-37d2-4d5e-acf2-d3963e07ad3e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:13.977127 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8b053-37d2-4d5e-acf2-d3963e07ad3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:13.977905 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 486/981] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 10 13:03:13 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:03:13.978551 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8b053-37d2-4d5e-acf2-d3963e07ad3e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:13.978739 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde78025-cc74-4d3e-85a4-47bb266de066 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:13.998950 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 496/982] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Aug 10 13:03:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:14.005011 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8b053-37d2-4d5e-acf2-d3963e07ad3e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:14.039072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:14.121445 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde78025-cc74-4d3e-85a4-47bb266de066 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:14.136371 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8b053-37d2-4d5e-acf2-d3963e07ad3e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:14.165701 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfadcae-7873-4fd0-8ca9-a908a0b1fa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:14.166320 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfadcae-7873-4fd0-8ca9-a908a0b1fa6f None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:14.166598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfadcae-7873-4fd0-8ca9-a908a0b1fa6f None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:14.166879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfadcae-7873-4fd0-8ca9-a908a0b1fa6f None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:14.167507 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfadcae-7873-4fd0-8ca9-a908a0b1fa6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:14.168885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfadcae-7873-4fd0-8ca9-a908a0b1fa6f None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:14.176478 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 487/983] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Aug 10 13:03:13 2022] GET /identity/v3/services => generated 1727 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:03:14.182665 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89a0cd-62ce-416b-a902-2642f235de9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:14.183469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89a0cd-62ce-416b-a902-2642f235de9a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:14.183751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89a0cd-62ce-416b-a902-2642f235de9a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:14.184026 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89a0cd-62ce-416b-a902-2642f235de9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:14.220403 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:14.268230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89a0cd-62ce-416b-a902-2642f235de9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:14.270261 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89a0cd-62ce-416b-a902-2642f235de9a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:14.381686 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 497/984] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:03:14 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 13:03:14.387483 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfadcae-7873-4fd0-8ca9-a908a0b1fa6f None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:14.489379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:14.494495 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfadcae-7873-4fd0-8ca9-a908a0b1fa6f None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:14.540430 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc3044-c404-4008-b66e-fe06e4532dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:14.541490 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc3044-c404-4008-b66e-fe06e4532dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:14.541980 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc3044-c404-4008-b66e-fe06e4532dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:14.542448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc3044-c404-4008-b66e-fe06e4532dc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:14.560335 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc3044-c404-4008-b66e-fe06e4532dc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:14.563037 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc3044-c404-4008-b66e-fe06e4532dc0 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:14.589647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-01cc3044-c404-4008-b66e-fe06e4532dc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:14.589647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:14.589647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:14.589647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:14.589647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:14.589647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:14.589647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:14.589647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:14.589647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:14.589647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:14.589647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:14.589647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:14.589647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:03:14.589647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:03:14.589647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:03:14.589647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:03:14.590709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:14.590709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:14.590709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:14.590709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:14.590709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:14.590709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:14.590709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:14.590709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:14.590709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:14.590709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:14.590709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:14.590709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:14.590709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:14.590709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:14.590709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:14.590709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:14.590709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:03:14.592025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:03:14.592025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:14.592025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:14.595080 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 488/985] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:14.601296 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89a0cd-62ce-416b-a902-2642f235de9a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:14.678140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:14.723945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89a0cd-62ce-416b-a902-2642f235de9a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:14.760147 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a977416-893e-498b-8d67-aeba61daaaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:14.760775 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a977416-893e-498b-8d67-aeba61daaaa8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:14.761040 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a977416-893e-498b-8d67-aeba61daaaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:14.761306 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a977416-893e-498b-8d67-aeba61daaaa8 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:14.761968 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a977416-893e-498b-8d67-aeba61daaaa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:14.762272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a977416-893e-498b-8d67-aeba61daaaa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:14.763718 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a977416-893e-498b-8d67-aeba61daaaa8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:14.782050 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 498/986] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:14.783529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc3044-c404-4008-b66e-fe06e4532dc0 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:14.911466 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc3044-c404-4008-b66e-fe06e4532dc0 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:14.948700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c521a70-7839-4857-bda9-321615ad6e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:14.949313 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c521a70-7839-4857-bda9-321615ad6e8e None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:14.949648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c521a70-7839-4857-bda9-321615ad6e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:14.950125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c521a70-7839-4857-bda9-321615ad6e8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:14.957574 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c521a70-7839-4857-bda9-321615ad6e8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:14.959026 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c521a70-7839-4857-bda9-321615ad6e8e None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:14.971389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-5c521a70-7839-4857-bda9-321615ad6e8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:03:14.971389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:14.971389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:14.971389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:14.971389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:14.971389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:14.971389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:14.971389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:14.971389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:14.971389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:14.971389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:14.971389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:14.971389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:03:14.971389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:03:14.971389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:03:14.972376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:03:14.972376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:14.972376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:14.972376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:14.972376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:14.972376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:14.972376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:14.972376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:14.972376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:14.972376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:14.972376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:14.972376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:14.972376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:14.972376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:14.972376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:14.972376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:14.972376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:14.978160 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:03:14.978160 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:03:14.978160 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:03:14.978160 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:03:14.978160 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:03:14.978160 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:03:14.978160 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:03:14.978160 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:14.978160 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 489/987] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:03:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:14.978671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a977416-893e-498b-8d67-aeba61daaaa8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:15.085751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a977416-893e-498b-8d67-aeba61daaaa8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:15.106555 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:15.122439 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e149e-ee71-48d2-80b4-a3a488c3adc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:15.123076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e149e-ee71-48d2-80b4-a3a488c3adc0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:15.123361 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e149e-ee71-48d2-80b4-a3a488c3adc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:15.123687 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e149e-ee71-48d2-80b4-a3a488c3adc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:15.124390 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e149e-ee71-48d2-80b4-a3a488c3adc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:15.124694 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e149e-ee71-48d2-80b4-a3a488c3adc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:15.126126 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e149e-ee71-48d2-80b4-a3a488c3adc0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:15.145138 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 499/988] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:03:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:15.146593 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c521a70-7839-4857-bda9-321615ad6e8e None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:15.162129 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:15.259981 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c521a70-7839-4857-bda9-321615ad6e8e None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:15.293479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68df47-50fc-404c-95fe-3694571a39fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:15.294073 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68df47-50fc-404c-95fe-3694571a39fe None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:15.294346 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68df47-50fc-404c-95fe-3694571a39fe None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:15.294610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68df47-50fc-404c-95fe-3694571a39fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:15.295343 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68df47-50fc-404c-95fe-3694571a39fe None admin] RBAC: Adding query filter params (role.id=4bbe1d7eee2c44329a4173574fab0f68, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=182eec86daa44cd48d6ef1c38f58e89d) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:15.295645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68df47-50fc-404c-95fe-3694571a39fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:15.297046 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68df47-50fc-404c-95fe-3694571a39fe None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:15.311036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 490/989] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:03:15 2022] GET /identity/v3/role_assignments?user.id=182eec86daa44cd48d6ef1c38f58e89d&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=4bbe1d7eee2c44329a4173574fab0f68 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:16.047492 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577601f0-0636-4bc1-b79e-3c21d6a74951 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:16.048065 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577601f0-0636-4bc1-b79e-3c21d6a74951 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:16.048065 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577601f0-0636-4bc1-b79e-3c21d6a74951 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:16.049620 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 500/990] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:16.055274 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa672b-925d-4a86-8cb5-48f5fcd52e49 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:16.055711 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa672b-925d-4a86-8cb5-48f5fcd52e49 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:16.055811 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa672b-925d-4a86-8cb5-48f5fcd52e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:16.074337 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-c7fa672b-925d-4a86-8cb5-48f5fcd52e49 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:16.075555 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c7fa672b-925d-4a86-8cb5-48f5fcd52e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:16.142397 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 491/991] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:16.164707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577601f0-0636-4bc1-b79e-3c21d6a74951 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:16.268151 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577601f0-0636-4bc1-b79e-3c21d6a74951 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:16.276772 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c63f6-e94f-4624-8696-9e99c1c12288 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:16.277056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c63f6-e94f-4624-8696-9e99c1c12288 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:16.277332 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c63f6-e94f-4624-8696-9e99c1c12288 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:16.278810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 492/992] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:03:16.283926 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667fb97-ae97-48e6-94ee-0c2e21347226 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:16.284242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667fb97-ae97-48e6-94ee-0c2e21347226 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:16.284551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667fb97-ae97-48e6-94ee-0c2e21347226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:16.291677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:16.303864 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-b667fb97-ae97-48e6-94ee-0c2e21347226 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:16.305040 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-b667fb97-ae97-48e6-94ee-0c2e21347226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:16.306217 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345dbc8-2596-4856-9f5c-03370014b88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:16.306918 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345dbc8-2596-4856-9f5c-03370014b88f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:16.307180 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345dbc8-2596-4856-9f5c-03370014b88f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:16.307453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345dbc8-2596-4856-9f5c-03370014b88f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:16.308035 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345dbc8-2596-4856-9f5c-03370014b88f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:16.309399 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345dbc8-2596-4856-9f5c-03370014b88f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:16.319208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-3345dbc8-2596-4856-9f5c-03370014b88f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 13:03:16.319208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:16.319208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:03:16.319208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:03:16.319208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:03:16.319208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:03:16.319208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:03:16.319208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:16.319208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 13:03:16.319208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:16.319208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:03:16.319208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:16.319208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:16.319208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:16.319208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:16.319208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:16.319208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:16.320253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:16.320253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:16.320253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:16.320253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:16.320253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:16.320253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:16.320253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:03:16.320253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:03:16.320253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:03:16.320253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:03:16.320253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:16.320253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:16.320253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:16.320253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:16.320253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:16.320253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:16.321139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:16.321139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:16.321139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:16.321139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:16.321139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:16.321139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:16.321139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:16.321139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:16.321139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:16.321139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:16.321139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:03:16.321139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:16.321139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 13:03:16.321139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:16.321139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 501/993] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:03:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:16.326397 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345dbc8-2596-4856-9f5c-03370014b88f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:16.375911 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:16.382067 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 493/994] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:16.405429 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667fb97-ae97-48e6-94ee-0c2e21347226 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:16.440031 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345dbc8-2596-4856-9f5c-03370014b88f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:16.482388 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb9f9f-e38e-4541-a2b0-330af7f55aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:16.483351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb9f9f-e38e-4541-a2b0-330af7f55aca None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:16.483638 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb9f9f-e38e-4541-a2b0-330af7f55aca None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:16.483907 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb9f9f-e38e-4541-a2b0-330af7f55aca None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:16.484540 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb9f9f-e38e-4541-a2b0-330af7f55aca None admin] RBAC: Adding query filter params (name=compute) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:16.484843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb9f9f-e38e-4541-a2b0-330af7f55aca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:16.486230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb9f9f-e38e-4541-a2b0-330af7f55aca None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:16.491948 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 502/995] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 10 13:03:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:16.497652 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb9f9f-e38e-4541-a2b0-330af7f55aca None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:16.524929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667fb97-ae97-48e6-94ee-0c2e21347226 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:16.562147 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de96ce-49a3-46b3-ad9c-2bf5b64f9dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:16.563167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de96ce-49a3-46b3-ad9c-2bf5b64f9dbc None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:16.563596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de96ce-49a3-46b3-ad9c-2bf5b64f9dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:16.564046 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de96ce-49a3-46b3-ad9c-2bf5b64f9dbc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:16.564778 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de96ce-49a3-46b3-ad9c-2bf5b64f9dbc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:16.566339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de96ce-49a3-46b3-ad9c-2bf5b64f9dbc None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:16.568344 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:16.581684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-81de96ce-49a3-46b3-ad9c-2bf5b64f9dbc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 13:03:16.581684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:16.581684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:03:16.581684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:03:16.581684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:03:16.581684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:03:16.581684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:03:16.581684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:16.581684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 13:03:16.581684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:16.581684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:03:16.581684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:16.581684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:16.581684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:16.581684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:16.581684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:16.581684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:16.583369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:16.583369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:16.583369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:16.583369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:16.583369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:16.583369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:16.583369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:03:16.583369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:03:16.583369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:03:16.583369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:03:16.583369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:16.583369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:16.583369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:16.583369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:16.583369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:16.583369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:16.584485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:16.584485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:16.584485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:16.584485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:16.584485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:16.584485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:16.584485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:16.584485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:16.584485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:16.584485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:16.584485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:03:16.584485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:16.584485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 13:03:16.584485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:16.584485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 494/996] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Aug 10 13:03:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:16.589104 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de96ce-49a3-46b3-ad9c-2bf5b64f9dbc None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:16.617180 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb9f9f-e38e-4541-a2b0-330af7f55aca None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:16.627420 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:16.663681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d8665-4b2f-4a8b-b451-9cece54118f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:16.664300 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d8665-4b2f-4a8b-b451-9cece54118f4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:16.664879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d8665-4b2f-4a8b-b451-9cece54118f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:16.665194 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d8665-4b2f-4a8b-b451-9cece54118f4 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:16.666671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d8665-4b2f-4a8b-b451-9cece54118f4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:16.666981 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d8665-4b2f-4a8b-b451-9cece54118f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:16.668375 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d8665-4b2f-4a8b-b451-9cece54118f4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:16.673891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 503/997] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 10 13:03:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:16.679841 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d8665-4b2f-4a8b-b451-9cece54118f4 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:16.703882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de96ce-49a3-46b3-ad9c-2bf5b64f9dbc None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:16.746122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb7431-a535-4dea-ba9e-de3f8321cba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:16.747098 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb7431-a535-4dea-ba9e-de3f8321cba6 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:16.747098 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb7431-a535-4dea-ba9e-de3f8321cba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:16.747384 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb7431-a535-4dea-ba9e-de3f8321cba6 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:16.748019 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb7431-a535-4dea-ba9e-de3f8321cba6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:16.748377 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb7431-a535-4dea-ba9e-de3f8321cba6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:16.749662 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb7431-a535-4dea-ba9e-de3f8321cba6 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:16.760236 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 495/998] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Aug 10 13:03:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:16.761473 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb7431-a535-4dea-ba9e-de3f8321cba6 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:16.798375 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d8665-4b2f-4a8b-b451-9cece54118f4 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:16.832946 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:16.833768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a696a-dc27-4e78-b3f9-01aeb5829647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:16.834747 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a696a-dc27-4e78-b3f9-01aeb5829647 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:16.835050 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a696a-dc27-4e78-b3f9-01aeb5829647 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:16.835326 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a696a-dc27-4e78-b3f9-01aeb5829647 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:16.836116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a696a-dc27-4e78-b3f9-01aeb5829647 None admin] RBAC: Adding query filter params (interface=public, service_id=66b46c52b06e4f328b41b4bfe787c9b3, region_id=RegionOne) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:16.836420 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a696a-dc27-4e78-b3f9-01aeb5829647 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:16.837773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a696a-dc27-4e78-b3f9-01aeb5829647 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:16.847473 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 504/999] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Aug 10 13:03:16 2022] GET /identity/v3/endpoints?service_id=66b46c52b06e4f328b41b4bfe787c9b3&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:16.850009 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a696a-dc27-4e78-b3f9-01aeb5829647 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:16.883230 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb7431-a535-4dea-ba9e-de3f8321cba6 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:16.888650 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:16.921937 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d90fba-4f97-4581-814a-05057f9130dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:16.922752 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d90fba-4f97-4581-814a-05057f9130dd None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:16.922897 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d90fba-4f97-4581-814a-05057f9130dd None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:16.923090 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d90fba-4f97-4581-814a-05057f9130dd None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:16.923976 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d90fba-4f97-4581-814a-05057f9130dd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:16.924268 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d90fba-4f97-4581-814a-05057f9130dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:16.925665 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d90fba-4f97-4581-814a-05057f9130dd None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:16.931659 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 496/1000] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Aug 10 13:03:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:16.937064 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d90fba-4f97-4581-814a-05057f9130dd None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:16.959150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a696a-dc27-4e78-b3f9-01aeb5829647 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:16.997214 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b4aa7-8d34-40f2-afe1-3989e420de2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:16.998177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b4aa7-8d34-40f2-afe1-3989e420de2c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:16.998555 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b4aa7-8d34-40f2-afe1-3989e420de2c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:16.998934 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b4aa7-8d34-40f2-afe1-3989e420de2c None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:16.999583 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b4aa7-8d34-40f2-afe1-3989e420de2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:17.001187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b4aa7-8d34-40f2-afe1-3989e420de2c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:17.008017 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 505/1001] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Aug 10 13:03:16 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:03:17.060477 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d90fba-4f97-4581-814a-05057f9130dd None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:17.091885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:17.103401 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3323090-3989-4319-a2ea-2b7b1ad9023a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:17.104088 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3323090-3989-4319-a2ea-2b7b1ad9023a None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:17.104368 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3323090-3989-4319-a2ea-2b7b1ad9023a None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:17.104633 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3323090-3989-4319-a2ea-2b7b1ad9023a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:17.105356 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3323090-3989-4319-a2ea-2b7b1ad9023a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:17.106749 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3323090-3989-4319-a2ea-2b7b1ad9023a None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:17.131098 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 497/1002] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:03:16 2022] POST /identity/v3/endpoints => generated 325 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:03:17.366915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e875f-18dc-4bcf-843e-fa0428704c06 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:17.367478 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e875f-18dc-4bcf-843e-fa0428704c06 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:17.367478 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e875f-18dc-4bcf-843e-fa0428704c06 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:17.368964 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 506/1003] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:17.374532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae470ce4-c9a9-4e2f-9267-16a49d843098 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:17.374825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae470ce4-c9a9-4e2f-9267-16a49d843098 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:17.375114 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae470ce4-c9a9-4e2f-9267-16a49d843098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:17.395303 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-ae470ce4-c9a9-4e2f-9267-16a49d843098 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:17.396518 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-ae470ce4-c9a9-4e2f-9267-16a49d843098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:17.485837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 498/1004] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:17 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:17.508256 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e875f-18dc-4bcf-843e-fa0428704c06 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:17.609682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:17.614835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e875f-18dc-4bcf-843e-fa0428704c06 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:17.652343 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c12a85-1072-41a8-9bd0-ddd2843bef54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:17.653332 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c12a85-1072-41a8-9bd0-ddd2843bef54 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:17.653864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c12a85-1072-41a8-9bd0-ddd2843bef54 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:17.654340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c12a85-1072-41a8-9bd0-ddd2843bef54 None admin] PATH_INFO: `/v3/services/image` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:17.655255 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c12a85-1072-41a8-9bd0-ddd2843bef54 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:17.656980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c12a85-1072-41a8-9bd0-ddd2843bef54 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:17.667607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-27c12a85-1072-41a8-9bd0-ddd2843bef54 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 13:03:17.667607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:17.667607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:03:17.667607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:03:17.667607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:03:17.667607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:03:17.667607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:03:17.667607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:17.667607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 13:03:17.667607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:17.667607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:03:17.667607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:17.667607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:17.667607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:17.667607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:17.667607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:17.667607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:17.668643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:17.668643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:17.668643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:17.668643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:17.668643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:17.668643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:17.668643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:03:17.668643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:03:17.668643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:03:17.668643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:03:17.668643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:17.668643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:17.668643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:17.668643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:17.668643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:17.668643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:17.669502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:17.669502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:17.669502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:17.669502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:17.669502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:17.669502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:17.669502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:17.669502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:17.669502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:17.669502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:17.669502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:03:17.669502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:17.669502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 13:03:17.669502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:17.671985 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 507/1005] 10.222.0.46 () {56 vars in 1105 bytes} [Wed Aug 10 13:03:17 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:17.677789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae470ce4-c9a9-4e2f-9267-16a49d843098 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:17.779422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae470ce4-c9a9-4e2f-9267-16a49d843098 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:17.793052 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:17.817927 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9ec95-e06e-47e1-877d-54b4673d2713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:17.818537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9ec95-e06e-47e1-877d-54b4673d2713 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:17.818815 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9ec95-e06e-47e1-877d-54b4673d2713 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:17.819112 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9ec95-e06e-47e1-877d-54b4673d2713 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:17.819740 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9ec95-e06e-47e1-877d-54b4673d2713 None admin] RBAC: Adding query filter params (name=image) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:17.820045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9ec95-e06e-47e1-877d-54b4673d2713 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:17.821401 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9ec95-e06e-47e1-877d-54b4673d2713 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:17.830823 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 499/1006] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:17.832259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c12a85-1072-41a8-9bd0-ddd2843bef54 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:17.940064 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c12a85-1072-41a8-9bd0-ddd2843bef54 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:17.975529 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a665c31-1a53-4153-ade2-154d3ffee7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:17.975909 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a665c31-1a53-4153-ade2-154d3ffee7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:17.976186 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a665c31-1a53-4153-ade2-154d3ffee7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:17.976461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a665c31-1a53-4153-ade2-154d3ffee7d9 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:17.977083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a665c31-1a53-4153-ade2-154d3ffee7d9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:17.977384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a665c31-1a53-4153-ade2-154d3ffee7d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:17.978820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a665c31-1a53-4153-ade2-154d3ffee7d9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:17.995269 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 508/1007] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:17 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:19.066450 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe0057-6122-4c8c-bef3-b6979661a466 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:19.066967 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe0057-6122-4c8c-bef3-b6979661a466 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:19.066967 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe0057-6122-4c8c-bef3-b6979661a466 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:19.068505 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 500/1008] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:19.073753 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49375e7-ad77-4c13-a575-7a3ee5adb4f8 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:19.074222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49375e7-ad77-4c13-a575-7a3ee5adb4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:19.074299 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49375e7-ad77-4c13-a575-7a3ee5adb4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:19.093964 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d49375e7-ad77-4c13-a575-7a3ee5adb4f8 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:19.095193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d49375e7-ad77-4c13-a575-7a3ee5adb4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:19.119864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:19.166395 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 509/1009] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:19 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:19.180935 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fb932-3dd3-4eff-868e-28605ebc17e8 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:19.181354 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fb932-3dd3-4eff-868e-28605ebc17e8 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:19.181692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fb932-3dd3-4eff-868e-28605ebc17e8 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:19.183146 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 501/1010] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:19.188239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197166f4-8da3-4512-9a97-0a9c1df7d0da None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:19.188528 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197166f4-8da3-4512-9a97-0a9c1df7d0da None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:19.188802 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197166f4-8da3-4512-9a97-0a9c1df7d0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:19.188937 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fb932-3dd3-4eff-868e-28605ebc17e8 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:19.207646 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-197166f4-8da3-4512-9a97-0a9c1df7d0da None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:19.208829 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-197166f4-8da3-4512-9a97-0a9c1df7d0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:19.283155 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 510/1011] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:19 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:19.293782 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fb932-3dd3-4eff-868e-28605ebc17e8 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:19.305267 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197166f4-8da3-4512-9a97-0a9c1df7d0da None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:19.333341 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0f803-b26d-4a19-b212-2ce8e05e0eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:19.334026 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0f803-b26d-4a19-b212-2ce8e05e0eec None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:19.334231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0f803-b26d-4a19-b212-2ce8e05e0eec None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:19.334519 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0f803-b26d-4a19-b212-2ce8e05e0eec None admin] PATH_INFO: `/v3/services/compute` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:19.335166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0f803-b26d-4a19-b212-2ce8e05e0eec None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:19.336548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0f803-b26d-4a19-b212-2ce8e05e0eec None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:19.345647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-34a0f803-b26d-4a19-b212-2ce8e05e0eec None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 13:03:19.345647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:19.345647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:03:19.345647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:03:19.345647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:03:19.345647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:03:19.345647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:03:19.345647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:19.345647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 13:03:19.345647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:19.345647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:03:19.345647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:19.345647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:19.345647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:19.345647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:19.345647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:19.345647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:19.347400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:19.347400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:19.347400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:19.347400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:19.347400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:19.347400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:19.347400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:03:19.347400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:03:19.347400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:03:19.347400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:03:19.347400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:19.347400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:19.347400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:19.347400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:19.347400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:19.347400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:19.348300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:19.348300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:19.348300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:19.348300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:19.348300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:19.348300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:19.348300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:19.348300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:19.348300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:19.348300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:19.348300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:03:19.348300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:19.348300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 13:03:19.348300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:19.348300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 502/1012] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:03:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:19.355202 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0f803-b26d-4a19-b212-2ce8e05e0eec None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:19.399555 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:19.402203 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:19.413978 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197166f4-8da3-4512-9a97-0a9c1df7d0da None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:19.448723 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39223be5-48b9-4766-a6b6-7a8143a26c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:19.449353 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39223be5-48b9-4766-a6b6-7a8143a26c0c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:19.449634 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39223be5-48b9-4766-a6b6-7a8143a26c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:19.449907 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39223be5-48b9-4766-a6b6-7a8143a26c0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:19.451036 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39223be5-48b9-4766-a6b6-7a8143a26c0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:19.452487 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39223be5-48b9-4766-a6b6-7a8143a26c0c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:19.454060 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 511/1013] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:19.460278 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39223be5-48b9-4766-a6b6-7a8143a26c0c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:19.472867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0f803-b26d-4a19-b212-2ce8e05e0eec None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:19.511095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8353acd-7c5d-445c-8776-a2c4e3c05bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:19.511708 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8353acd-7c5d-445c-8776-a2c4e3c05bae None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:19.512017 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8353acd-7c5d-445c-8776-a2c4e3c05bae None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:19.512334 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8353acd-7c5d-445c-8776-a2c4e3c05bae None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:19.512962 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8353acd-7c5d-445c-8776-a2c4e3c05bae None admin] RBAC: Adding query filter params (name=compute) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:19.513265 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8353acd-7c5d-445c-8776-a2c4e3c05bae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:19.514618 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8353acd-7c5d-445c-8776-a2c4e3c05bae None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:19.524378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 503/1014] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 10 13:03:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:19.525110 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8353acd-7c5d-445c-8776-a2c4e3c05bae None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:19.569879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39223be5-48b9-4766-a6b6-7a8143a26c0c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:19.613225 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f2e94-d6d8-41c8-8bd2-a0e0cbe83d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:19.614285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f2e94-d6d8-41c8-8bd2-a0e0cbe83d25 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:19.614653 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f2e94-d6d8-41c8-8bd2-a0e0cbe83d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:19.614931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f2e94-d6d8-41c8-8bd2-a0e0cbe83d25 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:19.615642 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f2e94-d6d8-41c8-8bd2-a0e0cbe83d25 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:19.617085 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f2e94-d6d8-41c8-8bd2-a0e0cbe83d25 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:19.649872 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8353acd-7c5d-445c-8776-a2c4e3c05bae None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:19.652905 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:19.656310 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 512/1015] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 10 13:03:19 2022] POST /identity/v3/projects => generated 311 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:03:19.699846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664010f-fffd-48e6-8b5e-e3da70c41117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:19.700468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664010f-fffd-48e6-8b5e-e3da70c41117 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:19.700747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664010f-fffd-48e6-8b5e-e3da70c41117 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:19.701016 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664010f-fffd-48e6-8b5e-e3da70c41117 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:19.701648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664010f-fffd-48e6-8b5e-e3da70c41117 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:19.701952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664010f-fffd-48e6-8b5e-e3da70c41117 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:19.703377 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664010f-fffd-48e6-8b5e-e3da70c41117 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:19.709884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 504/1016] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 10 13:03:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:19.716135 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f2e94-d6d8-41c8-8bd2-a0e0cbe83d25 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:19.730332 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:19.836252 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f2e94-d6d8-41c8-8bd2-a0e0cbe83d25 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:19.874089 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c05ca-d7a6-47d3-a87c-6fe7b1509eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:19.874714 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c05ca-d7a6-47d3-a87c-6fe7b1509eae None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:19.875024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c05ca-d7a6-47d3-a87c-6fe7b1509eae None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:19.875346 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c05ca-d7a6-47d3-a87c-6fe7b1509eae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:19.876029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c05ca-d7a6-47d3-a87c-6fe7b1509eae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:19.877402 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c05ca-d7a6-47d3-a87c-6fe7b1509eae None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:19.901349 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 513/1017] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:03:19 2022] POST /identity/v3/endpoints => generated 334 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:03:20.006873 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c7e28-e9b5-44e7-879b-1e549aa7a7a7 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:20.007258 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c7e28-e9b5-44e7-879b-1e549aa7a7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:20.007456 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c7e28-e9b5-44e7-879b-1e549aa7a7a7 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:20.008975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 505/1018] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:20.014485 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a195d22-e8bc-4c48-b7ff-fe775d438f6c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:20.014784 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a195d22-e8bc-4c48-b7ff-fe775d438f6c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:20.015072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a195d22-e8bc-4c48-b7ff-fe775d438f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:20.035364 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8a195d22-e8bc-4c48-b7ff-fe775d438f6c None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:20.036571 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8a195d22-e8bc-4c48-b7ff-fe775d438f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:20.103499 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:20.118497 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 514/1019] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:20 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:20.141612 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c7e28-e9b5-44e7-879b-1e549aa7a7a7 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:20.252859 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c7e28-e9b5-44e7-879b-1e549aa7a7a7 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:20.287957 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d38f92-6f43-41ab-aaba-0922122c91a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:20.288557 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d38f92-6f43-41ab-aaba-0922122c91a5 None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:20.288829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d38f92-6f43-41ab-aaba-0922122c91a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:20.289091 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d38f92-6f43-41ab-aaba-0922122c91a5 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:20.289718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d38f92-6f43-41ab-aaba-0922122c91a5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:20.291089 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d38f92-6f43-41ab-aaba-0922122c91a5 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:20.315030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 506/1020] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 10 13:03:20 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:03:21.727249 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818e2bb-62b5-4651-a799-f73926607ae1 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:21.727780 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818e2bb-62b5-4651-a799-f73926607ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:21.727780 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818e2bb-62b5-4651-a799-f73926607ae1 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:21.729152 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 515/1021] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:21.734248 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb48b5b-e953-4e02-9fa5-834ab9abcf24 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:21.734745 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb48b5b-e953-4e02-9fa5-834ab9abcf24 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:21.734825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb48b5b-e953-4e02-9fa5-834ab9abcf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:21.752605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-adb48b5b-e953-4e02-9fa5-834ab9abcf24 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:21.754294 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-adb48b5b-e953-4e02-9fa5-834ab9abcf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:21.777591 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:21.829995 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 507/1022] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:21.854515 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818e2bb-62b5-4651-a799-f73926607ae1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:21.963463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818e2bb-62b5-4651-a799-f73926607ae1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:22.010040 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba9600-66b9-48ff-82ea-aac9e50e64b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:22.010681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba9600-66b9-48ff-82ea-aac9e50e64b2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:22.010958 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba9600-66b9-48ff-82ea-aac9e50e64b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:22.011255 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba9600-66b9-48ff-82ea-aac9e50e64b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:22.012378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba9600-66b9-48ff-82ea-aac9e50e64b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:22.013809 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba9600-66b9-48ff-82ea-aac9e50e64b2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:22.020103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 516/1023] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:22.021737 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb48b5b-e953-4e02-9fa5-834ab9abcf24 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:22.033035 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c4d45-a2c8-4952-a1aa-c3654cbca832 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:22.033323 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c4d45-a2c8-4952-a1aa-c3654cbca832 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:22.033591 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c4d45-a2c8-4952-a1aa-c3654cbca832 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:22.035192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 517/1024] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:03:22.039870 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6b974-f0e4-46a1-92d4-8e0a65e188ec None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:22.040270 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6b974-f0e4-46a1-92d4-8e0a65e188ec None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:22.040448 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6b974-f0e4-46a1-92d4-8e0a65e188ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:22.059096 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d6f6b974-f0e4-46a1-92d4-8e0a65e188ec None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:22.060291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d6f6b974-f0e4-46a1-92d4-8e0a65e188ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:22.121606 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:22.133289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb48b5b-e953-4e02-9fa5-834ab9abcf24 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:22.140105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 518/1025] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 13:03:22.163026 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6b974-f0e4-46a1-92d4-8e0a65e188ec None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:22.168016 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429d1d1-325f-48c0-887c-1e2132672542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:22.168623 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429d1d1-325f-48c0-887c-1e2132672542 None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:22.168900 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429d1d1-325f-48c0-887c-1e2132672542 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:22.169167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429d1d1-325f-48c0-887c-1e2132672542 None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:22.169808 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429d1d1-325f-48c0-887c-1e2132672542 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:22.171320 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429d1d1-325f-48c0-887c-1e2132672542 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:22.202175 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 508/1026] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 10 13:03:22 2022] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:03:22.276062 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6b974-f0e4-46a1-92d4-8e0a65e188ec None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:22.314585 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c62271-2a79-4272-9316-f83085320373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:22.315805 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c62271-2a79-4272-9316-f83085320373 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:22.316089 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c62271-2a79-4272-9316-f83085320373 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:22.316358 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c62271-2a79-4272-9316-f83085320373 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:22.328406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c62271-2a79-4272-9316-f83085320373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:03:22.332940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5906670-aab2-46e7-973d-7a062fc28397 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:22.333221 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5906670-aab2-46e7-973d-7a062fc28397 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:22.333492 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5906670-aab2-46e7-973d-7a062fc28397 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:22.333773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-07c62271-2a79-4272-9316-f83085320373 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 13:03:22.333773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:22.333773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:22.333773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:22.333773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:22.333773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:22.333773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:22.333773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:22.333773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:22.333773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:22.333773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:22.333773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:22.333773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:03:22.333773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:03:22.333773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:03:22.333773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:03:22.334697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:03:22.334697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:03:22.334697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:03:22.334697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:03:22.334697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:22.334697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:22.334697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:22.334697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:22.334697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:22.334697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:22.334697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:22.334697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:22.334697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:22.334697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:22.334697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:22.334697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:22.336140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:22.336140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:22.336140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:22.336140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:22.336140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:03:22.336140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:03:22.336140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:03:22.336140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:03:22.336140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:03:22.336140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:03:22.336140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 13:03:22.336140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:22.336926 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 509/1027] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:03:22.337008 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 519/1028] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Aug 10 13:03:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:22.340878 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3c3d8-99ee-4691-9437-0b83f9e4e28f None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:22.341155 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3c3d8-99ee-4691-9437-0b83f9e4e28f None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:22.341420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3c3d8-99ee-4691-9437-0b83f9e4e28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:22.345945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c62271-2a79-4272-9316-f83085320373 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:22.363204 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-54a3c3d8-99ee-4691-9437-0b83f9e4e28f None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:22.364928 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-54a3c3d8-99ee-4691-9437-0b83f9e4e28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:22.368576 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:22.402626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:22.448858 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 510/1029] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:22.461075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c62271-2a79-4272-9316-f83085320373 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:22.472277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3c3d8-99ee-4691-9437-0b83f9e4e28f None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:22.500971 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e744ae-764e-45d7-bf3f-cb52025d6d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:22.501936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e744ae-764e-45d7-bf3f-cb52025d6d24 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:22.502393 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e744ae-764e-45d7-bf3f-cb52025d6d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:22.503416 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e744ae-764e-45d7-bf3f-cb52025d6d24 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:22.504226 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e744ae-764e-45d7-bf3f-cb52025d6d24 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:22.504795 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e744ae-764e-45d7-bf3f-cb52025d6d24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:22.506286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e744ae-764e-45d7-bf3f-cb52025d6d24 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:22.515582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 520/1030] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Aug 10 13:03:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:22.521744 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e744ae-764e-45d7-bf3f-cb52025d6d24 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:22.580718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3c3d8-99ee-4691-9437-0b83f9e4e28f None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:22.623088 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433db48-a9ae-444f-b141-836978f0457c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:22.623876 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433db48-a9ae-444f-b141-836978f0457c None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:22.624255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433db48-a9ae-444f-b141-836978f0457c None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:22.624534 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433db48-a9ae-444f-b141-836978f0457c None admin] PATH_INFO: `/v3/services/image` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:22.625176 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433db48-a9ae-444f-b141-836978f0457c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:22.626598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433db48-a9ae-444f-b141-836978f0457c None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:22.636427 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e744ae-764e-45d7-bf3f-cb52025d6d24 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:22.638006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-a433db48-a9ae-444f-b141-836978f0457c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 13:03:22.638006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:22.638006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:03:22.638006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:03:22.638006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:03:22.638006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:03:22.638006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:03:22.638006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:22.638006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 13:03:22.638006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:22.638006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:03:22.638006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:22.638006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:22.638006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:22.638006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:22.638006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:22.638006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:22.638986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:22.638986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:22.638986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:22.638986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:22.638986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:22.638986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:22.638986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:03:22.638986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:03:22.638986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:03:22.638986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:03:22.638986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:22.638986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:22.638986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:22.638986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:22.638986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:22.638986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:22.640585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:22.640585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:22.640585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:22.640585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:22.640585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:22.640585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:22.640585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:22.640585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:22.640585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:22.640585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:22.640585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:03:22.640585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:22.640585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 13:03:22.640585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:22.640585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 511/1031] 10.222.0.46 () {56 vars in 1105 bytes} [Wed Aug 10 13:03:22 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:22.645958 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433db48-a9ae-444f-b141-836978f0457c None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:22.649924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:22.653122 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:22.681213 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ace3c2-54ef-4438-8c84-b4fc83d28dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:22.682101 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ace3c2-54ef-4438-8c84-b4fc83d28dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:22.682544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ace3c2-54ef-4438-8c84-b4fc83d28dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:22.682818 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ace3c2-54ef-4438-8c84-b4fc83d28dd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:22.695472 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ace3c2-54ef-4438-8c84-b4fc83d28dd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:22.696936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ace3c2-54ef-4438-8c84-b4fc83d28dd1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:22.713454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b7ace3c2-54ef-4438-8c84-b4fc83d28dd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:22.713454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:22.713454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:22.713454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:22.713454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:22.713454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:22.713454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:22.713454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:22.713454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:22.713454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:22.713454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:22.713454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:22.713454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:03:22.713454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:03:22.713454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:03:22.713454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:03:22.714510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:22.714510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:22.714510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:22.714510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:22.714510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:22.714510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:22.714510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:22.714510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:22.714510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:22.714510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:22.714510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:22.714510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:22.714510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:22.714510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:22.714510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:22.714510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:22.714510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:03:22.715465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:03:22.715465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:22.715465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:22.719633 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 521/1032] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:22.720375 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ace3c2-54ef-4438-8c84-b4fc83d28dd1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:22.758838 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433db48-a9ae-444f-b141-836978f0457c None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:22.796354 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2152b7-5a4f-48c9-90da-8d4976c81384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:22.797214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2152b7-5a4f-48c9-90da-8d4976c81384 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:22.797496 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2152b7-5a4f-48c9-90da-8d4976c81384 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:22.797766 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2152b7-5a4f-48c9-90da-8d4976c81384 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:22.798399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2152b7-5a4f-48c9-90da-8d4976c81384 None admin] RBAC: Adding query filter params (name=image) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:22.798708 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2152b7-5a4f-48c9-90da-8d4976c81384 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:22.801268 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2152b7-5a4f-48c9-90da-8d4976c81384 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:22.812986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 512/1033] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:22.814116 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2152b7-5a4f-48c9-90da-8d4976c81384 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:22.828350 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ace3c2-54ef-4438-8c84-b4fc83d28dd1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:22.866927 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba87075-7b33-4f72-a0f9-6890f935c5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:22.867856 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba87075-7b33-4f72-a0f9-6890f935c5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:22.868204 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba87075-7b33-4f72-a0f9-6890f935c5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:22.868485 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba87075-7b33-4f72-a0f9-6890f935c5f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:22.869246 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba87075-7b33-4f72-a0f9-6890f935c5f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:22.869554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba87075-7b33-4f72-a0f9-6890f935c5f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:22.871837 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba87075-7b33-4f72-a0f9-6890f935c5f5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:22.886281 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 522/1034] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:22.891810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba87075-7b33-4f72-a0f9-6890f935c5f5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:22.900994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:22.920642 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:22.942394 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2152b7-5a4f-48c9-90da-8d4976c81384 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:22.979393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4936348-c25c-43c1-b780-c85da99d5968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:22.980006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4936348-c25c-43c1-b780-c85da99d5968 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:22.980283 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4936348-c25c-43c1-b780-c85da99d5968 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:22.980554 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4936348-c25c-43c1-b780-c85da99d5968 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:22.981296 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4936348-c25c-43c1-b780-c85da99d5968 None admin] RBAC: Adding query filter params (type=image) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:22.981601 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4936348-c25c-43c1-b780-c85da99d5968 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:22.983109 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4936348-c25c-43c1-b780-c85da99d5968 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:22.989928 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 513/1035] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:22.995469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4936348-c25c-43c1-b780-c85da99d5968 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:23.015394 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba87075-7b33-4f72-a0f9-6890f935c5f5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:23.051455 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce46783-a5f7-4087-b2ca-b99c72102bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:23.052079 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce46783-a5f7-4087-b2ca-b99c72102bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:23.052355 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce46783-a5f7-4087-b2ca-b99c72102bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:23.052624 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce46783-a5f7-4087-b2ca-b99c72102bd6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:23.060628 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce46783-a5f7-4087-b2ca-b99c72102bd6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:23.062064 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce46783-a5f7-4087-b2ca-b99c72102bd6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:23.074017 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-4ce46783-a5f7-4087-b2ca-b99c72102bd6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 13:03:23.074017 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:23.074017 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:23.074017 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:23.074017 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:23.074017 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:23.074017 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:23.074017 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:23.074017 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:23.074017 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:23.074017 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:23.074017 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:23.074017 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:03:23.074017 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:03:23.074017 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:03:23.074017 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:03:23.075943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:23.075943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:23.075943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:03:23.075943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:03:23.075943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:03:23.075943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:03:23.075943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:23.075943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:23.075943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:23.075943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:23.075943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:23.075943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:23.075943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:23.075943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:23.075943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:23.075943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:23.075943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:23.075943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:23.077309 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:23.077309 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:23.077309 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:03:23.077309 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:03:23.077309 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:03:23.077309 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:03:23.077309 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:03:23.077309 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:03:23.077309 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 13:03:23.077309 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:23.077309 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 523/1036] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Aug 10 13:03:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:23.080562 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce46783-a5f7-4087-b2ca-b99c72102bd6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:23.111122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4936348-c25c-43c1-b780-c85da99d5968 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:23.140558 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:23.145946 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ed6a0-2dae-4dc3-85b4-d0c463a5592a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:23.146559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ed6a0-2dae-4dc3-85b4-d0c463a5592a None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:23.146842 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ed6a0-2dae-4dc3-85b4-d0c463a5592a None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:23.147143 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ed6a0-2dae-4dc3-85b4-d0c463a5592a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:23.147835 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ed6a0-2dae-4dc3-85b4-d0c463a5592a None admin] RBAC: Adding query filter params (interface=public, service_id=0205f5f981ef4cceb2307b68b6c49217, region_id=RegionOne) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:23.148142 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ed6a0-2dae-4dc3-85b4-d0c463a5592a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:23.149497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ed6a0-2dae-4dc3-85b4-d0c463a5592a None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:23.156701 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 514/1037] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Aug 10 13:03:22 2022] GET /identity/v3/endpoints?service_id=0205f5f981ef4cceb2307b68b6c49217&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:23.162760 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ed6a0-2dae-4dc3-85b4-d0c463a5592a None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:23.168704 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:23.189596 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce46783-a5f7-4087-b2ca-b99c72102bd6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:23.226344 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799eef1a-912d-44f4-af3d-472b4bc79151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:23.226957 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799eef1a-912d-44f4-af3d-472b4bc79151 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:23.227266 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799eef1a-912d-44f4-af3d-472b4bc79151 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:23.227546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799eef1a-912d-44f4-af3d-472b4bc79151 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:23.228328 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799eef1a-912d-44f4-af3d-472b4bc79151 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:23.228638 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799eef1a-912d-44f4-af3d-472b4bc79151 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:23.230096 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799eef1a-912d-44f4-af3d-472b4bc79151 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:23.253234 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 524/1038] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Aug 10 13:03:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:23.254560 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799eef1a-912d-44f4-af3d-472b4bc79151 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:23.277991 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ed6a0-2dae-4dc3-85b4-d0c463a5592a None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:23.314647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94255d8-3dd8-414b-8b2b-e6ba3de2bf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:23.315834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94255d8-3dd8-414b-8b2b-e6ba3de2bf01 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:23.316117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94255d8-3dd8-414b-8b2b-e6ba3de2bf01 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:23.316610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94255d8-3dd8-414b-8b2b-e6ba3de2bf01 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:23.317344 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94255d8-3dd8-414b-8b2b-e6ba3de2bf01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:23.318716 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94255d8-3dd8-414b-8b2b-e6ba3de2bf01 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:23.327819 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 515/1039] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Aug 10 13:03:23 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:03:23.368548 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799eef1a-912d-44f4-af3d-472b4bc79151 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:23.410245 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b059f81-f7a1-4be8-8c7a-4c123f142fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:23.410792 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b059f81-f7a1-4be8-8c7a-4c123f142fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:23.411099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b059f81-f7a1-4be8-8c7a-4c123f142fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:23.411372 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b059f81-f7a1-4be8-8c7a-4c123f142fa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:23.423388 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:23.488601 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b059f81-f7a1-4be8-8c7a-4c123f142fa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:23.489283 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b059f81-f7a1-4be8-8c7a-4c123f142fa7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:23.595680 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 525/1040] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:03:23 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 13:03:23.601634 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94255d8-3dd8-414b-8b2b-e6ba3de2bf01 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:23.667732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:23.711980 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94255d8-3dd8-414b-8b2b-e6ba3de2bf01 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:23.751250 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c078650-b173-411c-b7c2-4acffdfca210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:23.751924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c078650-b173-411c-b7c2-4acffdfca210 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:23.752151 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c078650-b173-411c-b7c2-4acffdfca210 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:23.752418 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c078650-b173-411c-b7c2-4acffdfca210 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:23.763592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c078650-b173-411c-b7c2-4acffdfca210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:23.765027 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c078650-b173-411c-b7c2-4acffdfca210 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:23.779790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-8c078650-b173-411c-b7c2-4acffdfca210 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:23.779790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:23.779790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:23.779790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:23.779790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:23.779790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:23.779790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:23.779790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:23.779790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:23.779790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:23.779790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:23.779790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:23.779790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:03:23.779790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:03:23.779790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:03:23.779790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:03:23.780792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:23.780792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:23.780792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:23.780792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:23.780792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:23.780792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:23.780792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:23.780792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:23.780792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:23.780792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:23.780792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:23.780792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:23.780792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:23.780792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:23.780792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:23.780792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:23.780792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:03:23.781712 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:03:23.781712 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:23.781712 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:23.781712 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 516/1041] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:23.788688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b059f81-f7a1-4be8-8c7a-4c123f142fa7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:23.832874 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:23.894703 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b059f81-f7a1-4be8-8c7a-4c123f142fa7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:23.927905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2d627-9c3b-4b6d-bee7-22129a33aaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:23.928422 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2d627-9c3b-4b6d-bee7-22129a33aaea None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:23.928696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2d627-9c3b-4b6d-bee7-22129a33aaea None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:23.928962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2d627-9c3b-4b6d-bee7-22129a33aaea None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:23.929598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2d627-9c3b-4b6d-bee7-22129a33aaea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:23.929889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2d627-9c3b-4b6d-bee7-22129a33aaea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:23.932311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2d627-9c3b-4b6d-bee7-22129a33aaea None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:23.953623 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 526/1042] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:23.955266 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c078650-b173-411c-b7c2-4acffdfca210 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:24.071117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c078650-b173-411c-b7c2-4acffdfca210 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:24.084125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:24.107604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c7fe0-b243-46c0-a8b1-52668757b39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:24.108454 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c7fe0-b243-46c0-a8b1-52668757b39c None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:24.108910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c7fe0-b243-46c0-a8b1-52668757b39c None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:24.109328 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c7fe0-b243-46c0-a8b1-52668757b39c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:24.117417 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c7fe0-b243-46c0-a8b1-52668757b39c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:24.119103 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c7fe0-b243-46c0-a8b1-52668757b39c None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:24.131435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-367c7fe0-b243-46c0-a8b1-52668757b39c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:03:24.131435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:24.131435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:24.131435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:24.131435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:24.131435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:24.131435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:24.131435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:24.131435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:24.131435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:24.131435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:24.131435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:24.131435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:03:24.131435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:03:24.131435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:03:24.132542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:03:24.132542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:24.132542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:24.132542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:24.132542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:24.132542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:24.132542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:24.132542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:24.132542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:24.132542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:24.132542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:24.132542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:24.132542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:24.132542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:24.132542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:24.132542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:24.132542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:24.133688 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:03:24.133688 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:03:24.133688 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:03:24.133688 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:03:24.133688 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:03:24.133688 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:03:24.133688 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:03:24.133688 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:24.135721 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 517/1043] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:03:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:24.141172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2d627-9c3b-4b6d-bee7-22129a33aaea None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:24.240908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:24.244618 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2d627-9c3b-4b6d-bee7-22129a33aaea None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:24.278978 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff90ba-7283-4aca-80f8-8c73b90a2772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:24.279606 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff90ba-7283-4aca-80f8-8c73b90a2772 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:24.279882 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff90ba-7283-4aca-80f8-8c73b90a2772 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:24.280155 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff90ba-7283-4aca-80f8-8c73b90a2772 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:24.280842 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff90ba-7283-4aca-80f8-8c73b90a2772 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:24.281145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff90ba-7283-4aca-80f8-8c73b90a2772 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:24.282564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff90ba-7283-4aca-80f8-8c73b90a2772 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:24.295353 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 527/1044] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:03:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:24.301174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c7fe0-b243-46c0-a8b1-52668757b39c None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:24.302046 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2207e-df50-43a0-b6a8-016c50881a9c None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:24.302327 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2207e-df50-43a0-b6a8-016c50881a9c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:24.302596 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2207e-df50-43a0-b6a8-016c50881a9c None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:24.304076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 528/1045] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:24.309153 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc8b0d-9529-4eba-85c7-bdb22d85dd81 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:24.309439 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc8b0d-9529-4eba-85c7-bdb22d85dd81 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:24.309714 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc8b0d-9529-4eba-85c7-bdb22d85dd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:24.328837 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2fdc8b0d-9529-4eba-85c7-bdb22d85dd81 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:24.330029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2fdc8b0d-9529-4eba-85c7-bdb22d85dd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:24.399746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 529/1046] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 13:03:24.417862 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c7fe0-b243-46c0-a8b1-52668757b39c None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:24.423549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc8b0d-9529-4eba-85c7-bdb22d85dd81 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:24.452905 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb52a2-8f30-40a3-a720-8f69a19a2919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:24.453509 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb52a2-8f30-40a3-a720-8f69a19a2919 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:24.453784 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb52a2-8f30-40a3-a720-8f69a19a2919 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:24.454050 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb52a2-8f30-40a3-a720-8f69a19a2919 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:24.454756 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb52a2-8f30-40a3-a720-8f69a19a2919 None admin] RBAC: Adding query filter params (role.id=4bbe1d7eee2c44329a4173574fab0f68, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=7fd0f76f24ea481191dfd65fff2376af) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:24.455084 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb52a2-8f30-40a3-a720-8f69a19a2919 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:24.457055 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb52a2-8f30-40a3-a720-8f69a19a2919 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:24.467104 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 518/1047] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:03:24 2022] GET /identity/v3/role_assignments?user.id=7fd0f76f24ea481191dfd65fff2376af&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=4bbe1d7eee2c44329a4173574fab0f68 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:24.528445 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:24.539917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc8b0d-9529-4eba-85c7-bdb22d85dd81 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:24.579981 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5750d-dc95-415d-ba8f-9ed59b968bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:24.580627 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5750d-dc95-415d-ba8f-9ed59b968bde None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:24.581513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5750d-dc95-415d-ba8f-9ed59b968bde None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:24.581783 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5750d-dc95-415d-ba8f-9ed59b968bde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:24.593772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5750d-dc95-415d-ba8f-9ed59b968bde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:03:24.598544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-0ed5750d-dc95-415d-ba8f-9ed59b968bde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:03:24.598544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:24.598544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:24.598544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:24.598544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:24.598544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:24.598544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:24.598544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:24.598544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:24.598544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:24.598544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:24.598544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:24.598544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:03:24.598544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:03:24.598544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:03:24.598544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:03:24.599689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:03:24.599689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:03:24.599689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:03:24.599689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:03:24.599689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:24.599689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:24.599689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:24.599689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:24.599689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:24.599689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:24.599689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:24.599689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:24.599689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:24.599689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:24.599689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:24.599689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:24.606419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:24.606419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:24.606419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:24.606419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:24.606419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:03:24.606419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:03:24.606419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:03:24.606419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:03:24.606419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:03:24.606419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:03:24.606419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:03:24.606419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:24.606419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 530/1048] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:03:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:24.607643 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb52a2-8f30-40a3-a720-8f69a19a2919 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:24.646577 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:24.715577 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb52a2-8f30-40a3-a720-8f69a19a2919 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:24.749498 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8968d6-3000-4b92-b62e-c8a6648e7ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:24.750254 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8968d6-3000-4b92-b62e-c8a6648e7ced None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:24.750634 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8968d6-3000-4b92-b62e-c8a6648e7ced None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:24.751028 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8968d6-3000-4b92-b62e-c8a6648e7ced None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:24.751842 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8968d6-3000-4b92-b62e-c8a6648e7ced None admin] RBAC: Adding query filter params (name=admin) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:24.752238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8968d6-3000-4b92-b62e-c8a6648e7ced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:24.754824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8968d6-3000-4b92-b62e-c8a6648e7ced None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:24.768007 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 519/1049] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:03:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:24.769725 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5750d-dc95-415d-ba8f-9ed59b968bde None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:24.872289 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5750d-dc95-415d-ba8f-9ed59b968bde None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:24.906524 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb82d5-0980-4de9-a86f-6ab02df5d14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:24.907295 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb82d5-0980-4de9-a86f-6ab02df5d14e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:24.907577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb82d5-0980-4de9-a86f-6ab02df5d14e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:24.907847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb82d5-0980-4de9-a86f-6ab02df5d14e None admin] PATH_INFO: `/v3/users/b6f65ac76b644189a7a6a662d0ae9dfe` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:24.925324 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb82d5-0980-4de9-a86f-6ab02df5d14e None admin] RBAC: Authorizing `identity:get_user(user_id=b6f65ac76b644189a7a6a662d0ae9dfe)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:24.927171 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb82d5-0980-4de9-a86f-6ab02df5d14e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:24.929168 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 531/1050] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:03:24 2022] GET /identity/v3/users/b6f65ac76b644189a7a6a662d0ae9dfe => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:24.934738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8968d6-3000-4b92-b62e-c8a6648e7ced None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:25.039666 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:25.044238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8968d6-3000-4b92-b62e-c8a6648e7ced None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:25.078333 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c1a81-391b-41ea-b5c2-b102ed681ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:25.078939 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c1a81-391b-41ea-b5c2-b102ed681ecd None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:25.079237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c1a81-391b-41ea-b5c2-b102ed681ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:25.079512 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c1a81-391b-41ea-b5c2-b102ed681ecd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:25.147571 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c1a81-391b-41ea-b5c2-b102ed681ecd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:25.148916 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c1a81-391b-41ea-b5c2-b102ed681ecd None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:25.249997 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:25.260843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 520/1051] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:03:24 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 13:03:25.262286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb82d5-0980-4de9-a86f-6ab02df5d14e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:25.273456 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:25.369984 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb82d5-0980-4de9-a86f-6ab02df5d14e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:25.386200 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43553f9f-2552-49d2-8253-549909eb6f2c None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:25.386803 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43553f9f-2552-49d2-8253-549909eb6f2c None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:25.387329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43553f9f-2552-49d2-8253-549909eb6f2c None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:25.389135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 521/1052] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:25.396525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07331305-ea50-4444-b0d0-502c002a6d26 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:25.397098 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07331305-ea50-4444-b0d0-502c002a6d26 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:25.397563 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07331305-ea50-4444-b0d0-502c002a6d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:25.417515 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-07331305-ea50-4444-b0d0-502c002a6d26 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:25.418638 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-07331305-ea50-4444-b0d0-502c002a6d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:25.427224 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c6364-a923-4244-8933-cbfc709f2718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:25.428187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c6364-a923-4244-8933-cbfc709f2718 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:25.428684 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c6364-a923-4244-8933-cbfc709f2718 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:25.429151 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c6364-a923-4244-8933-cbfc709f2718 None admin] PATH_INFO: `/v3/projects/34ad5d167174474fb3b253c525d041d3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:25.430470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c6364-a923-4244-8933-cbfc709f2718 None admin] RBAC: Authorizing `identity:get_project(project_id=34ad5d167174474fb3b253c525d041d3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:25.432145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c6364-a923-4244-8933-cbfc709f2718 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:25.439151 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 532/1053] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:03:25 2022] GET /identity/v3/projects/34ad5d167174474fb3b253c525d041d3 => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:25.440772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c6364-a923-4244-8933-cbfc709f2718 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:25.496480 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 522/1054] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:25.520925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:25.521856 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07331305-ea50-4444-b0d0-502c002a6d26 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:25.548529 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c6364-a923-4244-8933-cbfc709f2718 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:25.591368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7d926-8c38-410a-a5ac-407e72fe2f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:25.591982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7d926-8c38-410a-a5ac-407e72fe2f3f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:25.592257 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7d926-8c38-410a-a5ac-407e72fe2f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:25.592522 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7d926-8c38-410a-a5ac-407e72fe2f3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:25.593504 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7d926-8c38-410a-a5ac-407e72fe2f3f None admin] RBAC: Adding query filter params (role.id=d9c9200468cb4f7ab6a23882bfb1f062, scope.project.id=34ad5d167174474fb3b253c525d041d3, user.id=b6f65ac76b644189a7a6a662d0ae9dfe) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:25.593808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7d926-8c38-410a-a5ac-407e72fe2f3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:25.596621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7d926-8c38-410a-a5ac-407e72fe2f3f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:25.605283 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 533/1055] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:03:25 2022] GET /identity/v3/role_assignments?user.id=b6f65ac76b644189a7a6a662d0ae9dfe&scope.project.id=34ad5d167174474fb3b253c525d041d3&role.id=d9c9200468cb4f7ab6a23882bfb1f062 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:25.642287 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07331305-ea50-4444-b0d0-502c002a6d26 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:25.673111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:25.682287 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5372ca4-1eb3-403f-9d7b-d212abe324f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:25.682939 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5372ca4-1eb3-403f-9d7b-d212abe324f2 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:25.683250 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5372ca4-1eb3-403f-9d7b-d212abe324f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:25.683525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5372ca4-1eb3-403f-9d7b-d212abe324f2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:25.684120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5372ca4-1eb3-403f-9d7b-d212abe324f2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:25.685490 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5372ca4-1eb3-403f-9d7b-d212abe324f2 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:25.695727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-a5372ca4-1eb3-403f-9d7b-d212abe324f2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 13:03:25.695727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:25.695727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:03:25.695727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:03:25.695727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:03:25.695727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:03:25.695727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:03:25.695727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:25.695727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 13:03:25.695727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:25.695727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:03:25.695727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:25.695727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:25.695727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:25.695727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:25.695727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:25.695727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:25.696836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:25.696836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:25.696836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:25.696836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:25.696836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:25.696836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:25.696836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:03:25.696836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:03:25.696836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:03:25.696836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:03:25.696836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:25.696836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:25.696836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:25.696836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:25.696836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:25.696836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:25.697680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:25.697680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:25.697680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:25.697680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:25.697680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:25.697680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:25.697680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:25.697680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:25.697680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:25.697680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:25.697680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:03:25.697680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:03:25.697680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 13:03:25.697680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:25.703940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 523/1056] 10.222.0.46 () {56 vars in 1105 bytes} [Wed Aug 10 13:03:25 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:25.704144 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7d926-8c38-410a-a5ac-407e72fe2f3f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:25.833578 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7d926-8c38-410a-a5ac-407e72fe2f3f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:25.866903 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301d2e8-ff38-4ffe-84de-9481ddd5b51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:25.867539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301d2e8-ff38-4ffe-84de-9481ddd5b51c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:25.867819 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301d2e8-ff38-4ffe-84de-9481ddd5b51c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:25.868090 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301d2e8-ff38-4ffe-84de-9481ddd5b51c None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:25.868715 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301d2e8-ff38-4ffe-84de-9481ddd5b51c None admin] RBAC: Adding query filter params (name=image) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:25.869010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301d2e8-ff38-4ffe-84de-9481ddd5b51c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:25.870367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301d2e8-ff38-4ffe-84de-9481ddd5b51c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:25.875466 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 534/1057] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:25.881501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5372ca4-1eb3-403f-9d7b-d212abe324f2 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:25.983132 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5372ca4-1eb3-403f-9d7b-d212abe324f2 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:26.022693 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05199d31-87b1-4157-8f4d-83e005414b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:26.023351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05199d31-87b1-4157-8f4d-83e005414b99 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:26.023628 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05199d31-87b1-4157-8f4d-83e005414b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:26.023900 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05199d31-87b1-4157-8f4d-83e005414b99 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:26.024529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05199d31-87b1-4157-8f4d-83e005414b99 None admin] RBAC: Adding query filter params (type=image) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:26.024901 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05199d31-87b1-4157-8f4d-83e005414b99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:26.026194 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05199d31-87b1-4157-8f4d-83e005414b99 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:26.036241 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 524/1058] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:26.037823 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301d2e8-ff38-4ffe-84de-9481ddd5b51c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:26.041770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:26.144396 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301d2e8-ff38-4ffe-84de-9481ddd5b51c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:26.180174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dc442-eeb1-470f-9fdd-63f2d13afaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:26.180790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dc442-eeb1-470f-9fdd-63f2d13afaf8 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:26.181069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dc442-eeb1-470f-9fdd-63f2d13afaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:26.181343 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dc442-eeb1-470f-9fdd-63f2d13afaf8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:26.182016 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dc442-eeb1-470f-9fdd-63f2d13afaf8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:26.183411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dc442-eeb1-470f-9fdd-63f2d13afaf8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:26.211091 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 535/1059] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:03:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:03:26.483707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c109ff-c1aa-4d76-bd25-9a90c09c8748 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:26.483984 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c109ff-c1aa-4d76-bd25-9a90c09c8748 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:26.484235 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c109ff-c1aa-4d76-bd25-9a90c09c8748 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:26.485726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 525/1060] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:26.490887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd0f0e-d2fe-43b6-8798-af1643506713 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:26.491196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd0f0e-d2fe-43b6-8798-af1643506713 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:26.491465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd0f0e-d2fe-43b6-8798-af1643506713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:26.509465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-aacd0f0e-d2fe-43b6-8798-af1643506713 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:26.510626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-aacd0f0e-d2fe-43b6-8798-af1643506713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:26.567530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:26.586643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 536/1061] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:26.608505 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c109ff-c1aa-4d76-bd25-9a90c09c8748 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:26.666966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:26.715656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c109ff-c1aa-4d76-bd25-9a90c09c8748 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:26.752073 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155de63-f6f1-49db-82dc-d4b85fe812d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:26.753565 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155de63-f6f1-49db-82dc-d4b85fe812d6 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:26.753996 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155de63-f6f1-49db-82dc-d4b85fe812d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:26.754449 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155de63-f6f1-49db-82dc-d4b85fe812d6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:26.765832 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155de63-f6f1-49db-82dc-d4b85fe812d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:03:26.770930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-0155de63-f6f1-49db-82dc-d4b85fe812d6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 13:03:26.770930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:26.770930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:26.770930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:26.770930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:26.770930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:26.770930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:26.770930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:26.770930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:26.770930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:26.770930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:26.770930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:26.770930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:03:26.770930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:03:26.770930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:03:26.770930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:03:26.772056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:03:26.772056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:03:26.772056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:03:26.772056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:03:26.772056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:26.772056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:26.772056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:26.772056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:26.772056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:26.772056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:26.772056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:26.772056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:26.772056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:26.772056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:26.772056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:26.772056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:26.773077 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:26.773077 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:26.773077 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:26.773077 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:26.773077 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:03:26.773077 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:03:26.773077 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:03:26.773077 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:03:26.773077 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:03:26.773077 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:03:26.773077 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 13:03:26.773077 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:26.775046 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 526/1062] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Aug 10 13:03:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:26.781221 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd0f0e-d2fe-43b6-8798-af1643506713 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:26.881784 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd0f0e-d2fe-43b6-8798-af1643506713 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:26.916887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae903743-15b4-4611-96f0-da6d6b470803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:26.917488 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae903743-15b4-4611-96f0-da6d6b470803 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:26.917761 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae903743-15b4-4611-96f0-da6d6b470803 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:26.918029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae903743-15b4-4611-96f0-da6d6b470803 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:26.918691 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae903743-15b4-4611-96f0-da6d6b470803 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:26.918989 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae903743-15b4-4611-96f0-da6d6b470803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:26.920373 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae903743-15b4-4611-96f0-da6d6b470803 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:26.933970 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 537/1063] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Aug 10 13:03:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:26.935325 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155de63-f6f1-49db-82dc-d4b85fe812d6 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:27.051082 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155de63-f6f1-49db-82dc-d4b85fe812d6 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:27.068224 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:27.087548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb02c0f-0810-4152-a280-201173a4023c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:27.088221 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb02c0f-0810-4152-a280-201173a4023c None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:27.088499 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb02c0f-0810-4152-a280-201173a4023c None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:27.088765 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb02c0f-0810-4152-a280-201173a4023c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:27.099329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb02c0f-0810-4152-a280-201173a4023c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:27.100650 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb02c0f-0810-4152-a280-201173a4023c None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:27.115053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-8eb02c0f-0810-4152-a280-201173a4023c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:27.115053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:27.115053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:27.115053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:27.115053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:27.115053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:27.115053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:27.115053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:27.115053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:27.115053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:27.115053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:27.115053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:27.115053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:03:27.115053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:03:27.115053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:03:27.115053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:03:27.116036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:27.116036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:27.116036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:27.116036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:27.116036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:27.116036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:27.116036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:27.116036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:27.116036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:27.116036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:27.116036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:27.116036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:27.116036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:27.116036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:27.116036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:27.116036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:27.116036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:03:27.122046 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:03:27.122046 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:27.122046 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:27.122046 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 527/1064] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:27.122316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae903743-15b4-4611-96f0-da6d6b470803 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:27.171443 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:27.224359 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae903743-15b4-4611-96f0-da6d6b470803 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:27.258963 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfac38d-cdb8-46f1-9739-a3aa03ac8a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:27.259597 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfac38d-cdb8-46f1-9739-a3aa03ac8a9b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:27.259874 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfac38d-cdb8-46f1-9739-a3aa03ac8a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:27.260142 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfac38d-cdb8-46f1-9739-a3aa03ac8a9b None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:27.260766 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfac38d-cdb8-46f1-9739-a3aa03ac8a9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:27.261067 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfac38d-cdb8-46f1-9739-a3aa03ac8a9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:27.262410 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfac38d-cdb8-46f1-9739-a3aa03ac8a9b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:27.278624 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 538/1065] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:27.280158 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb02c0f-0810-4152-a280-201173a4023c None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:27.390755 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb02c0f-0810-4152-a280-201173a4023c None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:27.423944 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890df2a-bfdc-48cb-b052-20d41f7d227f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:27.425193 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890df2a-bfdc-48cb-b052-20d41f7d227f None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:27.425466 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890df2a-bfdc-48cb-b052-20d41f7d227f None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:27.425733 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890df2a-bfdc-48cb-b052-20d41f7d227f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:27.433360 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890df2a-bfdc-48cb-b052-20d41f7d227f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:27.434816 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890df2a-bfdc-48cb-b052-20d41f7d227f None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:27.446521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-5890df2a-bfdc-48cb-b052-20d41f7d227f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 13:03:27.446521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:27.446521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:27.446521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:27.446521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:27.446521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:27.446521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:27.446521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:27.446521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:27.446521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:27.446521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:27.446521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:27.446521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:03:27.446521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:03:27.446521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:03:27.446521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:03:27.447525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:27.447525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:27.447525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:03:27.447525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:03:27.447525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:03:27.447525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:03:27.447525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:27.447525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:27.447525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:27.447525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:27.447525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:27.447525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:27.447525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:27.447525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:27.447525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:27.447525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:27.447525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:27.447525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:27.448511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:27.448511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:27.448511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:03:27.448511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:03:27.448511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:03:27.448511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:03:27.448511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:03:27.448511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:03:27.448511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 13:03:27.448511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:27.448511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 528/1066] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Aug 10 13:03:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:27.455285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfac38d-cdb8-46f1-9739-a3aa03ac8a9b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:27.557852 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfac38d-cdb8-46f1-9739-a3aa03ac8a9b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:27.567903 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:27.594318 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f333152-a1ca-4662-ace5-180f052ce039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:27.594919 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f333152-a1ca-4662-ace5-180f052ce039 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:27.595222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f333152-a1ca-4662-ace5-180f052ce039 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:27.595491 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f333152-a1ca-4662-ace5-180f052ce039 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:27.596725 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f333152-a1ca-4662-ace5-180f052ce039 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:27.597034 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f333152-a1ca-4662-ace5-180f052ce039 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:27.598443 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f333152-a1ca-4662-ace5-180f052ce039 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:27.617508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 539/1067] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Aug 10 13:03:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:27.622943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890df2a-bfdc-48cb-b052-20d41f7d227f None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:27.656869 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:27.681315 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8d5e1-e325-432a-aee1-a2bac190fa20 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:27.681602 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8d5e1-e325-432a-aee1-a2bac190fa20 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:27.681874 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8d5e1-e325-432a-aee1-a2bac190fa20 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:27.683247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 540/1068] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:27.688468 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e954ab-46ca-4f1a-8445-c4bd49caa004 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:27.688813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e954ab-46ca-4f1a-8445-c4bd49caa004 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:27.689244 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e954ab-46ca-4f1a-8445-c4bd49caa004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:27.709877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-55e954ab-46ca-4f1a-8445-c4bd49caa004 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:27.711092 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-55e954ab-46ca-4f1a-8445-c4bd49caa004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:27.753941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890df2a-bfdc-48cb-b052-20d41f7d227f None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:27.783049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 541/1069] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 13:03:27.794694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a13ea-09d6-49cd-96c7-98c8993d1574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:27.795652 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a13ea-09d6-49cd-96c7-98c8993d1574 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:27.796128 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a13ea-09d6-49cd-96c7-98c8993d1574 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:27.796611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a13ea-09d6-49cd-96c7-98c8993d1574 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:27.805683 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e954ab-46ca-4f1a-8445-c4bd49caa004 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:27.809299 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a13ea-09d6-49cd-96c7-98c8993d1574 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:27.810975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a13ea-09d6-49cd-96c7-98c8993d1574 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:27.825596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-442a13ea-09d6-49cd-96c7-98c8993d1574 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:27.825596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:27.825596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:27.825596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:27.825596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:27.825596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:27.825596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:27.825596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:27.825596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:27.825596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:27.825596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:27.825596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:27.825596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:03:27.825596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:03:27.825596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:03:27.825596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:03:27.826602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:27.826602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:27.826602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:27.826602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:27.826602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:27.826602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:27.826602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:27.826602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:27.826602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:27.826602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:27.826602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:27.826602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:27.826602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:27.826602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:27.826602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:27.826602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:27.826602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:03:27.827573 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:03:27.827573 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:27.827573 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:27.828980 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 529/1070] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:27.834525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a13ea-09d6-49cd-96c7-98c8993d1574 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:27.905426 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:27.914141 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e954ab-46ca-4f1a-8445-c4bd49caa004 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:27.929361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:27.951715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a13ea-09d6-49cd-96c7-98c8993d1574 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:27.953050 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260f980-80e8-4446-9685-906d29766ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:27.953707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260f980-80e8-4446-9685-906d29766ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:27.953988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260f980-80e8-4446-9685-906d29766ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:27.954261 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260f980-80e8-4446-9685-906d29766ac1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:27.965805 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260f980-80e8-4446-9685-906d29766ac1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:03:27.970843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-7260f980-80e8-4446-9685-906d29766ac1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:03:27.970843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:27.970843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:27.970843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:27.970843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:27.970843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:27.970843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:27.970843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:27.970843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:27.970843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:27.970843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:27.970843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:27.970843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:03:27.970843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:03:27.970843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:03:27.970843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:03:27.972577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:03:27.972577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:03:27.972577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:03:27.972577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:03:27.972577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:27.972577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:27.972577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:27.972577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:27.972577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:27.972577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:27.972577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:27.972577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:27.972577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:27.972577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:27.972577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:27.972577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:27.973640 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:27.973640 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:27.973640 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:27.973640 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:27.973640 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:03:27.973640 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:03:27.973640 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:03:27.973640 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:03:27.973640 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:03:27.973640 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:03:27.973640 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:03:27.973640 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:27.977551 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 542/1071] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:03:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:27.978790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260f980-80e8-4446-9685-906d29766ac1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:28.003447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9806a1-f66e-441e-bad6-fc0cceaeb81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:28.004059 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9806a1-f66e-441e-bad6-fc0cceaeb81b None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:28.004358 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9806a1-f66e-441e-bad6-fc0cceaeb81b None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:28.004602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9806a1-f66e-441e-bad6-fc0cceaeb81b None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:28.005244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9806a1-f66e-441e-bad6-fc0cceaeb81b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:28.005537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9806a1-f66e-441e-bad6-fc0cceaeb81b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:28.006888 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9806a1-f66e-441e-bad6-fc0cceaeb81b None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:28.022252 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 530/1072] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:28.027933 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9806a1-f66e-441e-bad6-fc0cceaeb81b None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:28.091892 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260f980-80e8-4446-9685-906d29766ac1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:28.127373 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9806a1-f66e-441e-bad6-fc0cceaeb81b None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:28.129544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c6ebe-0b2b-4212-819c-ac8cecaaf407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:28.130174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c6ebe-0b2b-4212-819c-ac8cecaaf407 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:28.130446 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c6ebe-0b2b-4212-819c-ac8cecaaf407 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:28.130716 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c6ebe-0b2b-4212-819c-ac8cecaaf407 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:28.131411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c6ebe-0b2b-4212-819c-ac8cecaaf407 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:28.131714 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c6ebe-0b2b-4212-819c-ac8cecaaf407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:28.133079 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c6ebe-0b2b-4212-819c-ac8cecaaf407 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:28.142081 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 543/1073] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:03:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:28.148352 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c6ebe-0b2b-4212-819c-ac8cecaaf407 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:28.163989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aca302-7322-49a3-8683-55ed5e911df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:28.164672 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aca302-7322-49a3-8683-55ed5e911df6 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:28.164887 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aca302-7322-49a3-8683-55ed5e911df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:28.165149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aca302-7322-49a3-8683-55ed5e911df6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:28.168916 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:28.172213 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aca302-7322-49a3-8683-55ed5e911df6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:28.173646 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aca302-7322-49a3-8683-55ed5e911df6 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:28.176335 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:28.188361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-b1aca302-7322-49a3-8683-55ed5e911df6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:03:28.188361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:28.188361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:28.188361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:28.188361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:28.188361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:28.188361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:28.188361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:28.188361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:28.188361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:28.188361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:28.188361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:28.188361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:03:28.188361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:03:28.188361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:03:28.189361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:03:28.189361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:28.189361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:28.189361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:28.189361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:28.189361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:28.189361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:28.189361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:28.189361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:28.189361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:28.189361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:28.189361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:28.189361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:28.189361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:28.189361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:28.189361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:28.189361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:28.190326 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:03:28.190326 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:03:28.190326 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:03:28.190326 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:03:28.190326 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:03:28.190326 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:03:28.190326 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:03:28.190326 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:28.192694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 531/1074] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:03:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:28.198019 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aca302-7322-49a3-8683-55ed5e911df6 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:28.260652 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c6ebe-0b2b-4212-819c-ac8cecaaf407 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:28.293533 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c06f5d-3e0c-4a5c-9100-3eb2232ff760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:28.294145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c06f5d-3e0c-4a5c-9100-3eb2232ff760 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:28.294419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c06f5d-3e0c-4a5c-9100-3eb2232ff760 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:28.294687 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c06f5d-3e0c-4a5c-9100-3eb2232ff760 None admin] PATH_INFO: `/v3/users/b6f65ac76b644189a7a6a662d0ae9dfe` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:28.295830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c06f5d-3e0c-4a5c-9100-3eb2232ff760 None admin] RBAC: Authorizing `identity:get_user(user_id=b6f65ac76b644189a7a6a662d0ae9dfe)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:28.297244 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c06f5d-3e0c-4a5c-9100-3eb2232ff760 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:28.298878 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 544/1075] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:03:28 2022] GET /identity/v3/users/b6f65ac76b644189a7a6a662d0ae9dfe => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:28.300658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59edf3-8561-47ce-a667-d042e5c5efe1 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:28.300936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59edf3-8561-47ce-a667-d042e5c5efe1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:28.301167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aca302-7322-49a3-8683-55ed5e911df6 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:28.301265 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59edf3-8561-47ce-a667-d042e5c5efe1 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:28.302554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 545/1076] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:28.304998 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59edf3-8561-47ce-a667-d042e5c5efe1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:28.336126 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e25560-e7b5-4554-a88d-24fc2ef6648a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:28.336733 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e25560-e7b5-4554-a88d-24fc2ef6648a None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:28.337007 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e25560-e7b5-4554-a88d-24fc2ef6648a None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:28.337277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e25560-e7b5-4554-a88d-24fc2ef6648a None admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:28.337959 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e25560-e7b5-4554-a88d-24fc2ef6648a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:28.338261 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e25560-e7b5-4554-a88d-24fc2ef6648a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:28.339694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e25560-e7b5-4554-a88d-24fc2ef6648a None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:28.352258 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 532/1077] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:03:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:28.353618 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0329e9b-5728-4f2c-8ea1-ceae7f10bb16 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:28.353833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0329e9b-5728-4f2c-8ea1-ceae7f10bb16 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:28.354100 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0329e9b-5728-4f2c-8ea1-ceae7f10bb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:28.371604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-b0329e9b-5728-4f2c-8ea1-ceae7f10bb16 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:28.372790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-b0329e9b-5728-4f2c-8ea1-ceae7f10bb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:28.390230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:28.405757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59edf3-8561-47ce-a667-d042e5c5efe1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:28.428170 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:28.439340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f93af1-d422-42ff-8264-f0363de94bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:28.439525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 533/1078] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:28.440517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f93af1-d422-42ff-8264-f0363de94bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:28.440736 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0329e9b-5728-4f2c-8ea1-ceae7f10bb16 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:28.440838 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f93af1-d422-42ff-8264-f0363de94bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:28.441123 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f93af1-d422-42ff-8264-f0363de94bb7 None admin] PATH_INFO: `/v3/projects/34ad5d167174474fb3b253c525d041d3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:28.442247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f93af1-d422-42ff-8264-f0363de94bb7 None admin] RBAC: Authorizing `identity:get_project(project_id=34ad5d167174474fb3b253c525d041d3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:28.443699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f93af1-d422-42ff-8264-f0363de94bb7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:28.450074 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 546/1079] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:03:28 2022] GET /identity/v3/projects/34ad5d167174474fb3b253c525d041d3 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:28.452076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f93af1-d422-42ff-8264-f0363de94bb7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:28.539430 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0329e9b-5728-4f2c-8ea1-ceae7f10bb16 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:28.550269 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f93af1-d422-42ff-8264-f0363de94bb7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:28.573792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e6fcc-dd67-4a87-ab53-c5a6d1eeda4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:28.574439 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e6fcc-dd67-4a87-ab53-c5a6d1eeda4a None admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:28.574712 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e6fcc-dd67-4a87-ab53-c5a6d1eeda4a None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:28.574979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e6fcc-dd67-4a87-ab53-c5a6d1eeda4a None admin] PATH_INFO: `/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/7fd0f76f24ea481191dfd65fff2376af/roles/4bbe1d7eee2c44329a4173574fab0f68` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:28.577149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e6fcc-dd67-4a87-ab53-c5a6d1eeda4a None admin] RBAC: Authorizing `identity:create_grant(project_id=8aa2ccddadb54dd9b88ccc6cec98ae37, user_id=7fd0f76f24ea481191dfd65fff2376af, role_id=4bbe1d7eee2c44329a4173574fab0f68)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:28.578549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e6fcc-dd67-4a87-ab53-c5a6d1eeda4a None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:28.584340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa24a4-68b4-4570-9e03-a13b27e4788d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:28.585080 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa24a4-68b4-4570-9e03-a13b27e4788d None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:28.585385 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa24a4-68b4-4570-9e03-a13b27e4788d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:28.585660 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa24a4-68b4-4570-9e03-a13b27e4788d None admin] PATH_INFO: `/v3/projects/34ad5d167174474fb3b253c525d041d3/users/b6f65ac76b644189a7a6a662d0ae9dfe/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:28.587660 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa24a4-68b4-4570-9e03-a13b27e4788d None admin] RBAC: Authorizing `identity:create_grant(project_id=34ad5d167174474fb3b253c525d041d3, user_id=b6f65ac76b644189a7a6a662d0ae9dfe, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:28.589073 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa24a4-68b4-4570-9e03-a13b27e4788d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:28.592283 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 534/1080] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:03:28 2022] PUT /identity/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/7fd0f76f24ea481191dfd65fff2376af/roles/4bbe1d7eee2c44329a4173574fab0f68 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:03:28.593432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e6fcc-dd67-4a87-ab53-c5a6d1eeda4a None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:28.620960 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 547/1081] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:03:28 2022] PUT /identity/v3/projects/34ad5d167174474fb3b253c525d041d3/users/b6f65ac76b644189a7a6a662d0ae9dfe/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:03:28.656837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:28.720504 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e6fcc-dd67-4a87-ab53-c5a6d1eeda4a None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:28.760858 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548f616-226e-4dcf-a2d7-1fd590306816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:28.761476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548f616-226e-4dcf-a2d7-1fd590306816 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:28.761750 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548f616-226e-4dcf-a2d7-1fd590306816 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:28.762016 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548f616-226e-4dcf-a2d7-1fd590306816 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:28.836627 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548f616-226e-4dcf-a2d7-1fd590306816 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:28.838068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548f616-226e-4dcf-a2d7-1fd590306816 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:28.887306 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:28.938803 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 535/1082] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:03:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 13:03:28.945528 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa24a4-68b4-4570-9e03-a13b27e4788d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:28.964097 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:29.062471 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa24a4-68b4-4570-9e03-a13b27e4788d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:29.099241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322cf93-2eae-4bb8-9a75-da5fb4615035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:29.099982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322cf93-2eae-4bb8-9a75-da5fb4615035 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:29.100257 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322cf93-2eae-4bb8-9a75-da5fb4615035 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:29.100521 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322cf93-2eae-4bb8-9a75-da5fb4615035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:29.113666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322cf93-2eae-4bb8-9a75-da5fb4615035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:29.113898 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322cf93-2eae-4bb8-9a75-da5fb4615035 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:29.129368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-8322cf93-2eae-4bb8-9a75-da5fb4615035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:29.129368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:29.129368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:29.129368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:29.129368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:29.129368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:29.129368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:29.129368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:29.129368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:29.129368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:29.129368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:29.129368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:29.129368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:03:29.129368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:03:29.129368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:03:29.129368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:03:29.130381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:29.130381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:29.130381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:29.130381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:29.130381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:29.130381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:29.130381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:29.130381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:29.130381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:29.130381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:29.130381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:29.130381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:29.130381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:29.130381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:29.130381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:29.130381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:29.130381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:03:29.131429 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:03:29.131429 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:29.131429 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:29.131429 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 548/1083] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:29.136617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548f616-226e-4dcf-a2d7-1fd590306816 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:29.240027 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548f616-226e-4dcf-a2d7-1fd590306816 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:29.273452 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1db88c-f6ab-4cab-8221-91e62228cbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:29.274165 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1db88c-f6ab-4cab-8221-91e62228cbee None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:29.274346 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1db88c-f6ab-4cab-8221-91e62228cbee None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:29.274651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1db88c-f6ab-4cab-8221-91e62228cbee None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:29.275224 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1db88c-f6ab-4cab-8221-91e62228cbee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:29.275520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1db88c-f6ab-4cab-8221-91e62228cbee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:29.276863 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1db88c-f6ab-4cab-8221-91e62228cbee None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:29.288928 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 536/1084] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:30.650427 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090a9e2-644f-43a7-a547-dfd2b3e8c38e None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:30.652343 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090a9e2-644f-43a7-a547-dfd2b3e8c38e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:30.652343 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090a9e2-644f-43a7-a547-dfd2b3e8c38e None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:30.652521 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 549/1085] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:30.658107 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a213e42-851c-4db6-bfd9-bce081e3fa17 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:30.659117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a213e42-851c-4db6-bfd9-bce081e3fa17 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:30.659331 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a213e42-851c-4db6-bfd9-bce081e3fa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:30.672865 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04725713-0b96-4734-97d8-999c670835c6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:30.673145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04725713-0b96-4734-97d8-999c670835c6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:30.673456 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04725713-0b96-4734-97d8-999c670835c6 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:30.675431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 550/1086] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:03:30.678010 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-2a213e42-851c-4db6-bfd9-bce081e3fa17 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:30.679254 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-2a213e42-851c-4db6-bfd9-bce081e3fa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:30.680879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591386ba-4dd4-464f-887d-296a9be36407 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:30.681162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591386ba-4dd4-464f-887d-296a9be36407 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:30.681448 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591386ba-4dd4-464f-887d-296a9be36407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:30.682209 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:30.699541 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-591386ba-4dd4-464f-887d-296a9be36407 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:30.700739 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-591386ba-4dd4-464f-887d-296a9be36407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:30.746330 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 537/1087] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 13:03:30.760614 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:30.768526 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 551/1088] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 13:03:30.769742 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a213e42-851c-4db6-bfd9-bce081e3fa17 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:30.791563 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591386ba-4dd4-464f-887d-296a9be36407 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:30.866466 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a213e42-851c-4db6-bfd9-bce081e3fa17 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:30.888128 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591386ba-4dd4-464f-887d-296a9be36407 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:30.900292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404381c5-2117-41c8-9cdf-ad76ee92a65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:30.900965 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404381c5-2117-41c8-9cdf-ad76ee92a65f None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:30.901190 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404381c5-2117-41c8-9cdf-ad76ee92a65f None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:30.901453 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404381c5-2117-41c8-9cdf-ad76ee92a65f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:30.909859 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:30.913030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404381c5-2117-41c8-9cdf-ad76ee92a65f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:03:30.918125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-404381c5-2117-41c8-9cdf-ad76ee92a65f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 13:03:30.918125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:30.918125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:30.918125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:30.918125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:30.918125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:30.918125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:30.918125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:30.918125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:30.918125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:30.918125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:30.918125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:30.918125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:03:30.918125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:03:30.918125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:03:30.918125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:03:30.919244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:03:30.919244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:03:30.919244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:03:30.919244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:03:30.919244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:30.919244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:30.919244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:30.919244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:30.919244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:30.919244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:30.919244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:30.919244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:30.919244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:30.919244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:30.919244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:30.919244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:30.920174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:30.920174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:30.920174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:30.920174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:30.920174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:03:30.920174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:03:30.920174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:03:30.920174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:03:30.920174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:03:30.920174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:03:30.920174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 13:03:30.920174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:30.922657 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f964c37-fb2e-4aa8-9f4d-ba1d1f09bdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:30.923318 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f964c37-fb2e-4aa8-9f4d-ba1d1f09bdb1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:30.923599 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f964c37-fb2e-4aa8-9f4d-ba1d1f09bdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:30.923874 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f964c37-fb2e-4aa8-9f4d-ba1d1f09bdb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:30.925242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 538/1089] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Aug 10 13:03:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:30.925919 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404381c5-2117-41c8-9cdf-ad76ee92a65f None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:30.934665 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f964c37-fb2e-4aa8-9f4d-ba1d1f09bdb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:03:30.939378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-9f964c37-fb2e-4aa8-9f4d-ba1d1f09bdb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:03:30.939378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:30.939378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:30.939378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:30.939378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:30.939378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:30.939378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:30.939378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:30.939378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:30.939378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:30.939378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:30.939378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:30.939378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:03:30.939378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:03:30.939378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:03:30.939378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:03:30.940377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:03:30.940377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:03:30.940377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:03:30.940377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:03:30.940377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:30.940377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:30.940377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:30.940377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:30.940377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:30.940377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:30.940377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:30.940377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:30.940377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:30.940377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:30.940377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:30.940377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:30.941260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:30.941260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:30.941260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:30.941260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:30.941260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:03:30.941260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:03:30.941260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:03:30.941260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:03:30.941260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:03:30.941260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:03:30.941260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:03:30.941260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:30.941260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 552/1090] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:03:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:30.946363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f964c37-fb2e-4aa8-9f4d-ba1d1f09bdb1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:31.007137 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:31.035363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404381c5-2117-41c8-9cdf-ad76ee92a65f None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:31.051736 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f964c37-fb2e-4aa8-9f4d-ba1d1f09bdb1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:31.069191 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c005554-54fc-4517-acc7-ba441068daba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:31.069791 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c005554-54fc-4517-acc7-ba441068daba None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:31.070069 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c005554-54fc-4517-acc7-ba441068daba None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:31.070340 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c005554-54fc-4517-acc7-ba441068daba None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:31.071091 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c005554-54fc-4517-acc7-ba441068daba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:31.071391 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c005554-54fc-4517-acc7-ba441068daba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:31.072744 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c005554-54fc-4517-acc7-ba441068daba None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:31.081334 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 539/1091] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Aug 10 13:03:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:31.085917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb60af9-4d22-4127-83e7-523e65ba77a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:31.086514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb60af9-4d22-4127-83e7-523e65ba77a2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:31.086743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c005554-54fc-4517-acc7-ba441068daba None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:31.086850 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb60af9-4d22-4127-83e7-523e65ba77a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:31.087065 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb60af9-4d22-4127-83e7-523e65ba77a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:31.087722 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb60af9-4d22-4127-83e7-523e65ba77a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:31.088015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb60af9-4d22-4127-83e7-523e65ba77a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:31.089395 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb60af9-4d22-4127-83e7-523e65ba77a2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:31.103092 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 553/1092] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:03:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:31.104079 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb60af9-4d22-4127-83e7-523e65ba77a2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:31.147545 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:31.194455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c005554-54fc-4517-acc7-ba441068daba None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:31.203751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb60af9-4d22-4127-83e7-523e65ba77a2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:31.221662 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:31.230973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429a411-2451-41fe-8550-4cb8050f1b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:31.231691 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429a411-2451-41fe-8550-4cb8050f1b7f None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:31.231970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429a411-2451-41fe-8550-4cb8050f1b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:31.232270 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429a411-2451-41fe-8550-4cb8050f1b7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:31.238971 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb05c9-834b-4cbc-bd84-c8716a0e10f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:31.240038 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb05c9-834b-4cbc-bd84-c8716a0e10f8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:31.240317 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb05c9-834b-4cbc-bd84-c8716a0e10f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:31.240589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb05c9-834b-4cbc-bd84-c8716a0e10f8 None admin] PATH_INFO: `/v3/users/b6f65ac76b644189a7a6a662d0ae9dfe` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:31.241723 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb05c9-834b-4cbc-bd84-c8716a0e10f8 None admin] RBAC: Authorizing `identity:get_user(user_id=b6f65ac76b644189a7a6a662d0ae9dfe)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:31.242854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429a411-2451-41fe-8550-4cb8050f1b7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:31.243178 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb05c9-834b-4cbc-bd84-c8716a0e10f8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:31.244302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429a411-2451-41fe-8550-4cb8050f1b7f None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:31.244747 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 554/1093] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:03:31 2022] GET /identity/v3/users/b6f65ac76b644189a7a6a662d0ae9dfe => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:31.250670 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb05c9-834b-4cbc-bd84-c8716a0e10f8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:31.258399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-e429a411-2451-41fe-8550-4cb8050f1b7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:31.258399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:31.258399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:31.258399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:31.258399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:31.258399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:31.258399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:31.258399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:31.258399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:31.258399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:31.258399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:31.258399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:31.258399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:03:31.258399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:03:31.258399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:03:31.258399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:03:31.259530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:31.259530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:31.259530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:31.259530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:31.259530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:31.259530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:31.259530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:31.259530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:31.259530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:31.259530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:31.259530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:31.259530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:31.259530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:31.259530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:31.259530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:31.259530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:31.259530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:03:31.260444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:03:31.260444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:31.260444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:31.260444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 540/1094] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:31.265127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429a411-2451-41fe-8550-4cb8050f1b7f None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:31.352954 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb05c9-834b-4cbc-bd84-c8716a0e10f8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:31.366002 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429a411-2451-41fe-8550-4cb8050f1b7f None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:31.380079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:31.387210 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0f8dc-862d-4c94-9034-9dc7ec754e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:31.387814 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0f8dc-862d-4c94-9034-9dc7ec754e8a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:31.388094 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0f8dc-862d-4c94-9034-9dc7ec754e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:31.388363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0f8dc-862d-4c94-9034-9dc7ec754e8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:31.401481 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4b535-f024-4d85-b654-44ee26e6dad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:31.402078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4b535-f024-4d85-b654-44ee26e6dad0 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:31.402349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4b535-f024-4d85-b654-44ee26e6dad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:31.402611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4b535-f024-4d85-b654-44ee26e6dad0 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:31.403265 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4b535-f024-4d85-b654-44ee26e6dad0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:31.403561 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4b535-f024-4d85-b654-44ee26e6dad0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:31.404931 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4b535-f024-4d85-b654-44ee26e6dad0 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:31.416351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 541/1095] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:31.421921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4b535-f024-4d85-b654-44ee26e6dad0 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:31.444029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:31.459553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0f8dc-862d-4c94-9034-9dc7ec754e8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:31.460917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0f8dc-862d-4c94-9034-9dc7ec754e8a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:31.520513 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4b535-f024-4d85-b654-44ee26e6dad0 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:31.553255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb63695-911a-4b6f-8816-dc23f85d2d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:31.553896 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb63695-911a-4b6f-8816-dc23f85d2d79 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:31.554161 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb63695-911a-4b6f-8816-dc23f85d2d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:31.554427 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb63695-911a-4b6f-8816-dc23f85d2d79 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:31.559051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 555/1096] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:03:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 13:03:31.561692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb63695-911a-4b6f-8816-dc23f85d2d79 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:31.563132 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb63695-911a-4b6f-8816-dc23f85d2d79 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:31.565489 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0f8dc-862d-4c94-9034-9dc7ec754e8a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:31.575421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-edb63695-911a-4b6f-8816-dc23f85d2d79 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 13:03:31.575421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:31.575421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:31.575421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:31.575421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:31.575421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:31.575421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:31.575421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:31.575421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:31.575421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:31.575421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:31.575421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:31.575421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:03:31.575421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:03:31.575421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:03:31.575421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:03:31.576999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:31.576999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:31.576999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:03:31.576999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:03:31.576999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:03:31.576999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:03:31.576999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:31.576999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:31.576999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:31.576999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:31.576999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:31.576999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:31.576999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:31.576999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:31.576999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:31.576999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:31.576999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:31.576999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:31.578893 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:31.578893 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:31.578893 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:03:31.578893 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:03:31.578893 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:03:31.578893 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:03:31.578893 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:03:31.578893 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:03:31.578893 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 13:03:31.578893 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:31.578893 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 542/1097] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Aug 10 13:03:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:03:31.586297 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb63695-911a-4b6f-8816-dc23f85d2d79 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:31.621234 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:31.661210 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:31.677216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0f8dc-862d-4c94-9034-9dc7ec754e8a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:31.692217 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb63695-911a-4b6f-8816-dc23f85d2d79 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:31.714170 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c35b2e-3dd5-42d5-96d7-1c9a675855f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:31.714722 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c35b2e-3dd5-42d5-96d7-1c9a675855f7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:31.715024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c35b2e-3dd5-42d5-96d7-1c9a675855f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:31.715309 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c35b2e-3dd5-42d5-96d7-1c9a675855f7 None admin] PATH_INFO: `/v3/projects/34ad5d167174474fb3b253c525d041d3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:31.716410 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c35b2e-3dd5-42d5-96d7-1c9a675855f7 None admin] RBAC: Authorizing `identity:get_project(project_id=34ad5d167174474fb3b253c525d041d3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:31.717911 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c35b2e-3dd5-42d5-96d7-1c9a675855f7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:31.719818 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 556/1098] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:03:31 2022] GET /identity/v3/projects/34ad5d167174474fb3b253c525d041d3 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:31.725999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c35b2e-3dd5-42d5-96d7-1c9a675855f7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:31.731222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab009dd2-ac5e-4cf1-9fb7-777b33529e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:31.731823 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab009dd2-ac5e-4cf1-9fb7-777b33529e17 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:31.732101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab009dd2-ac5e-4cf1-9fb7-777b33529e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:31.732373 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab009dd2-ac5e-4cf1-9fb7-777b33529e17 None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:31.733096 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab009dd2-ac5e-4cf1-9fb7-777b33529e17 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:31.733400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab009dd2-ac5e-4cf1-9fb7-777b33529e17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:31.734804 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab009dd2-ac5e-4cf1-9fb7-777b33529e17 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:31.752695 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 543/1099] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Aug 10 13:03:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:31.758292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab009dd2-ac5e-4cf1-9fb7-777b33529e17 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:31.824633 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c35b2e-3dd5-42d5-96d7-1c9a675855f7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:31.847319 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:31.856125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab009dd2-ac5e-4cf1-9fb7-777b33529e17 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:31.859063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142a463-4bb3-4e0c-b070-9a575c34897e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:31.859661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142a463-4bb3-4e0c-b070-9a575c34897e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:31.859936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142a463-4bb3-4e0c-b070-9a575c34897e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:31.860203 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142a463-4bb3-4e0c-b070-9a575c34897e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:31.860912 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142a463-4bb3-4e0c-b070-9a575c34897e None admin] RBAC: Adding query filter params (role.id=d9c9200468cb4f7ab6a23882bfb1f062, scope.project.id=34ad5d167174474fb3b253c525d041d3, user.id=b6f65ac76b644189a7a6a662d0ae9dfe) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:31.861217 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142a463-4bb3-4e0c-b070-9a575c34897e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:31.862696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142a463-4bb3-4e0c-b070-9a575c34897e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:31.868416 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 557/1100] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:03:31 2022] GET /identity/v3/role_assignments?user.id=b6f65ac76b644189a7a6a662d0ae9dfe&scope.project.id=34ad5d167174474fb3b253c525d041d3&role.id=d9c9200468cb4f7ab6a23882bfb1f062 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:31.890572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6dad1-84c4-4c30-8d16-c308f5e5e5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:31.891223 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6dad1-84c4-4c30-8d16-c308f5e5e5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:31.891502 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6dad1-84c4-4c30-8d16-c308f5e5e5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:31.891773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6dad1-84c4-4c30-8d16-c308f5e5e5f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:31.964910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6dad1-84c4-4c30-8d16-c308f5e5e5f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:31.966323 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6dad1-84c4-4c30-8d16-c308f5e5e5f5 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:32.061085 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:32.071793 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 544/1101] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:03:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 13:03:32.077576 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142a463-4bb3-4e0c-b070-9a575c34897e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:32.098056 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:32.179748 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142a463-4bb3-4e0c-b070-9a575c34897e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:32.214425 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbcd18-5d9e-4718-ae55-a07bfd81e54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:32.215127 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbcd18-5d9e-4718-ae55-a07bfd81e54c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:32.215355 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbcd18-5d9e-4718-ae55-a07bfd81e54c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:32.215623 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbcd18-5d9e-4718-ae55-a07bfd81e54c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:32.227413 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbcd18-5d9e-4718-ae55-a07bfd81e54c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:32.228954 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbcd18-5d9e-4718-ae55-a07bfd81e54c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:32.243329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-31cbcd18-5d9e-4718-ae55-a07bfd81e54c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:32.243329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:32.243329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:32.243329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:32.243329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:32.243329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:32.243329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:32.243329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:32.243329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:32.243329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:32.243329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:32.243329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:32.243329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:03:32.243329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:03:32.243329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:03:32.243329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:03:32.244502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:32.244502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:32.244502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:32.244502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:32.244502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:32.244502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:32.244502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:32.244502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:32.244502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:32.244502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:32.244502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:32.244502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:32.244502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:32.244502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:32.244502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:32.244502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:32.244502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:03:32.245579 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:03:32.245579 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:03:32.245579 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:32.245579 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 558/1102] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:32.250294 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6dad1-84c4-4c30-8d16-c308f5e5e5f5 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:32.345280 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6dad1-84c4-4c30-8d16-c308f5e5e5f5 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:32.379730 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d31927-75f8-48e2-9eed-cc4bafce42d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:32.380324 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d31927-75f8-48e2-9eed-cc4bafce42d5 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:32.380594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d31927-75f8-48e2-9eed-cc4bafce42d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:32.380860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d31927-75f8-48e2-9eed-cc4bafce42d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:32.381489 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d31927-75f8-48e2-9eed-cc4bafce42d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:32.381780 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d31927-75f8-48e2-9eed-cc4bafce42d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:32.383174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d31927-75f8-48e2-9eed-cc4bafce42d5 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:32.395531 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 545/1103] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:32.402267 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbcd18-5d9e-4718-ae55-a07bfd81e54c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:32.471931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:32.501948 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbcd18-5d9e-4718-ae55-a07bfd81e54c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:32.535207 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85df534-52fc-4420-ba82-612bbd1f50bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:32.535826 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85df534-52fc-4420-ba82-612bbd1f50bb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:32.536108 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85df534-52fc-4420-ba82-612bbd1f50bb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:32.536379 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85df534-52fc-4420-ba82-612bbd1f50bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:32.542992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85df534-52fc-4420-ba82-612bbd1f50bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:32.544598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85df534-52fc-4420-ba82-612bbd1f50bb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:32.556116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-d85df534-52fc-4420-ba82-612bbd1f50bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:03:32.556116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:32.556116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:32.556116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:32.556116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:32.556116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:32.556116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:32.556116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:32.556116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:32.556116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:32.556116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:32.556116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:32.556116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:03:32.556116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:03:32.556116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:03:32.561974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:03:32.561974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:32.561974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:32.561974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:32.561974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:32.561974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:32.561974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:32.561974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:32.561974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:32.561974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:32.561974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:32.561974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:32.561974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:32.561974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:32.561974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:32.561974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:32.561974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:32.562954 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:03:32.562954 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:03:32.562954 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:03:32.562954 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:03:32.562954 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:03:32.562954 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:03:32.562954 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:03:32.562954 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:32.562954 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 559/1104] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:03:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:32.563610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d31927-75f8-48e2-9eed-cc4bafce42d5 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:32.618295 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:32.669797 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d31927-75f8-48e2-9eed-cc4bafce42d5 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:32.702855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1a603-1098-419f-b50d-a61b0c4c98eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:32.703479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1a603-1098-419f-b50d-a61b0c4c98eb None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:32.703736 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1a603-1098-419f-b50d-a61b0c4c98eb None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:32.704004 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1a603-1098-419f-b50d-a61b0c4c98eb None admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:32.704708 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1a603-1098-419f-b50d-a61b0c4c98eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:32.705009 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1a603-1098-419f-b50d-a61b0c4c98eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:32.706433 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1a603-1098-419f-b50d-a61b0c4c98eb None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:32.717887 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 546/1105] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:03:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:32.724353 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85df534-52fc-4420-ba82-612bbd1f50bb None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:32.823099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85df534-52fc-4420-ba82-612bbd1f50bb None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:32.852445 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:32.858800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3b66d-1a62-4924-9da8-b7689e8feeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:32.859428 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3b66d-1a62-4924-9da8-b7689e8feeae None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:32.859710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3b66d-1a62-4924-9da8-b7689e8feeae None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:32.859982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3b66d-1a62-4924-9da8-b7689e8feeae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:32.860694 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3b66d-1a62-4924-9da8-b7689e8feeae None admin] RBAC: Adding query filter params (role.id=4bbe1d7eee2c44329a4173574fab0f68, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=7fd0f76f24ea481191dfd65fff2376af) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:32.861000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3b66d-1a62-4924-9da8-b7689e8feeae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:32.863031 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3b66d-1a62-4924-9da8-b7689e8feeae None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:32.869256 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 560/1106] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:03:32 2022] GET /identity/v3/role_assignments?user.id=7fd0f76f24ea481191dfd65fff2376af&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=4bbe1d7eee2c44329a4173574fab0f68 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:33.899385 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e6488-1b54-4786-b9c4-2f88fb0c1857 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:33.899918 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e6488-1b54-4786-b9c4-2f88fb0c1857 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:33.899918 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e6488-1b54-4786-b9c4-2f88fb0c1857 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:33.901277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 547/1107] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:33.906688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80823d2a-aa7a-4d00-9ee1-c63b75c817c4 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:33.907148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80823d2a-aa7a-4d00-9ee1-c63b75c817c4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:33.907251 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80823d2a-aa7a-4d00-9ee1-c63b75c817c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:33.925750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-80823d2a-aa7a-4d00-9ee1-c63b75c817c4 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:33.926917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-80823d2a-aa7a-4d00-9ee1-c63b75c817c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:33.990983 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 561/1108] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:34.014355 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e6488-1b54-4786-b9c4-2f88fb0c1857 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:34.111932 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e6488-1b54-4786-b9c4-2f88fb0c1857 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:34.124559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:34.148110 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eeed6d-bdf8-4ecb-82f1-b85852b92085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:34.149209 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eeed6d-bdf8-4ecb-82f1-b85852b92085 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:34.149755 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eeed6d-bdf8-4ecb-82f1-b85852b92085 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:34.150252 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eeed6d-bdf8-4ecb-82f1-b85852b92085 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:34.151400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eeed6d-bdf8-4ecb-82f1-b85852b92085 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:34.152821 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eeed6d-bdf8-4ecb-82f1-b85852b92085 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:34.154448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 548/1109] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:34.161004 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80823d2a-aa7a-4d00-9ee1-c63b75c817c4 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:34.254935 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80823d2a-aa7a-4d00-9ee1-c63b75c817c4 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:34.277433 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:34.288331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6dcbf-9434-4ee7-bd87-2022d6776069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:34.288926 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6dcbf-9434-4ee7-bd87-2022d6776069 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:34.289207 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6dcbf-9434-4ee7-bd87-2022d6776069 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:34.289471 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6dcbf-9434-4ee7-bd87-2022d6776069 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:34.290102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6dcbf-9434-4ee7-bd87-2022d6776069 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:34.291556 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6dcbf-9434-4ee7-bd87-2022d6776069 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:34.311835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 562/1110] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 10 13:03:34 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:03:36.354331 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019221c-6dd2-4717-9bd9-805e93407e58 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:36.354889 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019221c-6dd2-4717-9bd9-805e93407e58 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:36.354889 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019221c-6dd2-4717-9bd9-805e93407e58 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:36.356241 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 549/1111] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:36.361390 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1e5bb-baa1-4cbf-8d44-afd2a10ec318 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:36.362317 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1e5bb-baa1-4cbf-8d44-afd2a10ec318 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:36.362433 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1e5bb-baa1-4cbf-8d44-afd2a10ec318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:36.380577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ebe1e5bb-baa1-4cbf-8d44-afd2a10ec318 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:36.381758 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ebe1e5bb-baa1-4cbf-8d44-afd2a10ec318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:36.451780 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 563/1112] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:36.474850 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019221c-6dd2-4717-9bd9-805e93407e58 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:36.574091 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019221c-6dd2-4717-9bd9-805e93407e58 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:36.606996 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcaee1-6519-45d6-8599-109b00c81f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:36.607573 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcaee1-6519-45d6-8599-109b00c81f0d None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:36.607854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcaee1-6519-45d6-8599-109b00c81f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:36.608128 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcaee1-6519-45d6-8599-109b00c81f0d None admin] PATH_INFO: `/v3/roles/0a020d67ea4d4d62b1305fd0cd952779` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:36.609507 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfcaee1-6519-45d6-8599-109b00c81f0d None admin] RBAC: Authorizing `identity:get_role(role_id=0a020d67ea4d4d62b1305fd0cd952779)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:36.611124 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfcaee1-6519-45d6-8599-109b00c81f0d None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:36.613127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 550/1113] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:03:36 2022] GET /identity/v3/roles/0a020d67ea4d4d62b1305fd0cd952779 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:36.620160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1e5bb-baa1-4cbf-8d44-afd2a10ec318 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:36.715387 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1e5bb-baa1-4cbf-8d44-afd2a10ec318 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:36.725752 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:36.748943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52b279-4905-4592-a4d4-55433e7f6439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:36.749552 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52b279-4905-4592-a4d4-55433e7f6439 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:36.749825 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52b279-4905-4592-a4d4-55433e7f6439 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:36.750088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52b279-4905-4592-a4d4-55433e7f6439 None admin] PATH_INFO: `/v3/users/cd7d0b0c5de1442ab196a718bddf988c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:36.763072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52b279-4905-4592-a4d4-55433e7f6439 None admin] RBAC: Authorizing `identity:get_user(user_id=cd7d0b0c5de1442ab196a718bddf988c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:36.764499 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52b279-4905-4592-a4d4-55433e7f6439 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:36.766072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 564/1114] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:03:36 2022] GET /identity/v3/users/cd7d0b0c5de1442ab196a718bddf988c => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:36.772432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcaee1-6519-45d6-8599-109b00c81f0d None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:36.820071 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:36.868925 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcaee1-6519-45d6-8599-109b00c81f0d None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:36.902629 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8447814-5c51-4127-b6f7-7eea8eb4959e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:36.903254 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8447814-5c51-4127-b6f7-7eea8eb4959e None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:36.903533 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8447814-5c51-4127-b6f7-7eea8eb4959e None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:36.903804 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8447814-5c51-4127-b6f7-7eea8eb4959e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:36.967723 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8447814-5c51-4127-b6f7-7eea8eb4959e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:36.969405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8447814-5c51-4127-b6f7-7eea8eb4959e None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:37.018292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:37.069438 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 551/1115] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:03:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 13:03:37.075360 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52b279-4905-4592-a4d4-55433e7f6439 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:37.169229 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52b279-4905-4592-a4d4-55433e7f6439 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:37.201872 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a44ec1-b498-4c0b-9bb0-71ca0417895a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:37.202482 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a44ec1-b498-4c0b-9bb0-71ca0417895a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:37.202755 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a44ec1-b498-4c0b-9bb0-71ca0417895a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:37.203038 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a44ec1-b498-4c0b-9bb0-71ca0417895a None admin] PATH_INFO: `/v3/projects/34ad5d167174474fb3b253c525d041d3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:37.204124 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a44ec1-b498-4c0b-9bb0-71ca0417895a None admin] RBAC: Authorizing `identity:get_project(project_id=34ad5d167174474fb3b253c525d041d3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:37.205586 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a44ec1-b498-4c0b-9bb0-71ca0417895a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:37.207193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 565/1116] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:03:37 2022] GET /identity/v3/projects/34ad5d167174474fb3b253c525d041d3 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:37.213661 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8447814-5c51-4127-b6f7-7eea8eb4959e None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:37.308215 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8447814-5c51-4127-b6f7-7eea8eb4959e None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:37.340887 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c8de5-72b4-425f-b70f-000fdc487abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:37.341478 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c8de5-72b4-425f-b70f-000fdc487abf None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:37.341751 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c8de5-72b4-425f-b70f-000fdc487abf None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:37.342019 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c8de5-72b4-425f-b70f-000fdc487abf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:37.342722 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c8de5-72b4-425f-b70f-000fdc487abf None admin] RBAC: Adding query filter params (role.id=0a020d67ea4d4d62b1305fd0cd952779, scope.project.id=34ad5d167174474fb3b253c525d041d3, user.id=cd7d0b0c5de1442ab196a718bddf988c) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:37.343308 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c8de5-72b4-425f-b70f-000fdc487abf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:37.344731 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c8de5-72b4-425f-b70f-000fdc487abf None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:37.350545 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 552/1117] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:03:37 2022] GET /identity/v3/role_assignments?user.id=cd7d0b0c5de1442ab196a718bddf988c&scope.project.id=34ad5d167174474fb3b253c525d041d3&role.id=0a020d67ea4d4d62b1305fd0cd952779 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:39.331211 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc9c19-54f7-44eb-a143-a5c70242ea4c None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:39.331815 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc9c19-54f7-44eb-a143-a5c70242ea4c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:39.331815 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc9c19-54f7-44eb-a143-a5c70242ea4c None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:39.333082 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 566/1118] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:39.338259 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328963a-fb8f-49e0-9ad8-a80530894980 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:39.338656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328963a-fb8f-49e0-9ad8-a80530894980 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:39.338794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328963a-fb8f-49e0-9ad8-a80530894980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:39.356692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-4328963a-fb8f-49e0-9ad8-a80530894980 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:39.357887 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-4328963a-fb8f-49e0-9ad8-a80530894980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:39.365694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:39.422828 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 553/1119] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:39.445933 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc9c19-54f7-44eb-a143-a5c70242ea4c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:39.480433 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:39.544375 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc9c19-54f7-44eb-a143-a5c70242ea4c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:39.582367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736e722-f7b8-4bd7-a7ea-d5a1d7f3c4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:39.582905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736e722-f7b8-4bd7-a7ea-d5a1d7f3c4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:39.583203 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736e722-f7b8-4bd7-a7ea-d5a1d7f3c4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:39.583472 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736e722-f7b8-4bd7-a7ea-d5a1d7f3c4a0 None admin] PATH_INFO: `/v3/roles/0a020d67ea4d4d62b1305fd0cd952779` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:39.584820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736e722-f7b8-4bd7-a7ea-d5a1d7f3c4a0 None admin] RBAC: Authorizing `identity:get_role(role_id=0a020d67ea4d4d62b1305fd0cd952779)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:39.586172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736e722-f7b8-4bd7-a7ea-d5a1d7f3c4a0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:39.587502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 567/1120] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:03:39 2022] GET /identity/v3/roles/0a020d67ea4d4d62b1305fd0cd952779 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:39.593636 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328963a-fb8f-49e0-9ad8-a80530894980 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:39.689509 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328963a-fb8f-49e0-9ad8-a80530894980 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:39.722122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39425c0-d56f-4416-b0a4-d9acd863fdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:39.722740 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39425c0-d56f-4416-b0a4-d9acd863fdaa None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:39.723038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39425c0-d56f-4416-b0a4-d9acd863fdaa None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:39.723315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39425c0-d56f-4416-b0a4-d9acd863fdaa None admin] PATH_INFO: `/v3/users/cd7d0b0c5de1442ab196a718bddf988c` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:39.724422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39425c0-d56f-4416-b0a4-d9acd863fdaa None admin] RBAC: Authorizing `identity:get_user(user_id=cd7d0b0c5de1442ab196a718bddf988c)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:39.725848 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39425c0-d56f-4416-b0a4-d9acd863fdaa None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:39.727442 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 554/1121] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:03:39 2022] GET /identity/v3/users/cd7d0b0c5de1442ab196a718bddf988c => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:39.733223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736e722-f7b8-4bd7-a7ea-d5a1d7f3c4a0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:39.827887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736e722-f7b8-4bd7-a7ea-d5a1d7f3c4a0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:39.830115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:39.862334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83721a3-2c53-441a-85f6-650128680b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:39.862884 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83721a3-2c53-441a-85f6-650128680b84 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:39.863560 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83721a3-2c53-441a-85f6-650128680b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:39.863877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83721a3-2c53-441a-85f6-650128680b84 None admin] PATH_INFO: `/v3/projects/34ad5d167174474fb3b253c525d041d3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:39.865301 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83721a3-2c53-441a-85f6-650128680b84 None admin] RBAC: Authorizing `identity:get_project(project_id=34ad5d167174474fb3b253c525d041d3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:39.866937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83721a3-2c53-441a-85f6-650128680b84 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:39.868781 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 568/1122] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:03:39 2022] GET /identity/v3/projects/34ad5d167174474fb3b253c525d041d3 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:39.874762 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39425c0-d56f-4416-b0a4-d9acd863fdaa None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:39.886900 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:39.970185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39425c0-d56f-4416-b0a4-d9acd863fdaa None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:40.003210 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49a34f-c39e-483e-ae1c-903ebd51ab15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:40.003861 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49a34f-c39e-483e-ae1c-903ebd51ab15 None admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:40.004133 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49a34f-c39e-483e-ae1c-903ebd51ab15 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:40.004397 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49a34f-c39e-483e-ae1c-903ebd51ab15 None admin] PATH_INFO: `/v3/projects/34ad5d167174474fb3b253c525d041d3/users/cd7d0b0c5de1442ab196a718bddf988c/roles/0a020d67ea4d4d62b1305fd0cd952779` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:40.006479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49a34f-c39e-483e-ae1c-903ebd51ab15 None admin] RBAC: Authorizing `identity:create_grant(project_id=34ad5d167174474fb3b253c525d041d3, user_id=cd7d0b0c5de1442ab196a718bddf988c, role_id=0a020d67ea4d4d62b1305fd0cd952779)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:40.007931 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49a34f-c39e-483e-ae1c-903ebd51ab15 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:40.020886 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 555/1123] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:03:39 2022] PUT /identity/v3/projects/34ad5d167174474fb3b253c525d041d3/users/cd7d0b0c5de1442ab196a718bddf988c/roles/0a020d67ea4d4d62b1305fd0cd952779 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:03:41.991360 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69096d8d-5acd-431c-835a-7c3d72c66691 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:41.991844 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69096d8d-5acd-431c-835a-7c3d72c66691 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:41.991949 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69096d8d-5acd-431c-835a-7c3d72c66691 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:41.993255 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 569/1124] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:41.998640 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df55e58-fd69-412c-bb83-7333b8b62607 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:41.999099 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df55e58-fd69-412c-bb83-7333b8b62607 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:41.999201 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df55e58-fd69-412c-bb83-7333b8b62607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:42.018480 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-2df55e58-fd69-412c-bb83-7333b8b62607 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:42.019681 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-2df55e58-fd69-412c-bb83-7333b8b62607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:42.079434 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:42.084915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 556/1125] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:42.108540 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69096d8d-5acd-431c-835a-7c3d72c66691 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:42.206213 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69096d8d-5acd-431c-835a-7c3d72c66691 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:42.239376 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429046a-a750-4204-9007-a40bc85cefa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:42.239934 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429046a-a750-4204-9007-a40bc85cefa0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:42.240213 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429046a-a750-4204-9007-a40bc85cefa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:42.240485 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429046a-a750-4204-9007-a40bc85cefa0 None admin] PATH_INFO: `/v3/roles/0a020d67ea4d4d62b1305fd0cd952779` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:42.241868 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429046a-a750-4204-9007-a40bc85cefa0 None admin] RBAC: Authorizing `identity:get_role(role_id=0a020d67ea4d4d62b1305fd0cd952779)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:42.243260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429046a-a750-4204-9007-a40bc85cefa0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:42.244570 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 570/1126] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:03:42 2022] GET /identity/v3/roles/0a020d67ea4d4d62b1305fd0cd952779 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:03:42.250402 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df55e58-fd69-412c-bb83-7333b8b62607 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:42.344822 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df55e58-fd69-412c-bb83-7333b8b62607 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:42.377719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740ee1c-b909-46b3-92f8-c422de44abb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:42.378334 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740ee1c-b909-46b3-92f8-c422de44abb9 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:42.378608 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740ee1c-b909-46b3-92f8-c422de44abb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:42.378873 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740ee1c-b909-46b3-92f8-c422de44abb9 None admin] PATH_INFO: `/v3/users/cd7d0b0c5de1442ab196a718bddf988c` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:42.380014 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740ee1c-b909-46b3-92f8-c422de44abb9 None admin] RBAC: Authorizing `identity:get_user(user_id=cd7d0b0c5de1442ab196a718bddf988c)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:42.381419 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740ee1c-b909-46b3-92f8-c422de44abb9 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:42.382978 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 557/1127] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:03:42 2022] GET /identity/v3/users/cd7d0b0c5de1442ab196a718bddf988c => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:42.388969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429046a-a750-4204-9007-a40bc85cefa0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:42.429696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:42.487053 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429046a-a750-4204-9007-a40bc85cefa0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:42.520115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472b05d-8364-42cf-8ba4-d16d46583395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:42.520710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472b05d-8364-42cf-8ba4-d16d46583395 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:42.520988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472b05d-8364-42cf-8ba4-d16d46583395 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:42.521256 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472b05d-8364-42cf-8ba4-d16d46583395 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:42.585603 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472b05d-8364-42cf-8ba4-d16d46583395 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:42.587058 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472b05d-8364-42cf-8ba4-d16d46583395 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:42.628279 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:42.689127 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 571/1128] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:03:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 13:03:42.695125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740ee1c-b909-46b3-92f8-c422de44abb9 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:42.759718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:42.792794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740ee1c-b909-46b3-92f8-c422de44abb9 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:42.826205 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d33fd3-74b8-4bdf-b668-81518b1614db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:42.826820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d33fd3-74b8-4bdf-b668-81518b1614db None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:42.827125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d33fd3-74b8-4bdf-b668-81518b1614db None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:42.827401 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d33fd3-74b8-4bdf-b668-81518b1614db None admin] PATH_INFO: `/v3/projects/34ad5d167174474fb3b253c525d041d3` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:42.828503 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d33fd3-74b8-4bdf-b668-81518b1614db None admin] RBAC: Authorizing `identity:get_project(project_id=34ad5d167174474fb3b253c525d041d3)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:42.829958 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d33fd3-74b8-4bdf-b668-81518b1614db None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:42.831629 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 558/1129] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:03:42 2022] GET /identity/v3/projects/34ad5d167174474fb3b253c525d041d3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:42.838488 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472b05d-8364-42cf-8ba4-d16d46583395 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:42.941570 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472b05d-8364-42cf-8ba4-d16d46583395 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:42.978680 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824185f-ad65-4192-b3bf-b4b0a5b8a089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:42.979313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824185f-ad65-4192-b3bf-b4b0a5b8a089 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:42.979591 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824185f-ad65-4192-b3bf-b4b0a5b8a089 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:42.979859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824185f-ad65-4192-b3bf-b4b0a5b8a089 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:42.980571 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824185f-ad65-4192-b3bf-b4b0a5b8a089 None admin] RBAC: Adding query filter params (role.id=0a020d67ea4d4d62b1305fd0cd952779, scope.project.id=34ad5d167174474fb3b253c525d041d3, user.id=cd7d0b0c5de1442ab196a718bddf988c) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:42.980878 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824185f-ad65-4192-b3bf-b4b0a5b8a089 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:42.982316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824185f-ad65-4192-b3bf-b4b0a5b8a089 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:42.988572 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 572/1130] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:03:42 2022] GET /identity/v3/role_assignments?user.id=cd7d0b0c5de1442ab196a718bddf988c&scope.project.id=34ad5d167174474fb3b253c525d041d3&role.id=0a020d67ea4d4d62b1305fd0cd952779 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:45.031647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e9d26-c9e9-425f-86c2-1500fa3edd02 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:45.032156 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e9d26-c9e9-425f-86c2-1500fa3edd02 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:45.032267 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e9d26-c9e9-425f-86c2-1500fa3edd02 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:45.034107 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 559/1131] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:45.039218 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9206b8-a48d-4317-8d42-c7cc741f2eb0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:45.039608 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9206b8-a48d-4317-8d42-c7cc741f2eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:45.039760 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9206b8-a48d-4317-8d42-c7cc741f2eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:45.046954 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:45.058714 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ea9206b8-a48d-4317-8d42-c7cc741f2eb0 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:45.059940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ea9206b8-a48d-4317-8d42-c7cc741f2eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:45.126724 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 573/1132] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:45.149746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e9d26-c9e9-425f-86c2-1500fa3edd02 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:45.248643 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e9d26-c9e9-425f-86c2-1500fa3edd02 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:45.281740 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9825873-6587-4acc-b2e3-40272134f9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:45.282342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9825873-6587-4acc-b2e3-40272134f9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:45.282619 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9825873-6587-4acc-b2e3-40272134f9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:45.282888 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9825873-6587-4acc-b2e3-40272134f9f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:45.284557 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9825873-6587-4acc-b2e3-40272134f9f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:45.285973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9825873-6587-4acc-b2e3-40272134f9f5 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:45.287550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 560/1133] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:45.293532 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9206b8-a48d-4317-8d42-c7cc741f2eb0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:45.392093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9206b8-a48d-4317-8d42-c7cc741f2eb0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:45.426005 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da03c2a-d6f5-44b6-9eaf-ff0329db20be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:45.426603 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da03c2a-d6f5-44b6-9eaf-ff0329db20be None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:45.426883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da03c2a-d6f5-44b6-9eaf-ff0329db20be None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:45.427183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da03c2a-d6f5-44b6-9eaf-ff0329db20be None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:45.427841 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da03c2a-d6f5-44b6-9eaf-ff0329db20be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:45.429265 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da03c2a-d6f5-44b6-9eaf-ff0329db20be None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:45.433771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:45.456632 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 574/1134] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 10 13:03:45 2022] POST /identity/v3/projects => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:03:47.469524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d88e8-2323-4bb1-8e3f-37ebe23ed123 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:47.470084 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d88e8-2323-4bb1-8e3f-37ebe23ed123 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:47.470084 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d88e8-2323-4bb1-8e3f-37ebe23ed123 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:47.472024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 561/1135] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:47.477200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39a24b-6ca5-4caa-9272-906170d5f23d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:47.477617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39a24b-6ca5-4caa-9272-906170d5f23d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:47.477740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39a24b-6ca5-4caa-9272-906170d5f23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:47.495662 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ba39a24b-6ca5-4caa-9272-906170d5f23d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:47.496869 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ba39a24b-6ca5-4caa-9272-906170d5f23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:47.562728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 575/1136] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:47.586765 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d88e8-2323-4bb1-8e3f-37ebe23ed123 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:47.590586 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:47.692188 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d88e8-2323-4bb1-8e3f-37ebe23ed123 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:47.727952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36675923-a3e6-470d-b009-5f511890b620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:47.728485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36675923-a3e6-470d-b009-5f511890b620 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:47.728758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36675923-a3e6-470d-b009-5f511890b620 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:47.729023 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36675923-a3e6-470d-b009-5f511890b620 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:47.730109 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36675923-a3e6-470d-b009-5f511890b620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:47.731552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36675923-a3e6-470d-b009-5f511890b620 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:47.733094 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 562/1137] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:03:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:47.738949 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39a24b-6ca5-4caa-9272-906170d5f23d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:47.836491 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39a24b-6ca5-4caa-9272-906170d5f23d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:47.853742 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:47.873295 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de470059-b427-4db8-b9dc-9f52e5796694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:47.873898 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de470059-b427-4db8-b9dc-9f52e5796694 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:47.874177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de470059-b427-4db8-b9dc-9f52e5796694 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:47.874447 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de470059-b427-4db8-b9dc-9f52e5796694 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:47.875113 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de470059-b427-4db8-b9dc-9f52e5796694 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:47.877048 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de470059-b427-4db8-b9dc-9f52e5796694 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:47.898052 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 576/1138] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 10 13:03:47 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:03:49.966916 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce053833-e239-4b82-a766-5c273d98a1e4 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:49.967493 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce053833-e239-4b82-a766-5c273d98a1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:49.967493 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce053833-e239-4b82-a766-5c273d98a1e4 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:49.969118 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 563/1139] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:49.975712 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6c604-2f3c-4c02-ba15-baf492096284 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:49.976285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6c604-2f3c-4c02-ba15-baf492096284 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:49.976285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6c604-2f3c-4c02-ba15-baf492096284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:49.996011 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-34d6c604-2f3c-4c02-ba15-baf492096284 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:49.997250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-34d6c604-2f3c-4c02-ba15-baf492096284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:50.071593 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 577/1140] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:50.097788 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce053833-e239-4b82-a766-5c273d98a1e4 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:50.174151 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:50.205244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce053833-e239-4b82-a766-5c273d98a1e4 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:50.241819 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3cf292-6919-4984-a06d-ed9ebbcbe0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:50.242382 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cf292-6919-4984-a06d-ed9ebbcbe0be None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:50.242661 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cf292-6919-4984-a06d-ed9ebbcbe0be None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:50.242933 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cf292-6919-4984-a06d-ed9ebbcbe0be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:50.254806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3cf292-6919-4984-a06d-ed9ebbcbe0be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:03:50.259635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-ad3cf292-6919-4984-a06d-ed9ebbcbe0be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:03:50.259635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:50.259635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:50.259635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:50.259635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:50.259635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:50.259635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:50.259635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:50.259635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:50.259635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:50.259635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:50.259635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:50.259635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:03:50.259635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:03:50.259635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:03:50.259635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:03:50.260879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:03:50.260879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:03:50.260879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:03:50.260879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:03:50.260879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:50.260879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:50.260879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:50.260879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:50.260879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:50.260879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:50.260879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:50.260879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:50.260879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:50.260879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:50.260879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:50.260879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:50.261964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:50.261964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:50.261964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:50.261964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:50.261964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:03:50.261964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:03:50.261964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:03:50.261964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:03:50.261964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:03:50.261964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:03:50.261964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:03:50.261964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:50.261964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 564/1141] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:03:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:50.267374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6c604-2f3c-4c02-ba15-baf492096284 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:50.367976 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6c604-2f3c-4c02-ba15-baf492096284 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:50.369477 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:50.404085 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d2142-96e2-4e40-b05b-8299a78fa1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:50.404688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d2142-96e2-4e40-b05b-8299a78fa1db None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:50.404967 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d2142-96e2-4e40-b05b-8299a78fa1db None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:50.405236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d2142-96e2-4e40-b05b-8299a78fa1db None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:50.405890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d2142-96e2-4e40-b05b-8299a78fa1db None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:50.406188 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d2142-96e2-4e40-b05b-8299a78fa1db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:50.407576 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d2142-96e2-4e40-b05b-8299a78fa1db None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:50.415881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 578/1142] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:03:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:50.421903 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3cf292-6919-4984-a06d-ed9ebbcbe0be None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:50.519327 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3cf292-6919-4984-a06d-ed9ebbcbe0be None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:50.547018 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:50.552328 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed360514-e29d-4ad3-82ae-274e8d410f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:50.552946 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed360514-e29d-4ad3-82ae-274e8d410f8f None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:50.553215 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed360514-e29d-4ad3-82ae-274e8d410f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:50.553482 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed360514-e29d-4ad3-82ae-274e8d410f8f None admin] PATH_INFO: `/v3/users/5f96e996c21f4ff09fcdebcd6dc087a6` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:50.566677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed360514-e29d-4ad3-82ae-274e8d410f8f None admin] RBAC: Authorizing `identity:get_user(user_id=5f96e996c21f4ff09fcdebcd6dc087a6)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:50.568119 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed360514-e29d-4ad3-82ae-274e8d410f8f None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:50.569708 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 565/1143] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:03:50 2022] GET /identity/v3/users/5f96e996c21f4ff09fcdebcd6dc087a6 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:50.575598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d2142-96e2-4e40-b05b-8299a78fa1db None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:50.675497 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d2142-96e2-4e40-b05b-8299a78fa1db None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:50.707337 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39925a20-69af-4740-a8be-d36be289d26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:50.707927 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39925a20-69af-4740-a8be-d36be289d26e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:50.708200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39925a20-69af-4740-a8be-d36be289d26e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:50.708465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39925a20-69af-4740-a8be-d36be289d26e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:50.738478 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:50.774626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39925a20-69af-4740-a8be-d36be289d26e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:50.776047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39925a20-69af-4740-a8be-d36be289d26e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:50.871233 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 579/1144] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:03:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 13:03:50.877637 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed360514-e29d-4ad3-82ae-274e8d410f8f None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:50.973421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed360514-e29d-4ad3-82ae-274e8d410f8f None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:51.007822 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2b329-f6fa-4bd0-bcb4-0543f68be93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:51.008446 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2b329-f6fa-4bd0-bcb4-0543f68be93f None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:51.008724 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2b329-f6fa-4bd0-bcb4-0543f68be93f None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:51.008996 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2b329-f6fa-4bd0-bcb4-0543f68be93f None admin] PATH_INFO: `/v3/projects/0a550469c3034b1ca9220f1a0a7967e2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:51.010096 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b2b329-f6fa-4bd0-bcb4-0543f68be93f None admin] RBAC: Authorizing `identity:get_project(project_id=0a550469c3034b1ca9220f1a0a7967e2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:51.011548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b2b329-f6fa-4bd0-bcb4-0543f68be93f None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:51.013161 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 566/1145] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:03:50 2022] GET /identity/v3/projects/0a550469c3034b1ca9220f1a0a7967e2 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:51.020158 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39925a20-69af-4740-a8be-d36be289d26e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:51.079431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:51.117372 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39925a20-69af-4740-a8be-d36be289d26e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:51.151614 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0d1a9-afb7-48f1-b8fb-df9129c1e7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:51.153459 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0d1a9-afb7-48f1-b8fb-df9129c1e7ff None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:51.153737 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0d1a9-afb7-48f1-b8fb-df9129c1e7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:51.154006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0d1a9-afb7-48f1-b8fb-df9129c1e7ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:51.154723 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0d1a9-afb7-48f1-b8fb-df9129c1e7ff None admin] RBAC: Adding query filter params (role.id=d9c9200468cb4f7ab6a23882bfb1f062, scope.project.id=0a550469c3034b1ca9220f1a0a7967e2, user.id=5f96e996c21f4ff09fcdebcd6dc087a6) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:51.155042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0d1a9-afb7-48f1-b8fb-df9129c1e7ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:51.156454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0d1a9-afb7-48f1-b8fb-df9129c1e7ff None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:51.162311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 580/1146] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:03:51 2022] GET /identity/v3/role_assignments?user.id=5f96e996c21f4ff09fcdebcd6dc087a6&scope.project.id=0a550469c3034b1ca9220f1a0a7967e2&role.id=d9c9200468cb4f7ab6a23882bfb1f062 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:53.176334 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4ef7f-ac0b-4fbd-9644-b12c4df16b53 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:53.176886 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4ef7f-ac0b-4fbd-9644-b12c4df16b53 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:53.176886 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4ef7f-ac0b-4fbd-9644-b12c4df16b53 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:53.178187 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 567/1147] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:53.183476 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77837ab-8d5e-4c56-a6a5-3112c59e5d8f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:53.183983 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77837ab-8d5e-4c56-a6a5-3112c59e5d8f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:53.183983 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77837ab-8d5e-4c56-a6a5-3112c59e5d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:53.202198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d77837ab-8d5e-4c56-a6a5-3112c59e5d8f None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:53.203412 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d77837ab-8d5e-4c56-a6a5-3112c59e5d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:53.266879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 581/1148] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:53.289323 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4ef7f-ac0b-4fbd-9644-b12c4df16b53 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:53.348600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:53.390382 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4ef7f-ac0b-4fbd-9644-b12c4df16b53 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:53.423911 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74081ae1-89e0-4b7c-894d-33fe040a07eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:53.424530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74081ae1-89e0-4b7c-894d-33fe040a07eb None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:53.424811 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74081ae1-89e0-4b7c-894d-33fe040a07eb None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:53.425084 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74081ae1-89e0-4b7c-894d-33fe040a07eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:53.435130 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74081ae1-89e0-4b7c-894d-33fe040a07eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:03:53.440392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-74081ae1-89e0-4b7c-894d-33fe040a07eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:03:53.440392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:53.440392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:53.440392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:53.440392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:53.440392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:53.440392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:53.440392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:53.440392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:53.440392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:53.440392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:53.440392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:53.440392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:03:53.440392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:03:53.440392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:03:53.440392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:03:53.441552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:03:53.441552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:03:53.441552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:03:53.441552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:03:53.441552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:53.441552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:53.441552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:53.441552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:53.441552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:53.441552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:53.441552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:53.441552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:53.441552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:53.441552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:53.441552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:53.441552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:53.442594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:53.442594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:53.442594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:53.442594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:53.442594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:03:53.442594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:03:53.442594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:03:53.442594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:03:53.442594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:03:53.442594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:03:53.442594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:03:53.442594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:03:53.442594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 568/1149] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:03:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:53.447545 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77837ab-8d5e-4c56-a6a5-3112c59e5d8f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:53.507932 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:53.551578 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77837ab-8d5e-4c56-a6a5-3112c59e5d8f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:53.585663 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682eca7-0c8d-4b87-bde7-8fabe961a349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:53.586270 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682eca7-0c8d-4b87-bde7-8fabe961a349 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:53.586551 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682eca7-0c8d-4b87-bde7-8fabe961a349 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:53.586822 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682eca7-0c8d-4b87-bde7-8fabe961a349 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:53.587516 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682eca7-0c8d-4b87-bde7-8fabe961a349 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:53.587818 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682eca7-0c8d-4b87-bde7-8fabe961a349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:53.589185 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682eca7-0c8d-4b87-bde7-8fabe961a349 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:53.598194 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 582/1150] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:03:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:53.604258 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74081ae1-89e0-4b7c-894d-33fe040a07eb None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:53.705367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74081ae1-89e0-4b7c-894d-33fe040a07eb None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:53.723503 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:53.740805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1893b8-0988-4fc4-852b-fa164b34ac29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:53.741429 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1893b8-0988-4fc4-852b-fa164b34ac29 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:53.741707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1893b8-0988-4fc4-852b-fa164b34ac29 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:53.741976 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1893b8-0988-4fc4-852b-fa164b34ac29 None admin] PATH_INFO: `/v3/users/5f96e996c21f4ff09fcdebcd6dc087a6` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:53.743107 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1893b8-0988-4fc4-852b-fa164b34ac29 None admin] RBAC: Authorizing `identity:get_user(user_id=5f96e996c21f4ff09fcdebcd6dc087a6)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:53.744523 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1893b8-0988-4fc4-852b-fa164b34ac29 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:53.746116 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 569/1151] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:03:53 2022] GET /identity/v3/users/5f96e996c21f4ff09fcdebcd6dc087a6 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:53.754794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682eca7-0c8d-4b87-bde7-8fabe961a349 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:53.874871 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682eca7-0c8d-4b87-bde7-8fabe961a349 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:53.897947 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:53.912953 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce8ff1-6715-4935-925c-08027ec54885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:53.913595 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce8ff1-6715-4935-925c-08027ec54885 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:53.913877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce8ff1-6715-4935-925c-08027ec54885 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:53.914152 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce8ff1-6715-4935-925c-08027ec54885 None admin] PATH_INFO: `/v3/projects/0a550469c3034b1ca9220f1a0a7967e2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:53.915347 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce8ff1-6715-4935-925c-08027ec54885 None admin] RBAC: Authorizing `identity:get_project(project_id=0a550469c3034b1ca9220f1a0a7967e2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:53.916809 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce8ff1-6715-4935-925c-08027ec54885 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:53.918485 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 583/1152] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:03:53 2022] GET /identity/v3/projects/0a550469c3034b1ca9220f1a0a7967e2 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:53.924813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1893b8-0988-4fc4-852b-fa164b34ac29 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:54.033055 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1893b8-0988-4fc4-852b-fa164b34ac29 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:54.066412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75816a-fdb6-4b6f-af0a-2b6473fdc7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:54.067080 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75816a-fdb6-4b6f-af0a-2b6473fdc7b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:54.067356 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75816a-fdb6-4b6f-af0a-2b6473fdc7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:54.067623 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75816a-fdb6-4b6f-af0a-2b6473fdc7b2 None admin] PATH_INFO: `/v3/projects/0a550469c3034b1ca9220f1a0a7967e2/users/5f96e996c21f4ff09fcdebcd6dc087a6/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:54.069471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75816a-fdb6-4b6f-af0a-2b6473fdc7b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a550469c3034b1ca9220f1a0a7967e2, user_id=5f96e996c21f4ff09fcdebcd6dc087a6, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:54.070869 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75816a-fdb6-4b6f-af0a-2b6473fdc7b2 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:54.084484 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 570/1153] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:03:53 2022] PUT /identity/v3/projects/0a550469c3034b1ca9220f1a0a7967e2/users/5f96e996c21f4ff09fcdebcd6dc087a6/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:03:56.101800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa8534-7e6e-4cbd-be50-d2c5517c4303 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:56.102332 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa8534-7e6e-4cbd-be50-d2c5517c4303 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:56.102332 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa8534-7e6e-4cbd-be50-d2c5517c4303 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:56.103735 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 584/1154] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:56.109198 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d04f2-6a68-4790-b0a1-c05d38f001d1 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:56.109733 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d04f2-6a68-4790-b0a1-c05d38f001d1 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:56.109733 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d04f2-6a68-4790-b0a1-c05d38f001d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:56.129551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-db3d04f2-6a68-4790-b0a1-c05d38f001d1 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:56.130757 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-db3d04f2-6a68-4790-b0a1-c05d38f001d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:56.175026 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:56.210790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 571/1155] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:56.234609 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa8534-7e6e-4cbd-be50-d2c5517c4303 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:56.342268 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa8534-7e6e-4cbd-be50-d2c5517c4303 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:56.376666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fded79b-bfb1-47f9-ab67-88368f523029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:56.377305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fded79b-bfb1-47f9-ab67-88368f523029 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:56.377585 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fded79b-bfb1-47f9-ab67-88368f523029 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:56.377858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fded79b-bfb1-47f9-ab67-88368f523029 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:56.388950 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fded79b-bfb1-47f9-ab67-88368f523029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:03:56.394307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-8fded79b-bfb1-47f9-ab67-88368f523029 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:03:56.394307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:03:56.394307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:03:56.394307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:03:56.394307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:03:56.394307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:03:56.394307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:03:56.394307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:03:56.394307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:03:56.394307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:03:56.394307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:03:56.394307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:03:56.394307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:03:56.394307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:03:56.394307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:03:56.394307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:03:56.395437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:03:56.395437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:03:56.395437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:03:56.395437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:03:56.395437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:03:56.395437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:03:56.395437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:03:56.395437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:03:56.395437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:03:56.395437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:03:56.395437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:03:56.395437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:03:56.395437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:03:56.395437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:03:56.395437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:03:56.395437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:03:56.396474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:03:56.396474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:03:56.396474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:03:56.396474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:03:56.396474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:03:56.396474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:03:56.396474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:03:56.396474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:03:56.396474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:03:56.396474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:03:56.396474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:03:56.396474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:03:56.399202 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 585/1156] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:03:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:03:56.402377 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d04f2-6a68-4790-b0a1-c05d38f001d1 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:56.517718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d04f2-6a68-4790-b0a1-c05d38f001d1 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:56.551994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385e536-d962-4040-99e4-a8948ce5832b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:56.552608 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385e536-d962-4040-99e4-a8948ce5832b None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:56.552886 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385e536-d962-4040-99e4-a8948ce5832b None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:56.553159 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385e536-d962-4040-99e4-a8948ce5832b None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:56.553842 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385e536-d962-4040-99e4-a8948ce5832b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:56.554149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385e536-d962-4040-99e4-a8948ce5832b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:56.555562 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385e536-d962-4040-99e4-a8948ce5832b None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:56.565130 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 572/1157] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:03:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:56.571106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fded79b-bfb1-47f9-ab67-88368f523029 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:56.625728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:56.676703 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fded79b-bfb1-47f9-ab67-88368f523029 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:56.709511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da2bbc-3d72-4ffe-8d22-fd372861dccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:56.710130 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da2bbc-3d72-4ffe-8d22-fd372861dccf None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:56.710406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da2bbc-3d72-4ffe-8d22-fd372861dccf None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:56.710672 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da2bbc-3d72-4ffe-8d22-fd372861dccf None admin] PATH_INFO: `/v3/users/5f96e996c21f4ff09fcdebcd6dc087a6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:56.711789 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da2bbc-3d72-4ffe-8d22-fd372861dccf None admin] RBAC: Authorizing `identity:get_user(user_id=5f96e996c21f4ff09fcdebcd6dc087a6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:56.713205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da2bbc-3d72-4ffe-8d22-fd372861dccf None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:56.714763 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 586/1158] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:03:56 2022] GET /identity/v3/users/5f96e996c21f4ff09fcdebcd6dc087a6 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:56.721363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385e536-d962-4040-99e4-a8948ce5832b None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:56.762228 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:56.822826 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385e536-d962-4040-99e4-a8948ce5832b None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:56.857602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d32ca4-a595-4d34-b84b-66f87131e524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:56.858208 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d32ca4-a595-4d34-b84b-66f87131e524 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:56.858486 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d32ca4-a595-4d34-b84b-66f87131e524 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:56.858757 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d32ca4-a595-4d34-b84b-66f87131e524 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:56.927406 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d32ca4-a595-4d34-b84b-66f87131e524 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:56.928720 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d32ca4-a595-4d34-b84b-66f87131e524 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:56.966167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:57.032036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 573/1159] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:03:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 13:03:57.038600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da2bbc-3d72-4ffe-8d22-fd372861dccf None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:57.151431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da2bbc-3d72-4ffe-8d22-fd372861dccf None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:57.171896 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:57.195258 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5209bba-31dc-46d4-a261-4c20b653e5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:57.195827 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5209bba-31dc-46d4-a261-4c20b653e5ac None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:57.197237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5209bba-31dc-46d4-a261-4c20b653e5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:57.197554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5209bba-31dc-46d4-a261-4c20b653e5ac None admin] PATH_INFO: `/v3/projects/0a550469c3034b1ca9220f1a0a7967e2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:57.198876 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5209bba-31dc-46d4-a261-4c20b653e5ac None admin] RBAC: Authorizing `identity:get_project(project_id=0a550469c3034b1ca9220f1a0a7967e2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:57.201560 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5209bba-31dc-46d4-a261-4c20b653e5ac None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:57.203509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 587/1160] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:03:57 2022] GET /identity/v3/projects/0a550469c3034b1ca9220f1a0a7967e2 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:57.210562 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d32ca4-a595-4d34-b84b-66f87131e524 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:57.318112 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d32ca4-a595-4d34-b84b-66f87131e524 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:57.352887 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6aa43-ba96-4d6c-98a6-641051db155f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:57.353496 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6aa43-ba96-4d6c-98a6-641051db155f None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:57.353771 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6aa43-ba96-4d6c-98a6-641051db155f None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:57.356417 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6aa43-ba96-4d6c-98a6-641051db155f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:57.356417 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6aa43-ba96-4d6c-98a6-641051db155f None admin] RBAC: Adding query filter params (role.id=d9c9200468cb4f7ab6a23882bfb1f062, scope.project.id=0a550469c3034b1ca9220f1a0a7967e2, user.id=5f96e996c21f4ff09fcdebcd6dc087a6) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:03:57.356417 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6aa43-ba96-4d6c-98a6-641051db155f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:57.356820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6aa43-ba96-4d6c-98a6-641051db155f None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:57.363538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 574/1161] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:03:57 2022] GET /identity/v3/role_assignments?user.id=5f96e996c21f4ff09fcdebcd6dc087a6&scope.project.id=0a550469c3034b1ca9220f1a0a7967e2&role.id=d9c9200468cb4f7ab6a23882bfb1f062 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:03:59.426624 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3dbc0-a102-4595-ad94-b46f58e7ad62 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:59.427368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3dbc0-a102-4595-ad94-b46f58e7ad62 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:59.427368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3dbc0-a102-4595-ad94-b46f58e7ad62 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:59.428535 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 588/1162] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:03:59.433697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90d35a-162d-4d4c-a8d7-499423faff60 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:59.434117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90d35a-162d-4d4c-a8d7-499423faff60 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:59.434246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90d35a-162d-4d4c-a8d7-499423faff60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:59.440521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:59.453246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-1a90d35a-162d-4d4c-a8d7-499423faff60 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:03:59.454938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-1a90d35a-162d-4d4c-a8d7-499423faff60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:03:59.523395 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 575/1163] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:03:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:03:59.546055 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3dbc0-a102-4595-ad94-b46f58e7ad62 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:59.651487 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3dbc0-a102-4595-ad94-b46f58e7ad62 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:59.685855 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e538106-3859-4b45-9534-070db9419f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:59.686369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e538106-3859-4b45-9534-070db9419f09 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:59.686650 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e538106-3859-4b45-9534-070db9419f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:59.686925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e538106-3859-4b45-9534-070db9419f09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:03:59.738613 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:59.754668 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e538106-3859-4b45-9534-070db9419f09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:03:59.756150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e538106-3859-4b45-9534-070db9419f09 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:03:59.855977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 589/1164] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:03:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 13:03:59.864422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90d35a-162d-4d4c-a8d7-499423faff60 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:03:59.960883 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90d35a-162d-4d4c-a8d7-499423faff60 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:03:59.989697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:59.994960 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74af340-2204-4dac-95a8-bda2b91b4c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:03:59.995608 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74af340-2204-4dac-95a8-bda2b91b4c36 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:03:59.995884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74af340-2204-4dac-95a8-bda2b91b4c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:03:59.996151 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74af340-2204-4dac-95a8-bda2b91b4c36 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:00.003345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74af340-2204-4dac-95a8-bda2b91b4c36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:04:00.004768 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74af340-2204-4dac-95a8-bda2b91b4c36 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:04:00.015669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-f74af340-2204-4dac-95a8-bda2b91b4c36 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 10 13:04:00.015669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:04:00.015669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 10 13:04:00.015669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 10 13:04:00.015669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:04:00.015669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:04:00.015669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:04:00.015669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:04:00.015669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 10 13:04:00.015669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:04:00.015669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:04:00.015669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:04:00.015669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:04:00.015669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:04:00.015669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:04:00.015669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:04:00.015669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:04:00.017548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:04:00.017548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:04:00.017548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:04:00.017548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:04:00.017548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:04:00.017548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:04:00.017548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:04:00.017548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:04:00.017548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:04:00.017548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:04:00.017548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:04:00.017548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:04:00.017548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:04:00.017548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:04:00.017548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:04:00.017548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:04:00.018698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:04:00.018698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:04:00.018698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:04:00.018698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:04:00.018698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:04:00.018698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:04:00.018698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:04:00.018698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:04:00.018698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:04:00.018698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:04:00.018698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 10 13:04:00.018698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:04:00.018698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 10 13:04:00.018698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:04:00.018698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 576/1165] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Aug 10 13:03:59 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:04:00.023334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e538106-3859-4b45-9534-070db9419f09 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:04:00.103481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:00.119561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e538106-3859-4b45-9534-070db9419f09 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:04:00.151743 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd32ec-c14d-4e69-a603-42a55018cd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:04:00.152339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd32ec-c14d-4e69-a603-42a55018cd7b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:00.152618 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd32ec-c14d-4e69-a603-42a55018cd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:00.152887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd32ec-c14d-4e69-a603-42a55018cd7b None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:00.153597 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd32ec-c14d-4e69-a603-42a55018cd7b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:04:00.153818 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd32ec-c14d-4e69-a603-42a55018cd7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:04:00.155204 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd32ec-c14d-4e69-a603-42a55018cd7b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:04:00.162603 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 590/1166] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Aug 10 13:04:00 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:04:02.231021 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317885f-8cbb-4c79-bc27-b64c8f4b2439 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:02.231554 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317885f-8cbb-4c79-bc27-b64c8f4b2439 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:02.231554 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317885f-8cbb-4c79-bc27-b64c8f4b2439 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:02.232916 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 577/1167] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:04:02.238114 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e34744-a4a7-4db2-b54f-8181f0305780 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:02.238504 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e34744-a4a7-4db2-b54f-8181f0305780 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:02.238593 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e34744-a4a7-4db2-b54f-8181f0305780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:02.256668 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-88e34744-a4a7-4db2-b54f-8181f0305780 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:04:02.257858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-88e34744-a4a7-4db2-b54f-8181f0305780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:04:02.323349 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 591/1168] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:04:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:04:02.346151 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317885f-8cbb-4c79-bc27-b64c8f4b2439 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:04:02.448182 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317885f-8cbb-4c79-bc27-b64c8f4b2439 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:04:02.485981 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2e331-51f9-4997-9ae1-751e68124d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:04:02.486580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2e331-51f9-4997-9ae1-751e68124d4e None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:02.486859 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2e331-51f9-4997-9ae1-751e68124d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:02.487178 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2e331-51f9-4997-9ae1-751e68124d4e None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:02.487846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2e331-51f9-4997-9ae1-751e68124d4e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:04:02.489237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2e331-51f9-4997-9ae1-751e68124d4e None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:04:02.505974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 578/1169] 10.222.0.46 () {60 vars in 1138 bytes} [Wed Aug 10 13:04:02 2022] POST /identity/v3/domains => generated 267 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:04:04.557964 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4f5c5-d94d-4cfb-b6f3-7b6abb38518f None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:04.558504 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4f5c5-d94d-4cfb-b6f3-7b6abb38518f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:04.558504 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4f5c5-d94d-4cfb-b6f3-7b6abb38518f None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:04.559879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 592/1170] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:04:04.565260 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6c0d7-fc58-4264-87bc-dab2c9365f24 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:04.565706 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6c0d7-fc58-4264-87bc-dab2c9365f24 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:04.565798 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6c0d7-fc58-4264-87bc-dab2c9365f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:04.583498 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-7ab6c0d7-fc58-4264-87bc-dab2c9365f24 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:04:04.584683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7ab6c0d7-fc58-4264-87bc-dab2c9365f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:04:04.634710 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:04.654779 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 579/1171] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:04:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:04:04.679210 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4f5c5-d94d-4cfb-b6f3-7b6abb38518f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:04:04.757295 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:04.779939 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4f5c5-d94d-4cfb-b6f3-7b6abb38518f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:04:04.813363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b07639-7bc3-4988-87a5-e9ebb12178cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:04:04.813910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b07639-7bc3-4988-87a5-e9ebb12178cd None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:04.814190 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b07639-7bc3-4988-87a5-e9ebb12178cd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:04.814455 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b07639-7bc3-4988-87a5-e9ebb12178cd None admin] PATH_INFO: `/v3/domains/d09813324c1b4d34b75ddc2495666830` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:04.825295 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b07639-7bc3-4988-87a5-e9ebb12178cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=d09813324c1b4d34b75ddc2495666830)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:04:04.826745 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b07639-7bc3-4988-87a5-e9ebb12178cd None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:04:04.828425 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 593/1172] 10.222.0.46 () {56 vars in 1183 bytes} [Wed Aug 10 13:04:04 2022] GET /identity/v3/domains/d09813324c1b4d34b75ddc2495666830 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:04:04.834835 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6c0d7-fc58-4264-87bc-dab2c9365f24 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:04:04.934348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6c0d7-fc58-4264-87bc-dab2c9365f24 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:04:04.979953 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336feea-947e-4f6d-8727-c785200ecd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:04:04.980559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336feea-947e-4f6d-8727-c785200ecd7f None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:04.980832 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336feea-947e-4f6d-8727-c785200ecd7f None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:04.981097 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336feea-947e-4f6d-8727-c785200ecd7f None admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:04.981737 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336feea-947e-4f6d-8727-c785200ecd7f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:04:04.983172 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336feea-947e-4f6d-8727-c785200ecd7f None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:04:05.009577 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 580/1173] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 10 13:04:04 2022] POST /identity/v3/projects => generated 361 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:04:07.039484 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c71b1-d0be-4b34-a127-7f42c59b487a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:07.040003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c71b1-d0be-4b34-a127-7f42c59b487a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:07.040119 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c71b1-d0be-4b34-a127-7f42c59b487a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:07.041365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 594/1174] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:04:07.046415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a183d-0dd0-4b05-8118-21899fa8c248 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:07.046830 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a183d-0dd0-4b05-8118-21899fa8c248 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:07.046968 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a183d-0dd0-4b05-8118-21899fa8c248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:07.065825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-e67a183d-0dd0-4b05-8118-21899fa8c248 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:04:07.067027 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-e67a183d-0dd0-4b05-8118-21899fa8c248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:04:07.093107 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:07.135433 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 581/1175] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:04:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:04:07.159709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c71b1-d0be-4b34-a127-7f42c59b487a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:04:07.258256 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c71b1-d0be-4b34-a127-7f42c59b487a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:04:07.290617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7dab6-8bcc-48b2-97da-b4ca41cb2067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:04:07.291256 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7dab6-8bcc-48b2-97da-b4ca41cb2067 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:07.291530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7dab6-8bcc-48b2-97da-b4ca41cb2067 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:07.291798 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7dab6-8bcc-48b2-97da-b4ca41cb2067 None admin] PATH_INFO: `/v3/domains/d09813324c1b4d34b75ddc2495666830` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:07.292886 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7dab6-8bcc-48b2-97da-b4ca41cb2067 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d09813324c1b4d34b75ddc2495666830)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:04:07.294300 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7dab6-8bcc-48b2-97da-b4ca41cb2067 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:04:07.295875 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 595/1176] 10.222.0.46 () {56 vars in 1183 bytes} [Wed Aug 10 13:04:07 2022] GET /identity/v3/domains/d09813324c1b4d34b75ddc2495666830 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:04:07.306084 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a183d-0dd0-4b05-8118-21899fa8c248 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:04:07.404244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a183d-0dd0-4b05-8118-21899fa8c248 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:04:07.436824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdab9e3-5d08-48ea-94da-f10e728c8170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:04:07.437416 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdab9e3-5d08-48ea-94da-f10e728c8170 None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:07.437691 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdab9e3-5d08-48ea-94da-f10e728c8170 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:07.437958 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdab9e3-5d08-48ea-94da-f10e728c8170 None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:07.438616 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdab9e3-5d08-48ea-94da-f10e728c8170 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:04:07.440054 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdab9e3-5d08-48ea-94da-f10e728c8170 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:04:07.460154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 582/1177] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 10 13:04:07 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:04:09.539486 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66bd17-0ffa-404f-9028-2944fcb763c7 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:09.540095 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66bd17-0ffa-404f-9028-2944fcb763c7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:09.540095 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66bd17-0ffa-404f-9028-2944fcb763c7 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:09.541262 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 596/1178] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:04:09.546486 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8267b-d748-4012-a923-8010023870d0 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:09.546903 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8267b-d748-4012-a923-8010023870d0 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:09.547055 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8267b-d748-4012-a923-8010023870d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:09.565246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-49c8267b-d748-4012-a923-8010023870d0 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:04:09.566427 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-49c8267b-d748-4012-a923-8010023870d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:04:09.581065 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:09.635127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 583/1179] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:04:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:04:09.659034 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66bd17-0ffa-404f-9028-2944fcb763c7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:04:09.668438 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:09.761637 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66bd17-0ffa-404f-9028-2944fcb763c7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:04:09.794447 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47497d5d-d4c8-4843-b2c3-8830f9078290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:04:09.795023 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47497d5d-d4c8-4843-b2c3-8830f9078290 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:09.795305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47497d5d-d4c8-4843-b2c3-8830f9078290 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:09.795577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47497d5d-d4c8-4843-b2c3-8830f9078290 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:09.806606 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47497d5d-d4c8-4843-b2c3-8830f9078290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:04:09.811331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-47497d5d-d4c8-4843-b2c3-8830f9078290 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:04:09.811331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:04:09.811331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:04:09.811331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:04:09.811331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:04:09.811331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:04:09.811331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:04:09.811331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:04:09.811331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:04:09.811331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:04:09.811331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:04:09.811331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:04:09.811331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:04:09.811331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:04:09.811331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:04:09.811331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:04:09.812530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:04:09.812530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:04:09.812530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:04:09.812530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:04:09.812530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:04:09.812530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:04:09.812530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:04:09.812530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:04:09.812530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:04:09.812530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:04:09.812530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:04:09.812530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:04:09.812530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:04:09.812530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:04:09.812530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:04:09.812530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:04:09.814177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:04:09.814177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:04:09.814177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:04:09.814177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:04:09.814177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:04:09.814177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:04:09.814177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:04:09.814177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:04:09.814177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:04:09.814177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:04:09.814177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:04:09.814177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:04:09.814177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 597/1180] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:04:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:04:09.819206 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8267b-d748-4012-a923-8010023870d0 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:04:09.924637 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8267b-d748-4012-a923-8010023870d0 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:04:09.958031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799791e-2b99-4e58-b4d0-d70e11940da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:04:09.958629 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799791e-2b99-4e58-b4d0-d70e11940da6 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:09.958908 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799791e-2b99-4e58-b4d0-d70e11940da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:09.959205 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799791e-2b99-4e58-b4d0-d70e11940da6 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:09.959862 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799791e-2b99-4e58-b4d0-d70e11940da6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:04:09.960167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799791e-2b99-4e58-b4d0-d70e11940da6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:04:09.961521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799791e-2b99-4e58-b4d0-d70e11940da6 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:04:09.969713 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 584/1181] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:04:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:04:09.975612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47497d5d-d4c8-4843-b2c3-8830f9078290 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:04:10.043709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:10.077920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47497d5d-d4c8-4843-b2c3-8830f9078290 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:04:10.110748 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c044db-384e-4e7e-b926-1cd3da6eec0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:04:10.111386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c044db-384e-4e7e-b926-1cd3da6eec0c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:10.111665 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c044db-384e-4e7e-b926-1cd3da6eec0c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:10.111935 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c044db-384e-4e7e-b926-1cd3da6eec0c None admin] PATH_INFO: `/v3/users/dcc9fb4b36f64925a9a0437cb842e74c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:10.125221 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c044db-384e-4e7e-b926-1cd3da6eec0c None admin] RBAC: Authorizing `identity:get_user(user_id=dcc9fb4b36f64925a9a0437cb842e74c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:04:10.127295 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c044db-384e-4e7e-b926-1cd3da6eec0c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:04:10.128900 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 598/1182] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:04:09 2022] GET /identity/v3/users/dcc9fb4b36f64925a9a0437cb842e74c => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:04:10.134827 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799791e-2b99-4e58-b4d0-d70e11940da6 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:04:10.149888 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:10.231775 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799791e-2b99-4e58-b4d0-d70e11940da6 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:04:10.264022 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf60bb-9ce8-4add-96f2-fb78d88c3f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:04:10.264620 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf60bb-9ce8-4add-96f2-fb78d88c3f9e None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:10.264897 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf60bb-9ce8-4add-96f2-fb78d88c3f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:10.265164 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf60bb-9ce8-4add-96f2-fb78d88c3f9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:10.332022 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf60bb-9ce8-4add-96f2-fb78d88c3f9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:04:10.333363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf60bb-9ce8-4add-96f2-fb78d88c3f9e None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:04:10.346793 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:10.430744 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 585/1183] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:04:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 13:04:10.436717 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c044db-384e-4e7e-b926-1cd3da6eec0c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:04:10.533509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c044db-384e-4e7e-b926-1cd3da6eec0c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:04:10.556367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:10.567774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85404d4c-3a23-4fc5-977c-b9992d089e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:04:10.568396 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85404d4c-3a23-4fc5-977c-b9992d089e15 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:10.568677 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85404d4c-3a23-4fc5-977c-b9992d089e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:10.568946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85404d4c-3a23-4fc5-977c-b9992d089e15 None admin] PATH_INFO: `/v3/projects/90beabf3b7f544fea4f41877f3934ba4` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:10.570026 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85404d4c-3a23-4fc5-977c-b9992d089e15 None admin] RBAC: Authorizing `identity:get_project(project_id=90beabf3b7f544fea4f41877f3934ba4)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:04:10.571480 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85404d4c-3a23-4fc5-977c-b9992d089e15 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:04:10.573087 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 599/1184] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:04:10 2022] GET /identity/v3/projects/90beabf3b7f544fea4f41877f3934ba4 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:04:10.579931 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf60bb-9ce8-4add-96f2-fb78d88c3f9e None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:04:10.680778 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf60bb-9ce8-4add-96f2-fb78d88c3f9e None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:04:10.694030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:10.715121 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659e65f-0b84-4941-9568-d5c5fd562e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:04:10.715709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659e65f-0b84-4941-9568-d5c5fd562e89 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:10.715986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659e65f-0b84-4941-9568-d5c5fd562e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:10.716259 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659e65f-0b84-4941-9568-d5c5fd562e89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:10.716965 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659e65f-0b84-4941-9568-d5c5fd562e89 None admin] RBAC: Adding query filter params (role.id=d9c9200468cb4f7ab6a23882bfb1f062, scope.project.id=90beabf3b7f544fea4f41877f3934ba4, user.id=dcc9fb4b36f64925a9a0437cb842e74c) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:04:10.717272 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659e65f-0b84-4941-9568-d5c5fd562e89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:04:10.718947 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659e65f-0b84-4941-9568-d5c5fd562e89 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:04:10.724188 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 586/1185] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:04:10 2022] GET /identity/v3/role_assignments?user.id=dcc9fb4b36f64925a9a0437cb842e74c&scope.project.id=90beabf3b7f544fea4f41877f3934ba4&role.id=d9c9200468cb4f7ab6a23882bfb1f062 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:04:12.711545 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4c17c-3a5e-419a-b7ac-7bccc34e4819 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:12.712102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4c17c-3a5e-419a-b7ac-7bccc34e4819 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:12.712102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4c17c-3a5e-419a-b7ac-7bccc34e4819 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:12.713409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 600/1186] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:04:12.718832 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba542a2-2d69-41fc-801d-e7b1b7e66c88 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:12.719828 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba542a2-2d69-41fc-801d-e7b1b7e66c88 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:12.719929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba542a2-2d69-41fc-801d-e7b1b7e66c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:12.738071 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-bba542a2-2d69-41fc-801d-e7b1b7e66c88 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:04:12.739487 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-bba542a2-2d69-41fc-801d-e7b1b7e66c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:04:12.805142 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 587/1187] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:04:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:04:12.827126 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4c17c-3a5e-419a-b7ac-7bccc34e4819 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:04:12.929828 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4c17c-3a5e-419a-b7ac-7bccc34e4819 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:04:12.963354 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd08e26-e4f7-4229-8e42-ea8797aa3e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:04:12.963906 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd08e26-e4f7-4229-8e42-ea8797aa3e3c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:12.964187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd08e26-e4f7-4229-8e42-ea8797aa3e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:12.964460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd08e26-e4f7-4229-8e42-ea8797aa3e3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:12.975192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd08e26-e4f7-4229-8e42-ea8797aa3e3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:04:12.979931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-1bd08e26-e4f7-4229-8e42-ea8797aa3e3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:04:12.979931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:04:12.979931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:04:12.979931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:04:12.979931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:04:12.979931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:04:12.979931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:04:12.979931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:04:12.979931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:04:12.979931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:04:12.979931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:04:12.979931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:04:12.979931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:04:12.979931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:04:12.979931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:04:12.979931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:04:12.981069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:04:12.981069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:04:12.981069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:04:12.981069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:04:12.981069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:04:12.981069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:04:12.981069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:04:12.981069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:04:12.981069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:04:12.981069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:04:12.981069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:04:12.981069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:04:12.981069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:04:12.981069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:04:12.981069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:04:12.981069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:04:12.982105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:04:12.982105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:04:12.982105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:04:12.982105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:04:12.982105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:04:12.982105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:04:12.982105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:04:12.982105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:04:12.982105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:04:12.982105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:04:12.982105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:04:12.982105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:04:12.982105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 601/1188] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:04:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:04:12.987171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba542a2-2d69-41fc-801d-e7b1b7e66c88 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:04:13.084807 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba542a2-2d69-41fc-801d-e7b1b7e66c88 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:04:13.092085 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:13.119135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e337bb-50f5-47ef-9d3a-7917cdc10744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:04:13.119737 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e337bb-50f5-47ef-9d3a-7917cdc10744 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:13.120015 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e337bb-50f5-47ef-9d3a-7917cdc10744 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:13.120317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e337bb-50f5-47ef-9d3a-7917cdc10744 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:13.120971 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e337bb-50f5-47ef-9d3a-7917cdc10744 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:04:13.121272 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e337bb-50f5-47ef-9d3a-7917cdc10744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:04:13.122623 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e337bb-50f5-47ef-9d3a-7917cdc10744 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:04:13.130465 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 588/1189] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:04:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:04:13.136721 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd08e26-e4f7-4229-8e42-ea8797aa3e3c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:04:13.189106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:13.235422 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd08e26-e4f7-4229-8e42-ea8797aa3e3c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:04:13.271646 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34153138-bbb3-4bb1-b403-2a40ea211c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:04:13.272424 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34153138-bbb3-4bb1-b403-2a40ea211c6b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:13.272703 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34153138-bbb3-4bb1-b403-2a40ea211c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:13.272976 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34153138-bbb3-4bb1-b403-2a40ea211c6b None admin] PATH_INFO: `/v3/users/dcc9fb4b36f64925a9a0437cb842e74c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:13.274105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34153138-bbb3-4bb1-b403-2a40ea211c6b None admin] RBAC: Authorizing `identity:get_user(user_id=dcc9fb4b36f64925a9a0437cb842e74c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:04:13.275594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34153138-bbb3-4bb1-b403-2a40ea211c6b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:04:13.277191 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 602/1190] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:04:13 2022] GET /identity/v3/users/dcc9fb4b36f64925a9a0437cb842e74c => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:04:13.283569 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e337bb-50f5-47ef-9d3a-7917cdc10744 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:04:13.387230 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e337bb-50f5-47ef-9d3a-7917cdc10744 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:04:13.420716 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e444e5b-3ac6-4e57-886a-94e689fbf821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:04:13.421339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e444e5b-3ac6-4e57-886a-94e689fbf821 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:13.421612 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e444e5b-3ac6-4e57-886a-94e689fbf821 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:13.421882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e444e5b-3ac6-4e57-886a-94e689fbf821 None admin] PATH_INFO: `/v3/projects/90beabf3b7f544fea4f41877f3934ba4` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:13.423092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e444e5b-3ac6-4e57-886a-94e689fbf821 None admin] RBAC: Authorizing `identity:get_project(project_id=90beabf3b7f544fea4f41877f3934ba4)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:04:13.424443 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e444e5b-3ac6-4e57-886a-94e689fbf821 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:04:13.426057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 589/1191] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:04:13 2022] GET /identity/v3/projects/90beabf3b7f544fea4f41877f3934ba4 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:04:13.432039 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34153138-bbb3-4bb1-b403-2a40ea211c6b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:04:13.528684 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34153138-bbb3-4bb1-b403-2a40ea211c6b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:04:13.548879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:13.565293 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f9c9b-6e1f-42d9-9e40-16ce656a9a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:04:13.565949 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f9c9b-6e1f-42d9-9e40-16ce656a9a81 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:13.566231 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f9c9b-6e1f-42d9-9e40-16ce656a9a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:13.566502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f9c9b-6e1f-42d9-9e40-16ce656a9a81 None admin] PATH_INFO: `/v3/projects/90beabf3b7f544fea4f41877f3934ba4/users/dcc9fb4b36f64925a9a0437cb842e74c/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:13.568446 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f9c9b-6e1f-42d9-9e40-16ce656a9a81 None admin] RBAC: Authorizing `identity:create_grant(project_id=90beabf3b7f544fea4f41877f3934ba4, user_id=dcc9fb4b36f64925a9a0437cb842e74c, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:04:13.569884 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f9c9b-6e1f-42d9-9e40-16ce656a9a81 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:04:13.583332 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 603/1192] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:04:13 2022] PUT /identity/v3/projects/90beabf3b7f544fea4f41877f3934ba4/users/dcc9fb4b36f64925a9a0437cb842e74c/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:04:15.591980 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89900b1f-ffee-483a-bb00-a087cd97184b None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:15.592796 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89900b1f-ffee-483a-bb00-a087cd97184b None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:15.592796 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89900b1f-ffee-483a-bb00-a087cd97184b None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:15.594653 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 590/1193] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:04:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:04:15.599809 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837a5e0-e6aa-4684-89c2-4c5a4dec6a0a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:15.600212 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837a5e0-e6aa-4684-89c2-4c5a4dec6a0a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:15.600348 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837a5e0-e6aa-4684-89c2-4c5a4dec6a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:15.619463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5837a5e0-e6aa-4684-89c2-4c5a4dec6a0a None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:04:15.620660 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5837a5e0-e6aa-4684-89c2-4c5a4dec6a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:04:15.686590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 604/1194] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:04:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:04:15.709752 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89900b1f-ffee-483a-bb00-a087cd97184b None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:04:15.745610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:15.809115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89900b1f-ffee-483a-bb00-a087cd97184b None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:04:15.841161 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74219a-6a86-4cda-b8bd-9e22ec029964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:04:15.841767 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74219a-6a86-4cda-b8bd-9e22ec029964 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:15.842091 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74219a-6a86-4cda-b8bd-9e22ec029964 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:15.842306 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74219a-6a86-4cda-b8bd-9e22ec029964 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:15.853333 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74219a-6a86-4cda-b8bd-9e22ec029964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:04:15.857943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-2e74219a-6a86-4cda-b8bd-9e22ec029964 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:04:15.857943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:04:15.857943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:04:15.857943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:04:15.857943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:04:15.857943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:04:15.857943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:04:15.857943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:04:15.857943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:04:15.857943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:04:15.857943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:04:15.857943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:04:15.857943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:04:15.857943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:04:15.857943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:04:15.857943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:04:15.859038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:04:15.859038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:04:15.859038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:04:15.859038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:04:15.859038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:04:15.859038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:04:15.859038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:04:15.859038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:04:15.859038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:04:15.859038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:04:15.859038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:04:15.859038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:04:15.859038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:04:15.859038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:04:15.859038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:04:15.859038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:04:15.860860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:04:15.860860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:04:15.860860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:04:15.860860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:04:15.860860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:04:15.860860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:04:15.860860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:04:15.860860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:04:15.860860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:04:15.860860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:04:15.860860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:04:15.860860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:04:15.860860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 591/1195] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:04:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:04:15.865709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837a5e0-e6aa-4684-89c2-4c5a4dec6a0a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:04:15.960110 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837a5e0-e6aa-4684-89c2-4c5a4dec6a0a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:04:15.971728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:15.997081 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdf2dc-fe04-463a-8f57-db000ffcdcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:04:15.997694 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdf2dc-fe04-463a-8f57-db000ffcdcf5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:15.997973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdf2dc-fe04-463a-8f57-db000ffcdcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:15.998247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdf2dc-fe04-463a-8f57-db000ffcdcf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:15.998912 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdf2dc-fe04-463a-8f57-db000ffcdcf5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:04:15.999257 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdf2dc-fe04-463a-8f57-db000ffcdcf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:04:16.000688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdf2dc-fe04-463a-8f57-db000ffcdcf5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:04:16.008969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 605/1196] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:04:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:04:16.014732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74219a-6a86-4cda-b8bd-9e22ec029964 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:04:16.111909 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:16.118520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74219a-6a86-4cda-b8bd-9e22ec029964 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:04:16.152242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e0bc4-f17e-44de-bc8d-7a0e666cb80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:04:16.152851 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e0bc4-f17e-44de-bc8d-7a0e666cb80b None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:16.153126 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e0bc4-f17e-44de-bc8d-7a0e666cb80b None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:16.153391 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e0bc4-f17e-44de-bc8d-7a0e666cb80b None admin] PATH_INFO: `/v3/users/dcc9fb4b36f64925a9a0437cb842e74c` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:16.154479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e0bc4-f17e-44de-bc8d-7a0e666cb80b None admin] RBAC: Authorizing `identity:get_user(user_id=dcc9fb4b36f64925a9a0437cb842e74c)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:04:16.155903 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e0bc4-f17e-44de-bc8d-7a0e666cb80b None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:04:16.158083 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 592/1197] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 10 13:04:16 2022] GET /identity/v3/users/dcc9fb4b36f64925a9a0437cb842e74c => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:04:16.163953 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdf2dc-fe04-463a-8f57-db000ffcdcf5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:04:16.258155 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdf2dc-fe04-463a-8f57-db000ffcdcf5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:04:16.290741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01739aa-e755-442e-b3b6-ddd7177c291b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:04:16.291363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01739aa-e755-442e-b3b6-ddd7177c291b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:16.291637 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01739aa-e755-442e-b3b6-ddd7177c291b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:16.291904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01739aa-e755-442e-b3b6-ddd7177c291b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:16.330800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:16.356839 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01739aa-e755-442e-b3b6-ddd7177c291b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:04:16.358263 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01739aa-e755-442e-b3b6-ddd7177c291b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:04:16.453591 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 606/1198] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:04:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 13:04:16.459954 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e0bc4-f17e-44de-bc8d-7a0e666cb80b None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:04:16.556350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e0bc4-f17e-44de-bc8d-7a0e666cb80b None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:04:16.588821 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ee514-e47c-4227-85c8-7552cfe262af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:04:16.589436 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ee514-e47c-4227-85c8-7552cfe262af None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:16.589707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ee514-e47c-4227-85c8-7552cfe262af None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:16.589973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ee514-e47c-4227-85c8-7552cfe262af None admin] PATH_INFO: `/v3/projects/90beabf3b7f544fea4f41877f3934ba4` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:16.591083 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ee514-e47c-4227-85c8-7552cfe262af None admin] RBAC: Authorizing `identity:get_project(project_id=90beabf3b7f544fea4f41877f3934ba4)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:04:16.592754 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ee514-e47c-4227-85c8-7552cfe262af None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:04:16.594896 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 593/1199] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 10 13:04:16 2022] GET /identity/v3/projects/90beabf3b7f544fea4f41877f3934ba4 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:04:16.601183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01739aa-e755-442e-b3b6-ddd7177c291b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:04:16.671599 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:16.700820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01739aa-e755-442e-b3b6-ddd7177c291b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:04:16.734661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdd934-7644-4b98-99e5-2ad73eab0b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:04:16.735213 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdd934-7644-4b98-99e5-2ad73eab0b5b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:04:16.735495 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdd934-7644-4b98-99e5-2ad73eab0b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:04:16.735768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdd934-7644-4b98-99e5-2ad73eab0b5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:04:16.736486 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabdd934-7644-4b98-99e5-2ad73eab0b5b None admin] RBAC: Adding query filter params (role.id=d9c9200468cb4f7ab6a23882bfb1f062, scope.project.id=90beabf3b7f544fea4f41877f3934ba4, user.id=dcc9fb4b36f64925a9a0437cb842e74c) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:04:16.736793 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabdd934-7644-4b98-99e5-2ad73eab0b5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:04:16.738214 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabdd934-7644-4b98-99e5-2ad73eab0b5b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:04:16.743858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 607/1200] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:04:16 2022] GET /identity/v3/role_assignments?user.id=dcc9fb4b36f64925a9a0437cb842e74c&scope.project.id=90beabf3b7f544fea4f41877f3934ba4&role.id=d9c9200468cb4f7ab6a23882bfb1f062 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:04:26.584873 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=84 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:26.741756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=32 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:16.343559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc07dc3-14ec-4be9-b558-d8c6ceba8627 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:16.344865 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc07dc3-14ec-4be9-b558-d8c6ceba8627 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:16.344865 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc07dc3-14ec-4be9-b558-d8c6ceba8627 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:16.346348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 594/1201] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:05:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:05:16.358666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763de68-a299-4f82-8a83-6326e3dc9297 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:16.359623 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763de68-a299-4f82-8a83-6326e3dc9297 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:16.360370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763de68-a299-4f82-8a83-6326e3dc9297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:16.396072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c763de68-a299-4f82-8a83-6326e3dc9297 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:05:16.398585 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c763de68-a299-4f82-8a83-6326e3dc9297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:05:16.547181 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 608/1202] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:05:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:05:16.584919 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc07dc3-14ec-4be9-b558-d8c6ceba8627 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:16.782685 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc07dc3-14ec-4be9-b558-d8c6ceba8627 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:16.850592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b79b61-36c2-421f-b60c-6a56b73ef943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:16.851268 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b79b61-36c2-421f-b60c-6a56b73ef943 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:16.851564 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b79b61-36c2-421f-b60c-6a56b73ef943 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:16.851828 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b79b61-36c2-421f-b60c-6a56b73ef943 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:16.866066 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b79b61-36c2-421f-b60c-6a56b73ef943 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:16.867596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b79b61-36c2-421f-b60c-6a56b73ef943 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:16.887678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-57b79b61-36c2-421f-b60c-6a56b73ef943 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:16.887678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:16.887678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:16.887678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:16.887678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:16.887678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:16.887678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:16.887678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:16.887678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:16.887678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:16.887678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:16.887678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:16.887678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:05:16.887678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:05:16.887678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:05:16.887678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:05:16.889837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:16.889837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:16.889837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:16.889837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:16.889837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:16.889837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:16.889837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:16.889837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:16.889837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:16.889837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:16.889837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:16.889837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:16.889837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:16.889837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:16.889837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:16.889837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:16.889837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:05:16.891814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:05:16.891814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:16.891814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:05:16.891814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 595/1203] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:16.896802 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763de68-a299-4f82-8a83-6326e3dc9297 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:17.160488 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763de68-a299-4f82-8a83-6326e3dc9297 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:17.244541 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:17.259540 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9920fbe-1b07-4edf-a5e4-8ca99525e1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:17.260757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9920fbe-1b07-4edf-a5e4-8ca99525e1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:17.261292 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9920fbe-1b07-4edf-a5e4-8ca99525e1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:17.262129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9920fbe-1b07-4edf-a5e4-8ca99525e1d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:17.264180 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9920fbe-1b07-4edf-a5e4-8ca99525e1d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:17.264778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9920fbe-1b07-4edf-a5e4-8ca99525e1d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:17.268296 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9920fbe-1b07-4edf-a5e4-8ca99525e1d2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:17.307636 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 609/1204] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:17.309897 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b79b61-36c2-421f-b60c-6a56b73ef943 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:17.425709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:17.539415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b79b61-36c2-421f-b60c-6a56b73ef943 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:17.617219 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9373a5b-febe-4938-be61-c627654aeee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:17.618458 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9373a5b-febe-4938-be61-c627654aeee6 None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:17.618931 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9373a5b-febe-4938-be61-c627654aeee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:17.619548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9373a5b-febe-4938-be61-c627654aeee6 None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:17.621071 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9373a5b-febe-4938-be61-c627654aeee6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:17.625129 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9373a5b-febe-4938-be61-c627654aeee6 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:17.660735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 596/1205] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 10 13:05:17 2022] POST /identity/v3/users => generated 251 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:05:20.336792 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ede02-2f71-4ef0-960f-9bfdbc064757 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:20.337584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ede02-2f71-4ef0-960f-9bfdbc064757 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:20.338003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ede02-2f71-4ef0-960f-9bfdbc064757 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:20.340834 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 610/1206] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:05:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:05:20.347470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08ed0d-a422-47be-80e4-fabab528787a None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:20.348300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08ed0d-a422-47be-80e4-fabab528787a None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:20.348300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08ed0d-a422-47be-80e4-fabab528787a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:20.369443 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-4e08ed0d-a422-47be-80e4-fabab528787a None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:05:20.371441 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-4e08ed0d-a422-47be-80e4-fabab528787a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:05:20.461209 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 597/1207] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:05:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:05:20.501904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ede02-2f71-4ef0-960f-9bfdbc064757 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:20.688541 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ede02-2f71-4ef0-960f-9bfdbc064757 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:20.732688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb37c0e-8b54-4b07-9531-c592ae2058db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:20.733337 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb37c0e-8b54-4b07-9531-c592ae2058db None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:20.733622 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb37c0e-8b54-4b07-9531-c592ae2058db None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:20.733924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb37c0e-8b54-4b07-9531-c592ae2058db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:20.751964 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb37c0e-8b54-4b07-9531-c592ae2058db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:05:20.756962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-1fb37c0e-8b54-4b07-9531-c592ae2058db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:05:20.756962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:20.756962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:20.756962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:20.756962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:20.756962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:20.756962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:20.756962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:20.756962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:20.756962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:20.756962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:20.756962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:20.756962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:05:20.756962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:05:20.756962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:05:20.756962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:05:20.758236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:05:20.758236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:05:20.758236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:05:20.758236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:05:20.758236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:20.758236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:20.758236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:20.758236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:20.758236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:20.758236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:20.758236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:20.758236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:20.758236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:20.758236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:20.758236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:20.758236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:20.759330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:20.759330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:20.759330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:20.759330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:20.759330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:05:20.759330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:05:20.759330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:05:20.759330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:05:20.759330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:05:20.759330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:05:20.759330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:05:20.759330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:05:20.767798 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 611/1208] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:05:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:20.768137 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08ed0d-a422-47be-80e4-fabab528787a None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:20.820632 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:20.892935 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08ed0d-a422-47be-80e4-fabab528787a None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:20.937877 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d1a69-2f61-4ef1-87c2-530bb84a0951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:20.939724 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d1a69-2f61-4ef1-87c2-530bb84a0951 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:20.940393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d1a69-2f61-4ef1-87c2-530bb84a0951 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:20.941208 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d1a69-2f61-4ef1-87c2-530bb84a0951 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:20.943223 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d1a69-2f61-4ef1-87c2-530bb84a0951 None admin] RBAC: Adding query filter params (name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:20.943937 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d1a69-2f61-4ef1-87c2-530bb84a0951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:20.948576 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d1a69-2f61-4ef1-87c2-530bb84a0951 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:20.970238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 598/1209] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 10 13:05:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:20.977252 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb37c0e-8b54-4b07-9531-c592ae2058db None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:21.049671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:21.136001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb37c0e-8b54-4b07-9531-c592ae2058db None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:21.209719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d4965-f0a1-4a9f-8956-a7c93fa8865d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:21.210681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d4965-f0a1-4a9f-8956-a7c93fa8865d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:21.211183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d4965-f0a1-4a9f-8956-a7c93fa8865d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:21.211649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d4965-f0a1-4a9f-8956-a7c93fa8865d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:21.232198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d4965-f0a1-4a9f-8956-a7c93fa8865d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:21.236184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d4965-f0a1-4a9f-8956-a7c93fa8865d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:21.258710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5e3d4965-f0a1-4a9f-8956-a7c93fa8865d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:21.258710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:21.258710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:21.258710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:21.258710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:21.258710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:21.258710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:21.258710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:21.258710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:21.258710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:21.258710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:21.258710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:21.258710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:05:21.258710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:05:21.258710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:05:21.258710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:05:21.262139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:21.262139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:21.262139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:21.262139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:21.262139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:21.262139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:21.262139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:21.262139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:21.262139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:21.262139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:21.262139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:21.262139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:21.262139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:21.262139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:21.262139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:21.262139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:21.262139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:05:21.263921 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:05:21.263921 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:21.263921 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:05:21.263921 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 612/1210] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:05:21.269574 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d1a69-2f61-4ef1-87c2-530bb84a0951 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:21.464707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:21.473779 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d1a69-2f61-4ef1-87c2-530bb84a0951 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:21.525723 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2cde3-d0d2-4c3d-bfbd-9a4bc03b208d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:21.526507 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2cde3-d0d2-4c3d-bfbd-9a4bc03b208d None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:21.526884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2cde3-d0d2-4c3d-bfbd-9a4bc03b208d None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:21.527353 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2cde3-d0d2-4c3d-bfbd-9a4bc03b208d None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:21.528458 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2cde3-d0d2-4c3d-bfbd-9a4bc03b208d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:21.529014 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2cde3-d0d2-4c3d-bfbd-9a4bc03b208d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:21.530778 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2cde3-d0d2-4c3d-bfbd-9a4bc03b208d None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:21.555114 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 599/1211] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:21.558180 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d4965-f0a1-4a9f-8956-a7c93fa8865d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:21.752403 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d4965-f0a1-4a9f-8956-a7c93fa8865d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:21.753199 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:21.813207 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689065c4-bba9-494a-b70d-bc972ca4d74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:21.814219 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689065c4-bba9-494a-b70d-bc972ca4d74e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:21.814667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689065c4-bba9-494a-b70d-bc972ca4d74e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:21.815212 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689065c4-bba9-494a-b70d-bc972ca4d74e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:21.831647 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689065c4-bba9-494a-b70d-bc972ca4d74e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:21.834293 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689065c4-bba9-494a-b70d-bc972ca4d74e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:21.855980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-689065c4-bba9-494a-b70d-bc972ca4d74e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 13:05:21.855980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:21.855980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:21.855980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:21.855980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:21.855980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:21.855980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:21.855980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:21.855980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:21.855980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:21.855980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:21.855980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:21.855980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:05:21.855980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:05:21.855980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:05:21.855980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:05:21.858418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:21.858418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:21.858418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:05:21.858418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:05:21.858418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:05:21.858418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:05:21.858418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:21.858418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:21.858418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:21.858418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:21.858418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:21.858418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:21.858418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:21.858418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:21.858418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:21.858418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:21.858418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:21.858418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:21.860275 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:21.860275 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:21.860275 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:05:21.860275 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:05:21.860275 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:05:21.860275 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:05:21.860275 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:05:21.860275 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:05:21.860275 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 13:05:21.860275 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:05:21.860275 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 613/1212] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:05:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:21.867970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2cde3-d0d2-4c3d-bfbd-9a4bc03b208d None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:22.046809 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2cde3-d0d2-4c3d-bfbd-9a4bc03b208d None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:22.115413 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b8079-a48f-4c3a-9674-79cde8d8b15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:22.116657 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b8079-a48f-4c3a-9674-79cde8d8b15b None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:22.117049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b8079-a48f-4c3a-9674-79cde8d8b15b None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:22.118149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b8079-a48f-4c3a-9674-79cde8d8b15b None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:22.119748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b8079-a48f-4c3a-9674-79cde8d8b15b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:22.120278 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b8079-a48f-4c3a-9674-79cde8d8b15b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:22.123090 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b8079-a48f-4c3a-9674-79cde8d8b15b None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:22.154801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 600/1213] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Aug 10 13:05:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:22.165967 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689065c4-bba9-494a-b70d-bc972ca4d74e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:22.335624 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689065c4-bba9-494a-b70d-bc972ca4d74e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:22.401141 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f4be5-669c-47c4-8eb8-ea1bf4346009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:22.401912 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f4be5-669c-47c4-8eb8-ea1bf4346009 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:22.402257 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f4be5-669c-47c4-8eb8-ea1bf4346009 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:22.402713 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f4be5-669c-47c4-8eb8-ea1bf4346009 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:22.451214 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:22.526557 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f4be5-669c-47c4-8eb8-ea1bf4346009 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:22.529936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f4be5-669c-47c4-8eb8-ea1bf4346009 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:22.700426 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 614/1214] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:05:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 13:05:22.708222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b8079-a48f-4c3a-9674-79cde8d8b15b None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:22.734511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:22.860135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b8079-a48f-4c3a-9674-79cde8d8b15b None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:22.906717 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e236397-f616-403d-8a2a-6e8e361fc702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:22.907451 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e236397-f616-403d-8a2a-6e8e361fc702 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:22.907772 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e236397-f616-403d-8a2a-6e8e361fc702 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:22.907991 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e236397-f616-403d-8a2a-6e8e361fc702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:22.923314 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e236397-f616-403d-8a2a-6e8e361fc702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:22.924889 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e236397-f616-403d-8a2a-6e8e361fc702 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:22.946470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-0e236397-f616-403d-8a2a-6e8e361fc702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:22.946470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:22.946470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:22.946470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:22.946470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:22.946470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:22.946470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:22.946470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:22.946470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:22.946470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:22.946470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:22.946470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:22.946470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:05:22.946470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:05:22.946470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:05:22.946470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:05:22.948604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:22.948604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:22.948604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:22.948604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:22.948604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:22.948604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:22.948604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:22.948604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:22.948604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:22.948604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:22.948604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:22.948604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:22.948604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:22.948604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:22.948604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:22.948604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:22.948604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:05:22.951510 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:05:22.951510 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:22.951510 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:05:22.951510 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 601/1215] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:05:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:22.957182 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f4be5-669c-47c4-8eb8-ea1bf4346009 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:23.073021 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:23.125132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f4be5-669c-47c4-8eb8-ea1bf4346009 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:23.185534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba190f-8b5a-480f-a6d2-8ed7a6bd69b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:23.186169 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba190f-8b5a-480f-a6d2-8ed7a6bd69b6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:23.186444 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba190f-8b5a-480f-a6d2-8ed7a6bd69b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:23.186740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba190f-8b5a-480f-a6d2-8ed7a6bd69b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:23.187452 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba190f-8b5a-480f-a6d2-8ed7a6bd69b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:23.187754 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba190f-8b5a-480f-a6d2-8ed7a6bd69b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:23.189183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba190f-8b5a-480f-a6d2-8ed7a6bd69b6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:23.203366 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 615/1216] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:05:23.211790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e236397-f616-403d-8a2a-6e8e361fc702 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:23.298844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:23.338515 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e236397-f616-403d-8a2a-6e8e361fc702 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:23.380998 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554336fc-aa4e-4872-ab06-dad19c9d06e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:23.381637 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554336fc-aa4e-4872-ab06-dad19c9d06e6 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:23.381913 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554336fc-aa4e-4872-ab06-dad19c9d06e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:23.382183 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554336fc-aa4e-4872-ab06-dad19c9d06e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:23.390377 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554336fc-aa4e-4872-ab06-dad19c9d06e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:23.392075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554336fc-aa4e-4872-ab06-dad19c9d06e6 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:23.406824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-554336fc-aa4e-4872-ab06-dad19c9d06e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:05:23.406824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:23.406824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:23.406824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:23.406824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:23.406824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:23.406824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:23.406824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:23.406824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:23.406824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:23.406824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:23.406824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:23.406824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:05:23.406824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:05:23.406824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:05:23.408520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:05:23.408520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:23.408520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:23.408520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:23.408520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:23.408520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:23.408520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:23.408520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:23.408520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:23.408520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:23.408520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:23.408520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:23.408520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:23.408520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:23.408520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:23.408520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:23.408520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:23.410423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:05:23.410423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:05:23.410423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:05:23.410423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:05:23.410423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:05:23.410423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:05:23.410423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:05:23.410423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:05:23.410423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 602/1217] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:05:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:05:23.416107 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba190f-8b5a-480f-a6d2-8ed7a6bd69b6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:23.575702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba190f-8b5a-480f-a6d2-8ed7a6bd69b6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:23.626257 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:23.644568 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44f85e-155c-4ede-b9f4-b42e6cb0ec61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:23.645513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44f85e-155c-4ede-b9f4-b42e6cb0ec61 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:23.645677 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44f85e-155c-4ede-b9f4-b42e6cb0ec61 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:23.645860 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44f85e-155c-4ede-b9f4-b42e6cb0ec61 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:23.646595 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44f85e-155c-4ede-b9f4-b42e6cb0ec61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:23.647054 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44f85e-155c-4ede-b9f4-b42e6cb0ec61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:23.648994 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44f85e-155c-4ede-b9f4-b42e6cb0ec61 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:23.664787 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 616/1218] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:05:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:05:23.671423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554336fc-aa4e-4872-ab06-dad19c9d06e6 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:23.827066 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554336fc-aa4e-4872-ab06-dad19c9d06e6 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:23.882144 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:23.891362 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4eb2f1-a3f6-403a-92f0-336ab4f95e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:23.891993 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4eb2f1-a3f6-403a-92f0-336ab4f95e16 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:23.892275 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4eb2f1-a3f6-403a-92f0-336ab4f95e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:23.892624 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4eb2f1-a3f6-403a-92f0-336ab4f95e16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:23.893790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4eb2f1-a3f6-403a-92f0-336ab4f95e16 None admin] RBAC: Adding query filter params (role.id=434a1fd874d24b959bf48fe61633f240, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=15780b69faa745e9b99f1fffb6abe231) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:23.894176 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4eb2f1-a3f6-403a-92f0-336ab4f95e16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:23.895839 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4eb2f1-a3f6-403a-92f0-336ab4f95e16 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:23.902695 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 603/1219] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:05:23 2022] GET /identity/v3/role_assignments?user.id=15780b69faa745e9b99f1fffb6abe231&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=434a1fd874d24b959bf48fe61633f240 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:26.146554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a28fa-a425-44b3-92c3-abb3dcde69c9 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:26.147463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a28fa-a425-44b3-92c3-abb3dcde69c9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:26.147463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a28fa-a425-44b3-92c3-abb3dcde69c9 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:26.148815 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 617/1220] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:05:26.155597 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ca816-ff28-48a8-8cb8-66a00050f552 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:26.156454 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ca816-ff28-48a8-8cb8-66a00050f552 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:26.156454 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ca816-ff28-48a8-8cb8-66a00050f552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:26.179291 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-512ca816-ff28-48a8-8cb8-66a00050f552 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:05:26.180521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-512ca816-ff28-48a8-8cb8-66a00050f552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:05:26.299858 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 604/1221] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:05:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:05:26.339172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a28fa-a425-44b3-92c3-abb3dcde69c9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:26.506127 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a28fa-a425-44b3-92c3-abb3dcde69c9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:26.563905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45def842-5744-4f66-a089-ff5968486d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:26.564904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45def842-5744-4f66-a089-ff5968486d35 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:26.565419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45def842-5744-4f66-a089-ff5968486d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:26.565888 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45def842-5744-4f66-a089-ff5968486d35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:26.585529 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45def842-5744-4f66-a089-ff5968486d35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:05:26.593682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-45def842-5744-4f66-a089-ff5968486d35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:05:26.593682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:26.593682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:26.593682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:26.593682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:26.593682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:26.593682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:26.593682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:26.593682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:26.593682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:26.593682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:26.593682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:26.593682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:05:26.593682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:05:26.593682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:05:26.593682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:05:26.595733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:05:26.595733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:05:26.595733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:05:26.595733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:05:26.595733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:26.595733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:26.595733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:26.595733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:26.595733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:26.595733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:26.595733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:26.595733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:26.595733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:26.595733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:26.595733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:26.595733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:26.597709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:26.597709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:26.597709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:26.597709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:26.597709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:05:26.597709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:05:26.597709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:05:26.597709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:05:26.597709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:05:26.597709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:05:26.597709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:05:26.597709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:05:26.603816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 618/1222] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:05:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:26.610013 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ca816-ff28-48a8-8cb8-66a00050f552 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:26.756864 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ca816-ff28-48a8-8cb8-66a00050f552 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:26.787506 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:26.804949 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dd148-1578-490d-80e0-9ab6f266edd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:26.805657 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dd148-1578-490d-80e0-9ab6f266edd2 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:26.805977 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dd148-1578-490d-80e0-9ab6f266edd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:26.806264 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dd148-1578-490d-80e0-9ab6f266edd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:26.807460 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861dd148-1578-490d-80e0-9ab6f266edd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:26.808011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861dd148-1578-490d-80e0-9ab6f266edd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:26.810799 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861dd148-1578-490d-80e0-9ab6f266edd2 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:26.823533 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 605/1223] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 10 13:05:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:26.830151 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45def842-5744-4f66-a089-ff5968486d35 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:26.898800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:27.005706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45def842-5744-4f66-a089-ff5968486d35 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:27.044329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7590c-8d73-4624-a5b9-6c4a38723fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:27.044988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7590c-8d73-4624-a5b9-6c4a38723fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:27.045266 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7590c-8d73-4624-a5b9-6c4a38723fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:27.045537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7590c-8d73-4624-a5b9-6c4a38723fa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:27.058708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7590c-8d73-4624-a5b9-6c4a38723fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:27.060420 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7590c-8d73-4624-a5b9-6c4a38723fa9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:27.080951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-bdb7590c-8d73-4624-a5b9-6c4a38723fa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:27.080951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:27.080951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:27.080951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:27.080951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:27.080951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:27.080951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:27.080951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:27.080951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:27.080951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:27.080951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:27.080951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:27.080951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:05:27.080951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:05:27.080951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:05:27.080951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:05:27.082198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:27.082198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:27.082198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:27.082198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:27.082198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:27.082198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:27.082198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:27.082198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:27.082198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:27.082198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:27.082198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:27.082198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:27.082198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:27.082198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:27.082198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:27.082198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:27.082198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:05:27.083377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:05:27.083377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:27.083377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:05:27.087419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 619/1224] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:05:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:27.090022 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dd148-1578-490d-80e0-9ab6f266edd2 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:27.256334 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dd148-1578-490d-80e0-9ab6f266edd2 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:27.298863 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce068b29-3aaf-44c7-9973-c4abb7210650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:27.299536 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce068b29-3aaf-44c7-9973-c4abb7210650 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:27.299812 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce068b29-3aaf-44c7-9973-c4abb7210650 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:27.300085 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce068b29-3aaf-44c7-9973-c4abb7210650 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:27.300739 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce068b29-3aaf-44c7-9973-c4abb7210650 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:27.301041 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce068b29-3aaf-44c7-9973-c4abb7210650 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:27.302427 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce068b29-3aaf-44c7-9973-c4abb7210650 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:27.318279 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 606/1225] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:27.326179 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7590c-8d73-4624-a5b9-6c4a38723fa9 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:27.450770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:27.462517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7590c-8d73-4624-a5b9-6c4a38723fa9 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:27.524252 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a20f4-bc90-4a95-8a65-badfac75aa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:27.525037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a20f4-bc90-4a95-8a65-badfac75aa19 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:27.525416 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a20f4-bc90-4a95-8a65-badfac75aa19 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:27.525818 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a20f4-bc90-4a95-8a65-badfac75aa19 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:27.537924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a20f4-bc90-4a95-8a65-badfac75aa19 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:27.540779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a20f4-bc90-4a95-8a65-badfac75aa19 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:27.563830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-503a20f4-bc90-4a95-8a65-badfac75aa19 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 13:05:27.563830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:27.563830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:27.563830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:27.563830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:27.563830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:27.563830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:27.563830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:27.563830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:27.563830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:27.563830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:27.563830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:27.563830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:05:27.563830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:05:27.563830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:05:27.563830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:05:27.566000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:27.566000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:27.566000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:05:27.566000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:05:27.566000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:05:27.566000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:05:27.566000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:27.566000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:27.566000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:27.566000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:27.566000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:27.566000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:27.566000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:27.566000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:27.566000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:27.566000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:27.566000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:27.566000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:27.567903 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:27.567903 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:27.567903 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:05:27.567903 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:05:27.567903 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:05:27.567903 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:05:27.567903 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:05:27.567903 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:05:27.567903 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 13:05:27.567903 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:05:27.567903 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 620/1226] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:05:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:27.572834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce068b29-3aaf-44c7-9973-c4abb7210650 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:27.642428 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:27.717165 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce068b29-3aaf-44c7-9973-c4abb7210650 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:27.785341 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2376e-7849-4f93-a6ce-194278a3354c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:27.788385 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2376e-7849-4f93-a6ce-194278a3354c None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:27.788385 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2376e-7849-4f93-a6ce-194278a3354c None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:27.788385 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2376e-7849-4f93-a6ce-194278a3354c None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:27.789071 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2376e-7849-4f93-a6ce-194278a3354c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:27.789739 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2376e-7849-4f93-a6ce-194278a3354c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:27.793672 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2376e-7849-4f93-a6ce-194278a3354c None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:27.846149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 607/1227] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Aug 10 13:05:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:27.848073 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a20f4-bc90-4a95-8a65-badfac75aa19 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:28.022851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a20f4-bc90-4a95-8a65-badfac75aa19 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:28.076668 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efcba4-1f05-4862-9473-368cb032ed9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:28.077476 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efcba4-1f05-4862-9473-368cb032ed9d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:28.077864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efcba4-1f05-4862-9473-368cb032ed9d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:28.078241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efcba4-1f05-4862-9473-368cb032ed9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:28.102066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efcba4-1f05-4862-9473-368cb032ed9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:28.103925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efcba4-1f05-4862-9473-368cb032ed9d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:28.120846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-20efcba4-1f05-4862-9473-368cb032ed9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:28.120846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:28.120846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:28.120846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:28.120846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:28.120846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:28.120846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:28.120846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:28.120846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:28.120846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:28.120846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:28.120846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:28.120846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:05:28.120846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:05:28.120846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:05:28.120846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:05:28.123319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:28.123319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:28.123319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:28.123319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:28.123319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:28.123319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:28.123319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:28.123319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:28.123319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:28.123319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:28.123319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:28.123319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:28.123319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:28.123319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:28.123319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:28.123319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:28.123319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:05:28.125548 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:05:28.125548 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:28.125548 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:05:28.125548 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 621/1228] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:28.130296 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2376e-7849-4f93-a6ce-194278a3354c None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:28.254890 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2376e-7849-4f93-a6ce-194278a3354c None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:28.257939 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:28.310617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133944e6-6f80-40cd-a69c-bd56ee475632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:28.311563 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133944e6-6f80-40cd-a69c-bd56ee475632 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:28.312002 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133944e6-6f80-40cd-a69c-bd56ee475632 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:28.312386 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133944e6-6f80-40cd-a69c-bd56ee475632 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:28.313513 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133944e6-6f80-40cd-a69c-bd56ee475632 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:28.313919 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133944e6-6f80-40cd-a69c-bd56ee475632 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:28.315438 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133944e6-6f80-40cd-a69c-bd56ee475632 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:28.329317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 608/1229] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:05:28.339685 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efcba4-1f05-4862-9473-368cb032ed9d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:28.359905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:28.496019 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efcba4-1f05-4862-9473-368cb032ed9d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:28.549353 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a95d2-c918-411e-95b9-2966e6835875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:28.550359 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a95d2-c918-411e-95b9-2966e6835875 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:28.550789 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a95d2-c918-411e-95b9-2966e6835875 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:28.551193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a95d2-c918-411e-95b9-2966e6835875 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:28.563545 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a95d2-c918-411e-95b9-2966e6835875 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:28.565641 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a95d2-c918-411e-95b9-2966e6835875 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:28.581881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-918a95d2-c918-411e-95b9-2966e6835875 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:05:28.581881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:28.581881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:28.581881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:28.581881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:28.581881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:28.581881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:28.581881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:28.581881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:28.581881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:28.581881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:28.581881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:28.581881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:05:28.581881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:05:28.581881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:05:28.583099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:05:28.583099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:28.583099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:28.583099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:28.583099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:28.583099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:28.583099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:28.583099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:28.583099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:28.583099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:28.583099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:28.583099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:28.583099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:28.583099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:28.583099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:28.583099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:28.583099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:28.584189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:05:28.584189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:05:28.584189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:05:28.584189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:05:28.584189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:05:28.584189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:05:28.584189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:05:28.584189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:05:28.592678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 622/1230] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:05:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:28.593896 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133944e6-6f80-40cd-a69c-bd56ee475632 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:28.752463 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133944e6-6f80-40cd-a69c-bd56ee475632 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:28.823566 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdd9ac-b57b-4320-920a-0c532ffff476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:28.824652 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdd9ac-b57b-4320-920a-0c532ffff476 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:28.825694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdd9ac-b57b-4320-920a-0c532ffff476 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:28.826213 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdd9ac-b57b-4320-920a-0c532ffff476 None admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:28.827803 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cdd9ac-b57b-4320-920a-0c532ffff476 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:28.828437 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cdd9ac-b57b-4320-920a-0c532ffff476 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:28.831672 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cdd9ac-b57b-4320-920a-0c532ffff476 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:28.862185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 609/1231] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:05:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:28.868785 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a95d2-c918-411e-95b9-2966e6835875 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:28.967619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:29.030365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a95d2-c918-411e-95b9-2966e6835875 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:29.076337 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30dd62-9105-40d7-baaf-09e4ac00e2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:29.077223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30dd62-9105-40d7-baaf-09e4ac00e2a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:29.077516 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30dd62-9105-40d7-baaf-09e4ac00e2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:29.077793 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30dd62-9105-40d7-baaf-09e4ac00e2a4 None admin] PATH_INFO: `/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/15780b69faa745e9b99f1fffb6abe231/roles/434a1fd874d24b959bf48fe61633f240` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:29.101329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30dd62-9105-40d7-baaf-09e4ac00e2a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aa2ccddadb54dd9b88ccc6cec98ae37, user_id=15780b69faa745e9b99f1fffb6abe231, role_id=434a1fd874d24b959bf48fe61633f240)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:29.103256 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30dd62-9105-40d7-baaf-09e4ac00e2a4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:29.119926 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 623/1232] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:05:28 2022] PUT /identity/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/15780b69faa745e9b99f1fffb6abe231/roles/434a1fd874d24b959bf48fe61633f240 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:05:31.778916 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68c8c9-af15-4fe6-ba35-a67d5f78afaf None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:31.779681 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68c8c9-af15-4fe6-ba35-a67d5f78afaf None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:31.779914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68c8c9-af15-4fe6-ba35-a67d5f78afaf None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:31.782427 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 610/1233] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:05:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:05:31.789528 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99132f-f0e9-4806-82f7-d5773043a48b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:31.790153 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99132f-f0e9-4806-82f7-d5773043a48b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:31.790153 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99132f-f0e9-4806-82f7-d5773043a48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:31.814943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ac99132f-f0e9-4806-82f7-d5773043a48b None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:05:31.816378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ac99132f-f0e9-4806-82f7-d5773043a48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:05:31.936228 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 624/1234] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:05:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 13:05:31.969167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68c8c9-af15-4fe6-ba35-a67d5f78afaf None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:32.015992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:32.132933 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68c8c9-af15-4fe6-ba35-a67d5f78afaf None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:32.180989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2780f6-0731-4c23-a373-ba7aef9a91f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:32.181845 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2780f6-0731-4c23-a373-ba7aef9a91f6 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:32.182184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2780f6-0731-4c23-a373-ba7aef9a91f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:32.182405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2780f6-0731-4c23-a373-ba7aef9a91f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:32.199315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2780f6-0731-4c23-a373-ba7aef9a91f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:05:32.209673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-5a2780f6-0731-4c23-a373-ba7aef9a91f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:05:32.209673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:32.209673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:32.209673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:32.209673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:32.209673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:32.209673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:32.209673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:32.209673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:32.209673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:32.209673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:32.209673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:32.209673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:05:32.209673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:05:32.209673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:05:32.209673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:05:32.210952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:05:32.210952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:05:32.210952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:05:32.210952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:05:32.210952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:32.210952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:32.210952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:32.210952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:32.210952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:32.210952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:32.210952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:32.210952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:32.210952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:32.210952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:32.210952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:32.210952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:32.212031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:32.212031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:32.212031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:32.212031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:32.212031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:05:32.212031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:05:32.212031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:05:32.212031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:05:32.212031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:05:32.212031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:05:32.212031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 13:05:32.212031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:05:32.212706 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 611/1235] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 10 13:05:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:32.220495 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99132f-f0e9-4806-82f7-d5773043a48b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:32.306973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:32.415029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99132f-f0e9-4806-82f7-d5773043a48b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:32.479595 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab171d54-25f5-485c-8e10-b7d34391cc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:32.480779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab171d54-25f5-485c-8e10-b7d34391cc4e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:32.481315 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab171d54-25f5-485c-8e10-b7d34391cc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:32.481823 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab171d54-25f5-485c-8e10-b7d34391cc4e None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:32.483171 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab171d54-25f5-485c-8e10-b7d34391cc4e None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:32.483758 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab171d54-25f5-485c-8e10-b7d34391cc4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:32.486572 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab171d54-25f5-485c-8e10-b7d34391cc4e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:32.504002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 625/1236] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 10 13:05:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:32.513686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2780f6-0731-4c23-a373-ba7aef9a91f6 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:32.626785 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:32.657178 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2780f6-0731-4c23-a373-ba7aef9a91f6 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:32.727494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b3687-a0d6-423d-bd24-fc10eeb5a92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:32.728403 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b3687-a0d6-423d-bd24-fc10eeb5a92d None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:32.728869 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b3687-a0d6-423d-bd24-fc10eeb5a92d None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:32.729302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b3687-a0d6-423d-bd24-fc10eeb5a92d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:32.748443 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b3687-a0d6-423d-bd24-fc10eeb5a92d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:32.751287 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b3687-a0d6-423d-bd24-fc10eeb5a92d None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:32.779973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-436b3687-a0d6-423d-bd24-fc10eeb5a92d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:32.779973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:32.779973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:32.779973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:32.779973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:32.779973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:32.779973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:32.779973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:32.779973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:32.779973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:32.779973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:32.779973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:32.779973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:05:32.779973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:05:32.779973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:05:32.779973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:05:32.782549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:32.782549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:32.782549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:32.782549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:32.782549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:32.782549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:32.782549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:32.782549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:32.782549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:32.782549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:32.782549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:32.782549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:32.782549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:32.782549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:32.782549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:32.782549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:32.782549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:05:32.784726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:05:32.784726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:32.784726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:05:32.784726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 612/1237] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:05:32.789804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab171d54-25f5-485c-8e10-b7d34391cc4e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:32.922669 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab171d54-25f5-485c-8e10-b7d34391cc4e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:32.937650 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:32.979439 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90458e2e-18cc-4651-baea-8a5970d5a3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:32.980127 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90458e2e-18cc-4651-baea-8a5970d5a3fd None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:32.980480 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90458e2e-18cc-4651-baea-8a5970d5a3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:32.981479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90458e2e-18cc-4651-baea-8a5970d5a3fd None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:32.982733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90458e2e-18cc-4651-baea-8a5970d5a3fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:32.983229 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90458e2e-18cc-4651-baea-8a5970d5a3fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:32.985069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90458e2e-18cc-4651-baea-8a5970d5a3fd None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:33.009180 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 626/1238] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:05:33.015530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b3687-a0d6-423d-bd24-fc10eeb5a92d None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:33.148318 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b3687-a0d6-423d-bd24-fc10eeb5a92d None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:33.199084 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf88ca9-d860-41dd-a156-894d51f5a9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:33.200290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf88ca9-d860-41dd-a156-894d51f5a9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:33.200596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf88ca9-d860-41dd-a156-894d51f5a9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:33.200905 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf88ca9-d860-41dd-a156-894d51f5a9f0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:33.204971 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:33.212167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf88ca9-d860-41dd-a156-894d51f5a9f0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:33.214040 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf88ca9-d860-41dd-a156-894d51f5a9f0 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:33.228369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-ccf88ca9-d860-41dd-a156-894d51f5a9f0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 13:05:33.228369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:33.228369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:33.228369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:33.228369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:33.228369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:33.228369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:33.228369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:33.228369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:33.228369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:33.228369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:33.228369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:33.228369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:05:33.228369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:05:33.228369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:05:33.228369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:05:33.237117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:33.237117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:33.237117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:05:33.237117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:05:33.237117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:05:33.237117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:05:33.237117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:33.237117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:33.237117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:33.237117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:33.237117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:33.237117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:33.237117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:33.237117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:33.237117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:33.237117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:33.237117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:33.237117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:33.239067 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:33.239067 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:33.239067 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:05:33.239067 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:05:33.239067 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:05:33.239067 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:05:33.239067 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:05:33.239067 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:05:33.239067 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 13:05:33.239067 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:05:33.239067 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 613/1239] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:05:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:33.240242 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90458e2e-18cc-4651-baea-8a5970d5a3fd None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:33.400607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90458e2e-18cc-4651-baea-8a5970d5a3fd None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:33.455021 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689ffdf-9b15-4563-9394-2f025e976026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:33.455925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689ffdf-9b15-4563-9394-2f025e976026 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:33.456407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689ffdf-9b15-4563-9394-2f025e976026 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:33.456929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689ffdf-9b15-4563-9394-2f025e976026 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:33.458377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689ffdf-9b15-4563-9394-2f025e976026 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:33.458965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689ffdf-9b15-4563-9394-2f025e976026 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:33.469133 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689ffdf-9b15-4563-9394-2f025e976026 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:33.499333 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 627/1240] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Aug 10 13:05:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:33.506501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf88ca9-d860-41dd-a156-894d51f5a9f0 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:33.694664 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf88ca9-d860-41dd-a156-894d51f5a9f0 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:33.748778 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12dbe4-cc97-4209-8033-cb4a1d83e674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:33.749875 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12dbe4-cc97-4209-8033-cb4a1d83e674 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:33.750280 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12dbe4-cc97-4209-8033-cb4a1d83e674 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:33.750749 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12dbe4-cc97-4209-8033-cb4a1d83e674 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:33.873856 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:33.885526 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12dbe4-cc97-4209-8033-cb4a1d83e674 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:33.887455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12dbe4-cc97-4209-8033-cb4a1d83e674 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:34.051935 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 614/1241] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:05:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 13:05:34.063230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689ffdf-9b15-4563-9394-2f025e976026 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:34.100940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:34.214848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689ffdf-9b15-4563-9394-2f025e976026 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:34.271826 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64118c9d-c0c7-4cc4-80eb-500f4edbc56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:34.272585 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64118c9d-c0c7-4cc4-80eb-500f4edbc56a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:34.273056 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64118c9d-c0c7-4cc4-80eb-500f4edbc56a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:34.273414 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64118c9d-c0c7-4cc4-80eb-500f4edbc56a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:34.288641 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64118c9d-c0c7-4cc4-80eb-500f4edbc56a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:34.290426 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64118c9d-c0c7-4cc4-80eb-500f4edbc56a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:34.312483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-64118c9d-c0c7-4cc4-80eb-500f4edbc56a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:34.312483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:34.312483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:34.312483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:34.312483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:34.312483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:34.312483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:34.312483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:34.312483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:34.312483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:34.312483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:34.312483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:34.312483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:05:34.312483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:05:34.312483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:05:34.312483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:05:34.314440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:34.314440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:34.314440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:34.314440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:34.314440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:34.314440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:34.314440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:34.314440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:34.314440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:34.314440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:34.314440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:34.314440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:34.314440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:34.314440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:34.314440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:34.314440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:34.314440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:05:34.316254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:05:34.316254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:34.316254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:05:34.316254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 628/1242] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:05:34.320171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12dbe4-cc97-4209-8033-cb4a1d83e674 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:34.457175 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:34.464859 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12dbe4-cc97-4209-8033-cb4a1d83e674 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:34.510173 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d81799-f2ca-4147-8b15-3e43449f1902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:34.511248 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d81799-f2ca-4147-8b15-3e43449f1902 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:34.511645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d81799-f2ca-4147-8b15-3e43449f1902 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:34.512151 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d81799-f2ca-4147-8b15-3e43449f1902 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:34.513776 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d81799-f2ca-4147-8b15-3e43449f1902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:34.514305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d81799-f2ca-4147-8b15-3e43449f1902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:34.516151 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d81799-f2ca-4147-8b15-3e43449f1902 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:34.531502 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 615/1243] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:34.542687 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64118c9d-c0c7-4cc4-80eb-500f4edbc56a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:34.688173 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:34.729642 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64118c9d-c0c7-4cc4-80eb-500f4edbc56a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:34.780770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53501137-bc9a-41ec-9812-6e8406dee971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:34.781822 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53501137-bc9a-41ec-9812-6e8406dee971 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:34.782239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53501137-bc9a-41ec-9812-6e8406dee971 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:34.782552 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53501137-bc9a-41ec-9812-6e8406dee971 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:34.792156 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53501137-bc9a-41ec-9812-6e8406dee971 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:34.794296 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53501137-bc9a-41ec-9812-6e8406dee971 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:34.817132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-53501137-bc9a-41ec-9812-6e8406dee971 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:05:34.817132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:34.817132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:34.817132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:34.817132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:34.817132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:34.817132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:34.817132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:34.817132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:34.817132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:34.817132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:34.817132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:34.817132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:05:34.817132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:05:34.817132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:05:34.819374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:05:34.819374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:34.819374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:34.819374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:34.819374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:34.819374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:34.819374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:34.819374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:34.819374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:34.819374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:34.819374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:34.819374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:34.819374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:34.819374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:34.819374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:34.819374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:34.819374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:34.821163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:05:34.821163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:05:34.821163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:05:34.821163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:05:34.821163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:05:34.821163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:05:34.821163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:05:34.821163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:05:34.821163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 629/1244] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:05:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:34.827758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d81799-f2ca-4147-8b15-3e43449f1902 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:35.000613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d81799-f2ca-4147-8b15-3e43449f1902 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:35.054824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bee07-766a-477d-9096-a2a1c9b9ac96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:35.055805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bee07-766a-477d-9096-a2a1c9b9ac96 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:35.056346 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bee07-766a-477d-9096-a2a1c9b9ac96 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:35.056834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bee07-766a-477d-9096-a2a1c9b9ac96 None admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:35.057916 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bee07-766a-477d-9096-a2a1c9b9ac96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:35.058400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bee07-766a-477d-9096-a2a1c9b9ac96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:35.060283 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bee07-766a-477d-9096-a2a1c9b9ac96 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:35.076885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 616/1245] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:05:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:35.083962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53501137-bc9a-41ec-9812-6e8406dee971 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:35.242053 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53501137-bc9a-41ec-9812-6e8406dee971 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:35.308062 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49397af-b6ee-4584-96bf-27e4b7ba7627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:35.308707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49397af-b6ee-4584-96bf-27e4b7ba7627 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:35.308988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49397af-b6ee-4584-96bf-27e4b7ba7627 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:35.309296 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49397af-b6ee-4584-96bf-27e4b7ba7627 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:35.310118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49397af-b6ee-4584-96bf-27e4b7ba7627 None admin] RBAC: Adding query filter params (role.id=434a1fd874d24b959bf48fe61633f240, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=15780b69faa745e9b99f1fffb6abe231) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:35.310435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49397af-b6ee-4584-96bf-27e4b7ba7627 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:35.311954 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49397af-b6ee-4584-96bf-27e4b7ba7627 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:35.319150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 630/1246] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:05:35 2022] GET /identity/v3/role_assignments?user.id=15780b69faa745e9b99f1fffb6abe231&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=434a1fd874d24b959bf48fe61633f240 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:05:37.550172 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17625c57-77f4-4be3-b60e-5b9edd59aa8f None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:37.551052 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17625c57-77f4-4be3-b60e-5b9edd59aa8f None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:37.551052 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17625c57-77f4-4be3-b60e-5b9edd59aa8f None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:37.552597 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 617/1247] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:05:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:05:37.560690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc654846-faf5-48a1-84fa-fb06ac69fb2d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:37.561335 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc654846-faf5-48a1-84fa-fb06ac69fb2d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:37.561701 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc654846-faf5-48a1-84fa-fb06ac69fb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:37.571462 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:37.590419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fc654846-faf5-48a1-84fa-fb06ac69fb2d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:05:37.592851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fc654846-faf5-48a1-84fa-fb06ac69fb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:05:37.712113 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 631/1248] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:05:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:05:37.745232 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17625c57-77f4-4be3-b60e-5b9edd59aa8f None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:37.773896 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:37.943384 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17625c57-77f4-4be3-b60e-5b9edd59aa8f None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:38.023251 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4acb5-5aae-4cae-b3a5-6db2652d7bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:38.024346 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4acb5-5aae-4cae-b3a5-6db2652d7bdc None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:38.025042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4acb5-5aae-4cae-b3a5-6db2652d7bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:38.025488 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4acb5-5aae-4cae-b3a5-6db2652d7bdc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:38.048016 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4acb5-5aae-4cae-b3a5-6db2652d7bdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:05:38.059281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-a8f4acb5-5aae-4cae-b3a5-6db2652d7bdc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:05:38.059281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:38.059281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:38.059281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:38.059281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:38.059281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:38.059281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:38.059281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:38.059281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:38.059281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:38.059281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:38.059281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:38.059281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:05:38.059281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:05:38.059281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:05:38.059281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:05:38.060448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:05:38.060448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:05:38.060448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:05:38.060448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:05:38.060448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:38.060448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:38.060448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:38.060448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:38.060448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:38.060448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:38.060448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:38.060448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:38.060448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:38.060448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:38.060448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:38.060448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:38.061407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:38.061407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:38.061407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:38.061407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:38.061407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:05:38.061407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:05:38.061407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:05:38.061407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:05:38.061407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:05:38.061407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:05:38.061407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:05:38.061407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:05:38.062263 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 618/1249] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:05:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:05:38.069974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc654846-faf5-48a1-84fa-fb06ac69fb2d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:38.226991 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc654846-faf5-48a1-84fa-fb06ac69fb2d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:38.269303 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:38.278717 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a53887-1216-4b9a-b04d-687ca6b97517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:38.279368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a53887-1216-4b9a-b04d-687ca6b97517 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:38.279670 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a53887-1216-4b9a-b04d-687ca6b97517 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:38.279919 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a53887-1216-4b9a-b04d-687ca6b97517 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:38.280616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a53887-1216-4b9a-b04d-687ca6b97517 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:38.280917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a53887-1216-4b9a-b04d-687ca6b97517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:38.282351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a53887-1216-4b9a-b04d-687ca6b97517 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:38.296787 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 632/1250] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:05:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:05:38.306783 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4acb5-5aae-4cae-b3a5-6db2652d7bdc None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:38.451173 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:38.492231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4acb5-5aae-4cae-b3a5-6db2652d7bdc None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:38.543062 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc10efb-cad9-4dc4-a207-f5142024a999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:38.543959 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc10efb-cad9-4dc4-a207-f5142024a999 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:38.544372 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc10efb-cad9-4dc4-a207-f5142024a999 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:38.544720 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc10efb-cad9-4dc4-a207-f5142024a999 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:38.561768 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc10efb-cad9-4dc4-a207-f5142024a999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:38.563734 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc10efb-cad9-4dc4-a207-f5142024a999 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:38.592181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-0fc10efb-cad9-4dc4-a207-f5142024a999 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:38.592181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:38.592181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:38.592181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:38.592181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:38.592181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:38.592181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:38.592181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:38.592181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:38.592181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:38.592181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:38.592181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:38.592181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:05:38.592181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:05:38.592181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:05:38.592181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:05:38.594029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:38.594029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:38.594029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:38.594029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:38.594029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:38.594029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:38.594029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:38.594029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:38.594029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:38.594029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:38.594029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:38.594029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:38.594029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:38.594029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:38.594029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:38.594029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:38.594029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:05:38.596398 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:05:38.596398 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:38.596398 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:05:38.596398 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 619/1251] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:38.601999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a53887-1216-4b9a-b04d-687ca6b97517 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:38.793878 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a53887-1216-4b9a-b04d-687ca6b97517 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:38.846034 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a279d3-b6be-47a3-826c-0328511b232a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:38.847168 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a279d3-b6be-47a3-826c-0328511b232a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:38.847669 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a279d3-b6be-47a3-826c-0328511b232a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:38.848148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a279d3-b6be-47a3-826c-0328511b232a None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:38.849334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a279d3-b6be-47a3-826c-0328511b232a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:38.849867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a279d3-b6be-47a3-826c-0328511b232a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:38.852539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a279d3-b6be-47a3-826c-0328511b232a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:38.879734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 633/1252] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:05:38.886615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc10efb-cad9-4dc4-a207-f5142024a999 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:39.050165 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc10efb-cad9-4dc4-a207-f5142024a999 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:39.093056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:39.106556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f1e55-de7d-4f65-a486-000341ee8e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:39.107761 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f1e55-de7d-4f65-a486-000341ee8e84 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:39.109549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f1e55-de7d-4f65-a486-000341ee8e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:39.109549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f1e55-de7d-4f65-a486-000341ee8e84 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:39.120857 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f1e55-de7d-4f65-a486-000341ee8e84 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:39.124121 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f1e55-de7d-4f65-a486-000341ee8e84 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:39.150914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-d97f1e55-de7d-4f65-a486-000341ee8e84 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 13:05:39.150914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:39.150914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:39.150914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:39.150914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:39.150914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:39.150914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:39.150914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:39.150914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:39.150914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:39.150914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:39.150914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:39.150914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:05:39.150914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:05:39.150914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:05:39.150914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:05:39.153078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:39.153078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:39.153078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:05:39.153078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:05:39.153078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:05:39.153078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:05:39.153078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:39.153078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:39.153078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:39.153078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:39.153078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:39.153078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:39.153078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:39.153078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:39.153078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:39.153078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:39.153078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:39.153078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:39.155249 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:39.155249 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:39.155249 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:05:39.155249 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:05:39.155249 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:05:39.155249 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:05:39.155249 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:05:39.155249 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:05:39.155249 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 13:05:39.155249 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:05:39.156734 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 620/1253] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:05:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:05:39.162617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a279d3-b6be-47a3-826c-0328511b232a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:39.258668 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:39.335902 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a279d3-b6be-47a3-826c-0328511b232a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:39.391401 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52b1f8-6c87-4682-9891-66eb27ecb39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:39.392296 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52b1f8-6c87-4682-9891-66eb27ecb39c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:39.392680 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52b1f8-6c87-4682-9891-66eb27ecb39c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:39.393053 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52b1f8-6c87-4682-9891-66eb27ecb39c None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:39.394056 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52b1f8-6c87-4682-9891-66eb27ecb39c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:39.394540 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52b1f8-6c87-4682-9891-66eb27ecb39c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:39.396604 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52b1f8-6c87-4682-9891-66eb27ecb39c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:39.417511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 634/1254] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Aug 10 13:05:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:05:39.424585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f1e55-de7d-4f65-a486-000341ee8e84 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:39.582221 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f1e55-de7d-4f65-a486-000341ee8e84 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:39.644970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04748f-3ecf-4bd9-b559-e744453b4a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:39.645511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04748f-3ecf-4bd9-b559-e744453b4a1b None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:39.645786 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04748f-3ecf-4bd9-b559-e744453b4a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:39.646063 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04748f-3ecf-4bd9-b559-e744453b4a1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:39.733700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:39.754014 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04748f-3ecf-4bd9-b559-e744453b4a1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:39.756444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04748f-3ecf-4bd9-b559-e744453b4a1b None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:39.911446 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 621/1255] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:05:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 13:05:39.918084 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52b1f8-6c87-4682-9891-66eb27ecb39c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:40.061075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52b1f8-6c87-4682-9891-66eb27ecb39c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:40.078788 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:40.113256 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b66903-202b-4376-bb4c-8a1628d2c133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:40.114371 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b66903-202b-4376-bb4c-8a1628d2c133 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:40.114796 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b66903-202b-4376-bb4c-8a1628d2c133 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:40.115196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b66903-202b-4376-bb4c-8a1628d2c133 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:40.131711 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b66903-202b-4376-bb4c-8a1628d2c133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:40.133735 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b66903-202b-4376-bb4c-8a1628d2c133 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:40.154077 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c9b66903-202b-4376-bb4c-8a1628d2c133 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:40.154077 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:40.154077 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:40.154077 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:40.154077 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:40.154077 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:40.154077 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:40.154077 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:40.154077 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:40.154077 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:40.154077 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:40.154077 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:40.154077 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:05:40.154077 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:05:40.154077 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:05:40.154077 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:05:40.156386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:40.156386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:40.156386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:40.156386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:40.156386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:40.156386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:40.156386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:40.156386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:40.156386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:40.156386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:40.156386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:40.156386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:40.156386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:40.156386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:40.156386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:40.156386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:40.156386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:05:40.158306 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:05:40.158306 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:40.158306 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:05:40.158306 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 635/1256] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:40.164045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04748f-3ecf-4bd9-b559-e744453b4a1b None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:40.302328 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:40.327650 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04748f-3ecf-4bd9-b559-e744453b4a1b None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:40.384986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cef39-ef53-4047-869d-46a6b66b5fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:40.386275 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cef39-ef53-4047-869d-46a6b66b5fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:40.387308 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cef39-ef53-4047-869d-46a6b66b5fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:40.387717 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cef39-ef53-4047-869d-46a6b66b5fc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:40.388908 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8cef39-ef53-4047-869d-46a6b66b5fc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:40.389456 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8cef39-ef53-4047-869d-46a6b66b5fc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:40.391413 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8cef39-ef53-4047-869d-46a6b66b5fc3 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:40.409205 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 622/1257] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:40.417832 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b66903-202b-4376-bb4c-8a1628d2c133 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:40.590498 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b66903-202b-4376-bb4c-8a1628d2c133 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:40.656234 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386819a-eff2-4410-9934-835abfcc0460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:40.657018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386819a-eff2-4410-9934-835abfcc0460 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:40.657477 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386819a-eff2-4410-9934-835abfcc0460 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:40.657778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386819a-eff2-4410-9934-835abfcc0460 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:40.670410 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386819a-eff2-4410-9934-835abfcc0460 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:40.673161 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386819a-eff2-4410-9934-835abfcc0460 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:40.695598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-d386819a-eff2-4410-9934-835abfcc0460 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:05:40.695598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:40.695598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:40.695598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:40.695598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:40.695598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:40.695598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:40.695598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:40.695598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:40.695598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:40.695598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:40.695598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:40.695598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:05:40.695598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:05:40.695598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:05:40.697746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:05:40.697746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:40.697746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:40.697746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:40.697746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:40.697746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:40.697746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:40.697746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:40.697746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:40.697746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:40.697746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:40.697746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:40.697746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:40.697746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:40.697746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:40.697746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:40.697746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:40.698978 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:05:40.698978 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:05:40.698978 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:05:40.698978 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:05:40.698978 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:05:40.698978 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:05:40.698978 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:05:40.698978 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:05:40.698978 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 636/1258] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:05:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:40.705685 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cef39-ef53-4047-869d-46a6b66b5fc3 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:40.883187 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cef39-ef53-4047-869d-46a6b66b5fc3 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:40.940529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f46ea-e18d-4676-8bc5-199f8e2c08fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:40.941087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f46ea-e18d-4676-8bc5-199f8e2c08fa None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:40.941387 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f46ea-e18d-4676-8bc5-199f8e2c08fa None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:40.941689 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f46ea-e18d-4676-8bc5-199f8e2c08fa None admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:40.942463 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f46ea-e18d-4676-8bc5-199f8e2c08fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:40.942790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f46ea-e18d-4676-8bc5-199f8e2c08fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:40.944404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f46ea-e18d-4676-8bc5-199f8e2c08fa None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:40.962269 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 623/1259] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:05:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:05:40.969760 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386819a-eff2-4410-9934-835abfcc0460 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:41.016080 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:41.151269 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386819a-eff2-4410-9934-835abfcc0460 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:41.207444 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01706381-1fd3-4e09-a6dd-ee214d73df5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:41.208395 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01706381-1fd3-4e09-a6dd-ee214d73df5f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:41.208867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01706381-1fd3-4e09-a6dd-ee214d73df5f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:41.209390 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01706381-1fd3-4e09-a6dd-ee214d73df5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:41.210510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01706381-1fd3-4e09-a6dd-ee214d73df5f None admin] RBAC: Adding query filter params (role.id=d9c9200468cb4f7ab6a23882bfb1f062, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=15780b69faa745e9b99f1fffb6abe231) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:41.210992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01706381-1fd3-4e09-a6dd-ee214d73df5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:41.213398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01706381-1fd3-4e09-a6dd-ee214d73df5f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:41.221654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 637/1260] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:05:40 2022] GET /identity/v3/role_assignments?user.id=15780b69faa745e9b99f1fffb6abe231&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=d9c9200468cb4f7ab6a23882bfb1f062 => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:43.530026 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07585df7-bc1b-420c-96c8-7eca847823f9 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:43.530656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07585df7-bc1b-420c-96c8-7eca847823f9 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:43.530983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07585df7-bc1b-420c-96c8-7eca847823f9 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:43.533723 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 624/1261] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:05:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:05:43.542217 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c45612-f941-4ca5-8243-6a2fd8d19e93 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:43.542807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c45612-f941-4ca5-8243-6a2fd8d19e93 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:43.542907 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c45612-f941-4ca5-8243-6a2fd8d19e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:43.562687 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-60c45612-f941-4ca5-8243-6a2fd8d19e93 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:05:43.563992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-60c45612-f941-4ca5-8243-6a2fd8d19e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:05:43.648827 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 638/1262] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:05:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:05:43.682317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07585df7-bc1b-420c-96c8-7eca847823f9 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:43.700791 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:43.836945 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07585df7-bc1b-420c-96c8-7eca847823f9 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:43.880520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd1d40-cab9-4774-bfe9-0a7e2c2446c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:43.881423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd1d40-cab9-4774-bfe9-0a7e2c2446c6 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:43.881663 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd1d40-cab9-4774-bfe9-0a7e2c2446c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:43.881883 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd1d40-cab9-4774-bfe9-0a7e2c2446c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:43.896436 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd1d40-cab9-4774-bfe9-0a7e2c2446c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:05:43.901305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-7fdd1d40-cab9-4774-bfe9-0a7e2c2446c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:05:43.901305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:43.901305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:43.901305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:43.901305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:43.901305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:43.901305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:43.901305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:43.901305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:43.901305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:43.901305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:43.901305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:43.901305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:05:43.901305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:05:43.901305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:05:43.901305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:05:43.903497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:05:43.903497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:05:43.903497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:05:43.903497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:05:43.903497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:43.903497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:43.903497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:43.903497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:43.903497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:43.903497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:43.903497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:43.903497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:43.903497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:43.903497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:43.903497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:43.903497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:43.905820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:43.905820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:43.905820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:43.905820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:43.905820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:05:43.905820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:05:43.905820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:05:43.905820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:05:43.905820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:05:43.905820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:05:43.905820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:05:43.905820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:05:43.905820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 625/1263] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:05:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:43.909214 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c45612-f941-4ca5-8243-6a2fd8d19e93 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:43.931556 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:44.084517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c45612-f941-4ca5-8243-6a2fd8d19e93 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:44.140851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56746ad2-1f37-4130-8107-f104d15c503a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:44.141549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56746ad2-1f37-4130-8107-f104d15c503a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:44.141877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56746ad2-1f37-4130-8107-f104d15c503a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:44.142215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56746ad2-1f37-4130-8107-f104d15c503a None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:44.142956 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56746ad2-1f37-4130-8107-f104d15c503a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:44.143361 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56746ad2-1f37-4130-8107-f104d15c503a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:44.145046 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56746ad2-1f37-4130-8107-f104d15c503a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:44.154541 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 639/1264] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:05:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:44.160824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd1d40-cab9-4774-bfe9-0a7e2c2446c6 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:44.241174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:44.278516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd1d40-cab9-4774-bfe9-0a7e2c2446c6 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:44.316623 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940f451-7ed2-4c59-8309-333e6fa54dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:44.317268 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940f451-7ed2-4c59-8309-333e6fa54dfa None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:44.317542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940f451-7ed2-4c59-8309-333e6fa54dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:44.317809 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940f451-7ed2-4c59-8309-333e6fa54dfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:44.329413 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940f451-7ed2-4c59-8309-333e6fa54dfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:44.330892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940f451-7ed2-4c59-8309-333e6fa54dfa None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:44.347921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-6940f451-7ed2-4c59-8309-333e6fa54dfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:44.347921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:44.347921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:44.347921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:44.347921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:44.347921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:44.347921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:44.347921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:44.347921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:44.347921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:44.347921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:44.347921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:44.347921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:05:44.347921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:05:44.347921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:05:44.347921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:05:44.349654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:44.349654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:44.349654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:44.349654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:44.349654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:44.349654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:44.349654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:44.349654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:44.349654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:44.349654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:44.349654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:44.349654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:44.349654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:44.349654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:44.349654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:44.349654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:44.349654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:05:44.351307 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:05:44.351307 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:44.351307 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:05:44.351307 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 626/1265] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:44.355244 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56746ad2-1f37-4130-8107-f104d15c503a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:44.448490 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:44.470215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56746ad2-1f37-4130-8107-f104d15c503a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:44.511713 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2aed6-847f-49a5-b93e-b9e3197988b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:44.512332 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2aed6-847f-49a5-b93e-b9e3197988b7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:44.512608 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2aed6-847f-49a5-b93e-b9e3197988b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:44.512875 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2aed6-847f-49a5-b93e-b9e3197988b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:44.513526 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2aed6-847f-49a5-b93e-b9e3197988b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:44.513880 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2aed6-847f-49a5-b93e-b9e3197988b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:44.515433 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2aed6-847f-49a5-b93e-b9e3197988b7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:44.529875 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 640/1266] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:44.536666 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940f451-7ed2-4c59-8309-333e6fa54dfa None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:44.648646 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940f451-7ed2-4c59-8309-333e6fa54dfa None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:44.676416 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:44.694561 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6873cf-2313-4348-bde3-44717fa798f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:44.695259 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6873cf-2313-4348-bde3-44717fa798f0 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:44.695534 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6873cf-2313-4348-bde3-44717fa798f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:44.695800 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6873cf-2313-4348-bde3-44717fa798f0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:44.705107 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6873cf-2313-4348-bde3-44717fa798f0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:44.706473 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6873cf-2313-4348-bde3-44717fa798f0 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:44.719537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-7a6873cf-2313-4348-bde3-44717fa798f0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 13:05:44.719537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:44.719537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:44.719537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:44.719537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:44.719537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:44.719537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:44.719537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:44.719537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:44.719537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:44.719537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:44.719537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:44.719537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:05:44.719537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:05:44.719537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:05:44.719537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:05:44.721378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:44.721378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:44.721378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:05:44.721378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:05:44.721378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:05:44.721378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:05:44.721378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:44.721378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:44.721378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:44.721378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:44.721378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:44.721378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:44.721378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:44.721378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:44.721378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:44.721378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:44.721378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:44.721378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:44.723231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:44.723231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:44.723231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:05:44.723231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:05:44.723231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:05:44.723231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:05:44.723231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:05:44.723231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:05:44.723231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 13:05:44.723231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:05:44.723231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 627/1267] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:05:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:44.730055 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2aed6-847f-49a5-b93e-b9e3197988b7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:44.842515 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2aed6-847f-49a5-b93e-b9e3197988b7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:44.880861 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea0f36-a33f-454e-a541-fd74002667fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:44.881479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea0f36-a33f-454e-a541-fd74002667fe None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:44.881755 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea0f36-a33f-454e-a541-fd74002667fe None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:44.882022 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea0f36-a33f-454e-a541-fd74002667fe None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:44.882763 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea0f36-a33f-454e-a541-fd74002667fe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:44.883095 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea0f36-a33f-454e-a541-fd74002667fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:44.884556 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea0f36-a33f-454e-a541-fd74002667fe None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:44.895782 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:44.906418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 641/1268] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Aug 10 13:05:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:44.912532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6873cf-2313-4348-bde3-44717fa798f0 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:45.029517 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6873cf-2313-4348-bde3-44717fa798f0 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:45.067937 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9d8cb-5d47-41d8-9d90-5bbb54c534ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:45.068586 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9d8cb-5d47-41d8-9d90-5bbb54c534ea None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:45.068865 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9d8cb-5d47-41d8-9d90-5bbb54c534ea None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:45.069135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9d8cb-5d47-41d8-9d90-5bbb54c534ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:45.081984 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9d8cb-5d47-41d8-9d90-5bbb54c534ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:45.083519 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9d8cb-5d47-41d8-9d90-5bbb54c534ea None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:45.100992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-bad9d8cb-5d47-41d8-9d90-5bbb54c534ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:45.100992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:45.100992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:45.100992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:45.100992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:45.100992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:45.100992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:45.100992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:45.100992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:45.100992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:45.100992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:45.100992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:45.100992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:05:45.100992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:05:45.100992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:05:45.100992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:05:45.102738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:45.102738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:45.102738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:45.102738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:45.102738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:45.102738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:45.102738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:45.102738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:45.102738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:45.102738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:45.102738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:45.102738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:45.102738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:45.102738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:45.102738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:45.102738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:45.102738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:05:45.104464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:05:45.104464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:45.104464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:05:45.104464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 628/1269] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:45.108326 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea0f36-a33f-454e-a541-fd74002667fe None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:45.217284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea0f36-a33f-454e-a541-fd74002667fe None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:45.256621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f355a-c268-4f04-912b-e80598f08620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:45.257144 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f355a-c268-4f04-912b-e80598f08620 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:45.257527 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f355a-c268-4f04-912b-e80598f08620 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:45.257800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f355a-c268-4f04-912b-e80598f08620 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:45.258465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f355a-c268-4f04-912b-e80598f08620 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:45.258776 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f355a-c268-4f04-912b-e80598f08620 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:45.260245 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f355a-c268-4f04-912b-e80598f08620 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:45.273720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 642/1270] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:45.283379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9d8cb-5d47-41d8-9d90-5bbb54c534ea None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:45.338880 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:45.428273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9d8cb-5d47-41d8-9d90-5bbb54c534ea None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:45.467237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c475479-1584-47ec-af77-f550fcaaced0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:45.467873 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c475479-1584-47ec-af77-f550fcaaced0 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:45.468153 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c475479-1584-47ec-af77-f550fcaaced0 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:45.468426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c475479-1584-47ec-af77-f550fcaaced0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:45.476034 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c475479-1584-47ec-af77-f550fcaaced0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:45.477531 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c475479-1584-47ec-af77-f550fcaaced0 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:45.490468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-0c475479-1584-47ec-af77-f550fcaaced0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:05:45.490468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:45.490468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:45.490468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:45.490468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:45.490468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:45.490468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:45.490468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:45.490468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:45.490468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:45.490468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:45.490468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:45.490468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:05:45.490468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:05:45.490468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:05:45.492255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:05:45.492255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:45.492255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:45.492255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:45.492255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:45.492255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:45.492255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:45.492255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:45.492255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:45.492255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:45.492255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:45.492255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:45.492255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:45.492255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:45.492255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:45.492255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:45.492255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:45.494075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:05:45.494075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:05:45.494075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:05:45.494075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:05:45.494075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:05:45.494075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:05:45.494075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:05:45.494075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:05:45.494075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 629/1271] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:05:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:45.502044 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f355a-c268-4f04-912b-e80598f08620 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:45.610863 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:45.675601 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f355a-c268-4f04-912b-e80598f08620 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:45.713804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117cf57-762a-4b7b-9d88-58b2cc4a9587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:45.714963 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117cf57-762a-4b7b-9d88-58b2cc4a9587 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:45.715289 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117cf57-762a-4b7b-9d88-58b2cc4a9587 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:45.715630 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117cf57-762a-4b7b-9d88-58b2cc4a9587 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:45.716561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117cf57-762a-4b7b-9d88-58b2cc4a9587 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:45.716867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117cf57-762a-4b7b-9d88-58b2cc4a9587 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:45.718330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117cf57-762a-4b7b-9d88-58b2cc4a9587 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:45.731850 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 643/1272] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:05:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:45.737996 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c475479-1584-47ec-af77-f550fcaaced0 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:45.838862 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:45.849580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c475479-1584-47ec-af77-f550fcaaced0 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:45.888413 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecf364-3fbd-43b8-b4b2-d805491cb5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:45.889050 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecf364-3fbd-43b8-b4b2-d805491cb5cd None admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:45.889369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecf364-3fbd-43b8-b4b2-d805491cb5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:45.889684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecf364-3fbd-43b8-b4b2-d805491cb5cd None admin] PATH_INFO: `/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/15780b69faa745e9b99f1fffb6abe231/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:45.891819 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecf364-3fbd-43b8-b4b2-d805491cb5cd None admin] RBAC: Authorizing `identity:create_grant(project_id=8aa2ccddadb54dd9b88ccc6cec98ae37, user_id=15780b69faa745e9b99f1fffb6abe231, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:45.893320 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecf364-3fbd-43b8-b4b2-d805491cb5cd None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:45.907983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 630/1273] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 10 13:05:45 2022] PUT /identity/v3/projects/8aa2ccddadb54dd9b88ccc6cec98ae37/users/15780b69faa745e9b99f1fffb6abe231/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:05:48.084248 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b8e8a-6276-4002-800d-592d8ec872ab None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:48.084811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b8e8a-6276-4002-800d-592d8ec872ab None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:48.084979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b8e8a-6276-4002-800d-592d8ec872ab None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:48.086374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 644/1274] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:05:48.093468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ef3b6-2f95-4359-8f8c-c324a03dff16 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:48.094036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ef3b6-2f95-4359-8f8c-c324a03dff16 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:48.094036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ef3b6-2f95-4359-8f8c-c324a03dff16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:48.114287 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-ce0ef3b6-2f95-4359-8f8c-c324a03dff16 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:05:48.115560 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-ce0ef3b6-2f95-4359-8f8c-c324a03dff16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:05:48.191469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 631/1275] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:05:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:05:48.215533 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b8e8a-6276-4002-800d-592d8ec872ab None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:48.328847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b8e8a-6276-4002-800d-592d8ec872ab None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:48.348641 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:48.367272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4dca1-2632-4747-9829-fa576f6928e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:48.367913 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4dca1-2632-4747-9829-fa576f6928e2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:48.368191 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4dca1-2632-4747-9829-fa576f6928e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:48.368464 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4dca1-2632-4747-9829-fa576f6928e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:48.381304 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4dca1-2632-4747-9829-fa576f6928e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 13:05:48.387980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-00e4dca1-2632-4747-9829-fa576f6928e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:05:48.387980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:48.387980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:48.387980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:48.387980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:48.387980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:48.387980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:48.387980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:48.387980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:48.387980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:48.387980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:48.387980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:48.387980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 13:05:48.387980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 13:05:48.387980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 13:05:48.387980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 13:05:48.389779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 13:05:48.389779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 13:05:48.389779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 13:05:48.389779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 13:05:48.389779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:48.389779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:48.389779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:48.389779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:48.389779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:48.389779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:48.389779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:48.389779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:48.389779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:48.389779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:48.389779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:48.389779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:48.391406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:48.391406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:48.391406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:48.391406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:48.391406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 13:05:48.391406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 13:05:48.391406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 13:05:48.391406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 13:05:48.391406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 13:05:48.391406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 13:05:48.391406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 13:05:48.391406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:05:48.391406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 645/1276] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 10 13:05:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:48.395559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ef3b6-2f95-4359-8f8c-c324a03dff16 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:48.490227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:48.512558 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ef3b6-2f95-4359-8f8c-c324a03dff16 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:48.549919 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02726323-4ed0-47f8-be15-34668de26a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:48.550532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02726323-4ed0-47f8-be15-34668de26a9e None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:48.550809 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02726323-4ed0-47f8-be15-34668de26a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:48.551105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02726323-4ed0-47f8-be15-34668de26a9e None admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:48.551783 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02726323-4ed0-47f8-be15-34668de26a9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:48.552083 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02726323-4ed0-47f8-be15-34668de26a9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:48.553514 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02726323-4ed0-47f8-be15-34668de26a9e None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:48.563856 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 632/1277] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 10 13:05:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:48.569916 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4dca1-2632-4747-9829-fa576f6928e2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:48.714110 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4dca1-2632-4747-9829-fa576f6928e2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:48.755525 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7157f0b-abd9-4159-aa61-9ca6dbd11722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:48.756171 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7157f0b-abd9-4159-aa61-9ca6dbd11722 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:48.756446 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7157f0b-abd9-4159-aa61-9ca6dbd11722 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:48.756713 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7157f0b-abd9-4159-aa61-9ca6dbd11722 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:48.769085 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7157f0b-abd9-4159-aa61-9ca6dbd11722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:48.770546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7157f0b-abd9-4159-aa61-9ca6dbd11722 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:48.787671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-f7157f0b-abd9-4159-aa61-9ca6dbd11722 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:48.787671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:48.787671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:48.787671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:48.787671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:48.787671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:48.787671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:48.787671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:48.787671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:48.787671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:48.787671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:48.787671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:48.787671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:05:48.787671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:05:48.787671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:05:48.787671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:05:48.788757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:48.788757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:48.788757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:48.788757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:48.788757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:48.788757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:48.788757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:48.788757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:48.788757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:48.788757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:48.788757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:48.788757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:48.788757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:48.788757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:48.788757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:48.788757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:48.788757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:05:48.789718 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:05:48.789718 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:48.789718 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:05:48.789718 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 646/1278] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:48.795954 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02726323-4ed0-47f8-be15-34668de26a9e None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:48.908891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02726323-4ed0-47f8-be15-34668de26a9e None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:48.947017 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c375c-bec6-405d-bcc6-c925bb56aee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:48.947660 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c375c-bec6-405d-bcc6-c925bb56aee2 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:48.947941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c375c-bec6-405d-bcc6-c925bb56aee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:48.948213 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c375c-bec6-405d-bcc6-c925bb56aee2 None admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:48.948910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c375c-bec6-405d-bcc6-c925bb56aee2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:48.949212 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c375c-bec6-405d-bcc6-c925bb56aee2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:48.950657 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c375c-bec6-405d-bcc6-c925bb56aee2 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:48.964244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 633/1279] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:48.970308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7157f0b-abd9-4159-aa61-9ca6dbd11722 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:49.006165 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:49.089561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7157f0b-abd9-4159-aa61-9ca6dbd11722 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:49.126166 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd777b09-e26a-4965-be38-8bf21159ccac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:49.126815 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd777b09-e26a-4965-be38-8bf21159ccac None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:49.127124 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd777b09-e26a-4965-be38-8bf21159ccac None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:49.127432 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd777b09-e26a-4965-be38-8bf21159ccac None admin] PATH_INFO: `/v3/users/placement` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:49.136245 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd777b09-e26a-4965-be38-8bf21159ccac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:49.137722 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd777b09-e26a-4965-be38-8bf21159ccac None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:49.149977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-dd777b09-e26a-4965-be38-8bf21159ccac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 13:05:49.149977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:49.149977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:49.149977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:49.149977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:49.149977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:49.149977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:49.149977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:49.149977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:49.149977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:49.149977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:49.149977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:49.149977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 13:05:49.149977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 13:05:49.149977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 13:05:49.149977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 13:05:49.151235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:49.151235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:49.151235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 13:05:49.151235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:05:49.151235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 13:05:49.151235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 13:05:49.151235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:49.151235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:49.151235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:49.151235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:49.151235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:49.151235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:49.151235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:49.151235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:49.151235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:49.151235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:49.151235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:49.151235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:49.153024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:49.153024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:49.153024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 13:05:49.153024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 13:05:49.153024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 13:05:49.153024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 13:05:49.153024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 13:05:49.153024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 13:05:49.153024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 13:05:49.153024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:05:49.155201 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 647/1280] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:05:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:49.158324 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c375c-bec6-405d-bcc6-c925bb56aee2 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:49.164609 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:49.329220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c375c-bec6-405d-bcc6-c925bb56aee2 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:49.368001 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898392a9-84a9-4dc9-901c-f4bfcec1dc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:49.368618 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898392a9-84a9-4dc9-901c-f4bfcec1dc5d None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:49.368891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898392a9-84a9-4dc9-901c-f4bfcec1dc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:49.369164 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898392a9-84a9-4dc9-901c-f4bfcec1dc5d None admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:49.369906 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898392a9-84a9-4dc9-901c-f4bfcec1dc5d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:49.370217 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898392a9-84a9-4dc9-901c-f4bfcec1dc5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:49.371718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898392a9-84a9-4dc9-901c-f4bfcec1dc5d None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:49.392404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 634/1281] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Aug 10 13:05:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:49.398572 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd777b09-e26a-4965-be38-8bf21159ccac None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:49.506324 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:49.520299 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd777b09-e26a-4965-be38-8bf21159ccac None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:49.564050 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8e9f6-99c8-466a-ac5c-1ed44c894c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:49.564670 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8e9f6-99c8-466a-ac5c-1ed44c894c06 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:49.564944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8e9f6-99c8-466a-ac5c-1ed44c894c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:49.565210 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8e9f6-99c8-466a-ac5c-1ed44c894c06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:49.646095 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8e9f6-99c8-466a-ac5c-1ed44c894c06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:49.648530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8e9f6-99c8-466a-ac5c-1ed44c894c06 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:49.751973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:49.764785 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 648/1282] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 10 13:05:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 13:05:49.773957 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898392a9-84a9-4dc9-901c-f4bfcec1dc5d None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:49.843974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:49.891668 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898392a9-84a9-4dc9-901c-f4bfcec1dc5d None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:49.930950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ffe98-d846-41fb-9ce2-8169d30b2210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:49.931535 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ffe98-d846-41fb-9ce2-8169d30b2210 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:49.931812 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ffe98-d846-41fb-9ce2-8169d30b2210 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:49.932083 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ffe98-d846-41fb-9ce2-8169d30b2210 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:49.943839 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ffe98-d846-41fb-9ce2-8169d30b2210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:49.945392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ffe98-d846-41fb-9ce2-8169d30b2210 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:49.961550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-697ffe98-d846-41fb-9ce2-8169d30b2210 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:49.961550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:49.961550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:49.961550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:49.961550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:49.961550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:49.961550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:49.961550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:49.961550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:49.961550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:49.961550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:49.961550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:49.961550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 13:05:49.961550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 13:05:49.961550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 13:05:49.961550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 13:05:49.963380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:49.963380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:49.963380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:49.963380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:49.963380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:49.963380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:49.963380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:49.963380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:49.963380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:49.963380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:49.963380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:49.963380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:49.963380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:49.963380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:49.963380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:49.963380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:49.963380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 13:05:49.965857 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 13:05:49.965857 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 13:05:49.965857 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:05:49.965857 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 635/1283] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:49.970432 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8e9f6-99c8-466a-ac5c-1ed44c894c06 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:50.081476 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8e9f6-99c8-466a-ac5c-1ed44c894c06 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:50.123351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d80a66-17a2-44f7-a970-b95d233f2579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:50.124081 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d80a66-17a2-44f7-a970-b95d233f2579 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:50.124248 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d80a66-17a2-44f7-a970-b95d233f2579 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:50.124522 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d80a66-17a2-44f7-a970-b95d233f2579 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:50.125347 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d80a66-17a2-44f7-a970-b95d233f2579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:50.125600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d80a66-17a2-44f7-a970-b95d233f2579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:50.126970 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d80a66-17a2-44f7-a970-b95d233f2579 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:50.140997 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 649/1284] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 10 13:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:05:50.146842 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ffe98-d846-41fb-9ce2-8169d30b2210 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:50.268074 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ffe98-d846-41fb-9ce2-8169d30b2210 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:50.283946 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:50.305825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b3741-9d94-4a8b-a0b4-025be0b15c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:50.306463 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b3741-9d94-4a8b-a0b4-025be0b15c42 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:50.306740 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b3741-9d94-4a8b-a0b4-025be0b15c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:50.307031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b3741-9d94-4a8b-a0b4-025be0b15c42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:50.314878 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b3741-9d94-4a8b-a0b4-025be0b15c42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:50.316342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b3741-9d94-4a8b-a0b4-025be0b15c42 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:50.328070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application [None req-838b3741-9d94-4a8b-a0b4-025be0b15c42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:05:50.328070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:50.328070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:50.328070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:50.328070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:50.328070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:50.328070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:50.328070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:50.328070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:50.328070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:50.328070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:50.328070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:50.328070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 13:05:50.328070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 13:05:50.328070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 13:05:50.329277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 13:05:50.329277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:50.329277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:50.329277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:50.329277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:50.329277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:50.329277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:50.329277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:50.329277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:50.329277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:50.329277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:50.329277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:50.329277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:50.329277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:50.329277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:50.329277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:50.329277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:50.330226 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 13:05:50.330226 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 13:05:50.330226 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 13:05:50.330226 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 13:05:50.330226 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 13:05:50.330226 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 13:05:50.330226 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 13:05:50.330226 dv-cinder-836027-5-smb devstack@keystone.service[80297]: ERROR keystone.server.flask.application Aug 10 13:05:50.330226 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 636/1285] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 10 13:05:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:50.336015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d80a66-17a2-44f7-a970-b95d233f2579 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:50.397758 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:50.460188 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d80a66-17a2-44f7-a970-b95d233f2579 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:50.500469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78678b0d-1256-4dc5-af39-6e23c7b6a21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:50.501095 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78678b0d-1256-4dc5-af39-6e23c7b6a21a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:50.501376 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78678b0d-1256-4dc5-af39-6e23c7b6a21a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:50.501649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78678b0d-1256-4dc5-af39-6e23c7b6a21a None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:50.502357 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78678b0d-1256-4dc5-af39-6e23c7b6a21a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:50.502664 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78678b0d-1256-4dc5-af39-6e23c7b6a21a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:50.504181 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78678b0d-1256-4dc5-af39-6e23c7b6a21a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:50.517744 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 650/1286] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 10 13:05:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:50.524463 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b3741-9d94-4a8b-a0b4-025be0b15c42 None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:50.648896 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b3741-9d94-4a8b-a0b4-025be0b15c42 None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:50.708838 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b220a7-df31-4a75-9756-8209f49baad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:50.709838 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b220a7-df31-4a75-9756-8209f49baad3 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:50.710322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b220a7-df31-4a75-9756-8209f49baad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:50.710790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b220a7-df31-4a75-9756-8209f49baad3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:50.712176 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b220a7-df31-4a75-9756-8209f49baad3 None admin] RBAC: Adding query filter params (role.id=d9c9200468cb4f7ab6a23882bfb1f062, scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37, user.id=15780b69faa745e9b99f1fffb6abe231) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:50.712721 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b220a7-df31-4a75-9756-8209f49baad3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:50.716249 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b220a7-df31-4a75-9756-8209f49baad3 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:50.727284 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 637/1287] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 10 13:05:50 2022] GET /identity/v3/role_assignments?user.id=15780b69faa745e9b99f1fffb6abe231&scope.project.id=8aa2ccddadb54dd9b88ccc6cec98ae37&role.id=d9c9200468cb4f7ab6a23882bfb1f062 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:05:52.822530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163d103-c7b1-4179-9e15-611600c35b02 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:52.823192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163d103-c7b1-4179-9e15-611600c35b02 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:52.823192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163d103-c7b1-4179-9e15-611600c35b02 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:52.824792 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 651/1288] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:05:52.830857 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855b7af-6ae8-420c-b770-c41486c13b3c None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:52.831459 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855b7af-6ae8-420c-b770-c41486c13b3c None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:52.831459 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855b7af-6ae8-420c-b770-c41486c13b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:52.850980 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-b855b7af-6ae8-420c-b770-c41486c13b3c None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:05:52.852249 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-b855b7af-6ae8-420c-b770-c41486c13b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:05:52.887083 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:52.930449 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 638/1289] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:05:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:05:52.953068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163d103-c7b1-4179-9e15-611600c35b02 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:53.067696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163d103-c7b1-4179-9e15-611600c35b02 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:53.080848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:53.108592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516ac9b-00a4-4935-b80e-d0dc5660d082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:53.109230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516ac9b-00a4-4935-b80e-d0dc5660d082 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:53.109506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516ac9b-00a4-4935-b80e-d0dc5660d082 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:53.109781 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516ac9b-00a4-4935-b80e-d0dc5660d082 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:53.110361 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516ac9b-00a4-4935-b80e-d0dc5660d082 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:53.111767 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516ac9b-00a4-4935-b80e-d0dc5660d082 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:53.121768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-e516ac9b-00a4-4935-b80e-d0dc5660d082 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 13:05:53.121768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:53.121768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:05:53.121768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:05:53.121768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:05:53.121768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:05:53.121768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:05:53.121768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:05:53.121768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 13:05:53.121768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:05:53.121768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:05:53.121768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:05:53.121768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:53.121768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:53.121768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:53.121768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:53.121768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:53.123851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:53.123851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:53.123851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:53.123851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:53.123851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:53.123851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:53.123851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:05:53.123851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:05:53.123851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:05:53.123851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:05:53.123851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:53.123851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:53.123851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:53.123851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:53.123851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:53.123851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:53.125777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:53.125777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:53.125777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:53.125777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:53.125777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:53.125777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:53.125777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:53.125777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:53.125777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:53.125777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:53.125777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:05:53.125777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:05:53.125777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 13:05:53.125777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:05:53.125777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 652/1290] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Aug 10 13:05:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 13:05:53.131302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855b7af-6ae8-420c-b770-c41486c13b3c None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:53.282058 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855b7af-6ae8-420c-b770-c41486c13b3c None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:53.321317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0233db-f1b5-4059-865c-ed074d7c1925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:53.321942 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0233db-f1b5-4059-865c-ed074d7c1925 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:53.322223 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0233db-f1b5-4059-865c-ed074d7c1925 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:53.322493 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0233db-f1b5-4059-865c-ed074d7c1925 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:53.323177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0233db-f1b5-4059-865c-ed074d7c1925 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:53.323509 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0233db-f1b5-4059-865c-ed074d7c1925 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:53.324880 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0233db-f1b5-4059-865c-ed074d7c1925 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:53.330464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 639/1291] 10.222.0.46 () {56 vars in 1116 bytes} [Wed Aug 10 13:05:53 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:53.336578 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516ac9b-00a4-4935-b80e-d0dc5660d082 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:53.446162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516ac9b-00a4-4935-b80e-d0dc5660d082 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:53.484472 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843eebb-8b12-49fb-a721-8a23db0cf061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:53.485294 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843eebb-8b12-49fb-a721-8a23db0cf061 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:53.485695 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843eebb-8b12-49fb-a721-8a23db0cf061 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:53.486016 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843eebb-8b12-49fb-a721-8a23db0cf061 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:53.486720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843eebb-8b12-49fb-a721-8a23db0cf061 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:53.487195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843eebb-8b12-49fb-a721-8a23db0cf061 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:53.488774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843eebb-8b12-49fb-a721-8a23db0cf061 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:53.494217 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 653/1292] 10.222.0.46 () {56 vars in 1116 bytes} [Wed Aug 10 13:05:53 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:55.791274 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fd7d9-b3c5-4e76-9457-f57c331c7c52 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:55.791882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fd7d9-b3c5-4e76-9457-f57c331c7c52 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:55.791882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fd7d9-b3c5-4e76-9457-f57c331c7c52 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:55.793707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 640/1293] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:05:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:05:55.799344 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea553e4-c4b0-4a3e-b475-b01ac51158ac None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:55.799871 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea553e4-c4b0-4a3e-b475-b01ac51158ac None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:55.799871 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea553e4-c4b0-4a3e-b475-b01ac51158ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:55.819596 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4ea553e4-c4b0-4a3e-b475-b01ac51158ac None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:05:55.820815 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4ea553e4-c4b0-4a3e-b475-b01ac51158ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:05:55.856691 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:55.898939 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 654/1294] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:05:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:05:55.922796 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fd7d9-b3c5-4e76-9457-f57c331c7c52 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:55.958047 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:56.044446 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fd7d9-b3c5-4e76-9457-f57c331c7c52 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:56.084758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8a3c4-a04c-4763-930c-cc2dd35d8b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:56.085385 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8a3c4-a04c-4763-930c-cc2dd35d8b2b None admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:56.085682 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8a3c4-a04c-4763-930c-cc2dd35d8b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:56.085969 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8a3c4-a04c-4763-930c-cc2dd35d8b2b None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:56.086692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8a3c4-a04c-4763-930c-cc2dd35d8b2b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:56.088135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8a3c4-a04c-4763-930c-cc2dd35d8b2b None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:56.105180 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 641/1295] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 10 13:05:55 2022] POST /identity/v3/services => generated 246 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:05:58.207375 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d60392-b978-418d-ae39-3a30b5761f7b None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:58.207988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d60392-b978-418d-ae39-3a30b5761f7b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:58.207988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d60392-b978-418d-ae39-3a30b5761f7b None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:58.209282 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 655/1296] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:05:58.214876 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21bf91-a0e7-4d89-81b4-20e4ffaeceeb None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:58.215721 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21bf91-a0e7-4d89-81b4-20e4ffaeceeb None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:58.215721 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21bf91-a0e7-4d89-81b4-20e4ffaeceeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:58.233964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-ca21bf91-a0e7-4d89-81b4-20e4ffaeceeb None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:05:58.235205 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-ca21bf91-a0e7-4d89-81b4-20e4ffaeceeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:05:58.320163 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 642/1297] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:05:58 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 13:05:58.343380 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d60392-b978-418d-ae39-3a30b5761f7b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:58.457938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d60392-b978-418d-ae39-3a30b5761f7b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:58.494994 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8f3ed-8152-4748-b128-388905b64caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:58.496268 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8f3ed-8152-4748-b128-388905b64caf None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:58.496571 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8f3ed-8152-4748-b128-388905b64caf None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:58.496836 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8f3ed-8152-4748-b128-388905b64caf None admin] PATH_INFO: `/v3/services/placement` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:58.497419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8f3ed-8152-4748-b128-388905b64caf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:58.498808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8f3ed-8152-4748-b128-388905b64caf None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:58.522015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-8bf8f3ed-8152-4748-b128-388905b64caf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 13:05:58.522015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:58.522015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:05:58.522015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:05:58.522015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:05:58.522015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:05:58.522015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:05:58.522015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:05:58.522015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 13:05:58.522015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:05:58.522015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:05:58.522015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:05:58.522015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:05:58.522015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:05:58.522015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:05:58.522015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:05:58.522015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:05:58.523936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:05:58.523936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:05:58.523936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:05:58.523936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:05:58.523936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:05:58.523936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:05:58.523936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:05:58.523936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:05:58.523936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:05:58.523936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:05:58.523936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:05:58.523936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:05:58.523936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:05:58.523936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:05:58.523936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:05:58.523936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:05:58.525688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:05:58.525688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:05:58.525688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:05:58.525688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:05:58.525688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:05:58.525688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:05:58.525688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:05:58.525688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:05:58.525688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:05:58.525688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:05:58.525688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:05:58.525688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:05:58.525688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 13:05:58.525688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:05:58.525688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 656/1298] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Aug 10 13:05:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:05:58.530194 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21bf91-a0e7-4d89-81b4-20e4ffaeceeb None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:58.550182 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:58.642592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21bf91-a0e7-4d89-81b4-20e4ffaeceeb None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:58.689152 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90a522-db7a-450a-925b-c30a67186cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:58.690014 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90a522-db7a-450a-925b-c30a67186cdd None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:58.690399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90a522-db7a-450a-925b-c30a67186cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:58.690854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90a522-db7a-450a-925b-c30a67186cdd None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:58.691694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90a522-db7a-450a-925b-c30a67186cdd None admin] RBAC: Adding query filter params (name=placement) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:58.692045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90a522-db7a-450a-925b-c30a67186cdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:58.693995 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90a522-db7a-450a-925b-c30a67186cdd None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:58.701296 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 643/1299] 10.222.0.46 () {56 vars in 1116 bytes} [Wed Aug 10 13:05:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:58.707971 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8f3ed-8152-4748-b128-388905b64caf None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:58.755086 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:58.833148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8f3ed-8152-4748-b128-388905b64caf None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:58.873201 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e80f16-ad66-43b3-8c69-c1799569374c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:58.873821 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e80f16-ad66-43b3-8c69-c1799569374c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:58.874100 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e80f16-ad66-43b3-8c69-c1799569374c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:58.874372 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e80f16-ad66-43b3-8c69-c1799569374c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:58.875109 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e80f16-ad66-43b3-8c69-c1799569374c None admin] RBAC: Adding query filter params (interface=public, service_id=a085256154cd437cb354caaa5c7271bf, region_id=RegionOne) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:05:58.875422 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e80f16-ad66-43b3-8c69-c1799569374c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:58.876825 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e80f16-ad66-43b3-8c69-c1799569374c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:58.882598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 657/1300] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Aug 10 13:05:58 2022] GET /identity/v3/endpoints?service_id=a085256154cd437cb354caaa5c7271bf&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:05:58.891351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90a522-db7a-450a-925b-c30a67186cdd None admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:05:58.985507 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:59.016031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90a522-db7a-450a-925b-c30a67186cdd None admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:05:59.077203 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb50504-4a6a-4de3-822c-859b5bb242f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:05:59.078065 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb50504-4a6a-4de3-822c-859b5bb242f0 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:05:59.078455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb50504-4a6a-4de3-822c-859b5bb242f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:05:59.078891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb50504-4a6a-4de3-822c-859b5bb242f0 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:05:59.079796 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb50504-4a6a-4de3-822c-859b5bb242f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:05:59.081924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb50504-4a6a-4de3-822c-859b5bb242f0 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:05:59.091816 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 644/1301] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Aug 10 13:05:58 2022] GET /identity/v3/services => generated 2191 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:06:01.186012 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d6364-09a9-4508-9967-bb0456530ed4 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:06:01.186606 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d6364-09a9-4508-9967-bb0456530ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:06:01.186606 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d6364-09a9-4508-9967-bb0456530ed4 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:06:01.188170 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 658/1302] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:06:01.194262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea846c0-4da7-45d2-a26a-b5e91c41738a None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:06:01.194805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea846c0-4da7-45d2-a26a-b5e91c41738a None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:06:01.194805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea846c0-4da7-45d2-a26a-b5e91c41738a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:06:01.214707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-9ea846c0-4da7-45d2-a26a-b5e91c41738a None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:06:01.216308 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-9ea846c0-4da7-45d2-a26a-b5e91c41738a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:06:01.297431 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 645/1303] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:06:01 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 13:06:01.324538 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d6364-09a9-4508-9967-bb0456530ed4 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:06:01.478486 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:06:01.487752 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d6364-09a9-4508-9967-bb0456530ed4 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:06:01.535952 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d6cca-fc4e-42ba-8c5c-d5b739a71ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:06:01.536598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d6cca-fc4e-42ba-8c5c-d5b739a71ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:06:01.536877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d6cca-fc4e-42ba-8c5c-d5b739a71ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:06:01.537149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d6cca-fc4e-42ba-8c5c-d5b739a71ff0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:06:01.537738 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d6cca-fc4e-42ba-8c5c-d5b739a71ff0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:06:01.539170 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d6cca-fc4e-42ba-8c5c-d5b739a71ff0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:06:01.552689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b24d6cca-fc4e-42ba-8c5c-d5b739a71ff0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 13:06:01.552689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:06:01.552689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 13:06:01.552689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 13:06:01.552689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 13:06:01.552689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 13:06:01.552689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 13:06:01.552689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:06:01.552689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 13:06:01.552689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:06:01.552689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 13:06:01.552689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:06:01.552689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 13:06:01.552689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 13:06:01.552689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 13:06:01.552689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 13:06:01.552689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 13:06:01.554690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 13:06:01.554690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 13:06:01.554690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 13:06:01.554690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 13:06:01.554690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 13:06:01.554690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 13:06:01.554690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 13:06:01.554690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 13:06:01.554690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 13:06:01.554690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 13:06:01.554690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 13:06:01.554690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 13:06:01.554690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 13:06:01.554690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 13:06:01.554690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 13:06:01.554690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 13:06:01.556564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 13:06:01.556564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Aug 10 13:06:01.556564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 13:06:01.556564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Aug 10 13:06:01.556564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 13:06:01.556564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 13:06:01.556564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 13:06:01.556564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Aug 10 13:06:01.556564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 13:06:01.556564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Aug 10 13:06:01.556564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 13:06:01.556564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 13:06:01.556564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 13:06:01.556564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: ERROR keystone.server.flask.application Aug 10 13:06:01.556564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 659/1304] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Aug 10 13:06:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 13:06:01.564529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea846c0-4da7-45d2-a26a-b5e91c41738a None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:06:01.668280 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:06:01.698971 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea846c0-4da7-45d2-a26a-b5e91c41738a None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:06:01.757450 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec588c-0316-405c-a32d-d127dbc10339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:06:01.758474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec588c-0316-405c-a32d-d127dbc10339 None admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:06:01.758967 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec588c-0316-405c-a32d-d127dbc10339 None admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:06:01.759505 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec588c-0316-405c-a32d-d127dbc10339 None admin] PATH_INFO: `/v3/services` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:06:01.760723 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec588c-0316-405c-a32d-d127dbc10339 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:06:01.761279 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec588c-0316-405c-a32d-d127dbc10339 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:06:01.763950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec588c-0316-405c-a32d-d127dbc10339 None admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:06:01.774044 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 646/1305] 10.222.0.46 () {56 vars in 1116 bytes} [Wed Aug 10 13:06:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:06:01.782292 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d6cca-fc4e-42ba-8c5c-d5b739a71ff0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:06:01.908251 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d6cca-fc4e-42ba-8c5c-d5b739a71ff0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:06:01.952003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40596944-64b1-45f0-93e8-8ac4e3c9057f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:06:01.953056 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40596944-64b1-45f0-93e8-8ac4e3c9057f None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:06:01.953509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40596944-64b1-45f0-93e8-8ac4e3c9057f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:06:01.953962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40596944-64b1-45f0-93e8-8ac4e3c9057f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:06:01.954951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40596944-64b1-45f0-93e8-8ac4e3c9057f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:06:01.956560 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40596944-64b1-45f0-93e8-8ac4e3c9057f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:06:01.983377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 660/1306] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:06:01 2022] POST /identity/v3/endpoints => generated 331 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:06:11.767648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=30 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:06:11.977044 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:14.962571 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502e10d-b43a-454a-8775-7a5748e4f6bd None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:14.963261 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502e10d-b43a-454a-8775-7a5748e4f6bd None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:14.963589 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502e10d-b43a-454a-8775-7a5748e4f6bd None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:14.966679 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 647/1307] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:07:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:07:14.976613 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b7f2c-550c-459d-987a-67b680c831f9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:14.977265 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b7f2c-550c-459d-987a-67b680c831f9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:14.977598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b7f2c-550c-459d-987a-67b680c831f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:15.133526 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9c5b7f2c-550c-459d-987a-67b680c831f9 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:07:15.135830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9c5b7f2c-550c-459d-987a-67b680c831f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:15.298582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 661/1308] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:07:15.364570 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42546b2e-7073-4068-be65-c9db8c100551 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:15.365213 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42546b2e-7073-4068-be65-c9db8c100551 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:15.365649 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42546b2e-7073-4068-be65-c9db8c100551 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:15.368906 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 648/1309] 10.222.0.46 () {54 vars in 965 bytes} [Wed Aug 10 13:07:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:07:15.379238 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc309b5d-d4d8-4a05-845d-0e55a6e3dc83 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:15.379827 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc309b5d-d4d8-4a05-845d-0e55a6e3dc83 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:15.380664 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc309b5d-d4d8-4a05-845d-0e55a6e3dc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:15.550597 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-bc309b5d-d4d8-4a05-845d-0e55a6e3dc83 None None] MFA Rules not processed for user `49b69dad00934ce78cbede99f976439f`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:07:15.553018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bc309b5d-d4d8-4a05-845d-0e55a6e3dc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:15.601723 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:15.744734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 662/1310] 10.222.0.46 () {58 vars in 1062 bytes} [Wed Aug 10 13:07:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:07:15.746330 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42546b2e-7073-4068-be65-c9db8c100551 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:07:15.749529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-42546b2e-7073-4068-be65-c9db8c100551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:15.992606 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42546b2e-7073-4068-be65-c9db8c100551 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:07:16.115379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14627d-252e-4124-a964-3750d993d3a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:07:16.116676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14627d-252e-4124-a964-3750d993d3a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:16.116980 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14627d-252e-4124-a964-3750d993d3a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:16.117259 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14627d-252e-4124-a964-3750d993d3a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:16.119367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-ac14627d-252e-4124-a964-3750d993d3a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:16.201054 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:16.278320 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14627d-252e-4124-a964-3750d993d3a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:07:16.279955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14627d-252e-4124-a964-3750d993d3a2 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:07:16.304402 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 649/1311] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:07:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:07:18.984538 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d520d-2daf-4534-bc79-86dbd7f786fa None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:18.985300 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d520d-2daf-4534-bc79-86dbd7f786fa None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:18.985300 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d520d-2daf-4534-bc79-86dbd7f786fa None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:18.986783 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 663/1312] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:07:18.993203 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857533a-052c-4dda-9d25-87935a572516 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:18.994021 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857533a-052c-4dda-9d25-87935a572516 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:18.994179 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857533a-052c-4dda-9d25-87935a572516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:19.102971 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-7857533a-052c-4dda-9d25-87935a572516 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:07:19.104228 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7857533a-052c-4dda-9d25-87935a572516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:19.228864 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 650/1313] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:07:19.285066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def85ae-9318-42f3-9926-8a9a0908e53f None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:19.285345 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def85ae-9318-42f3-9926-8a9a0908e53f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:19.285711 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def85ae-9318-42f3-9926-8a9a0908e53f None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:19.287308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 664/1314] 10.222.0.46 () {54 vars in 965 bytes} [Wed Aug 10 13:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:07:19.294106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d25c14-5112-4d4c-9625-0f8fc44bb3f6 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:19.294400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d25c14-5112-4d4c-9625-0f8fc44bb3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:19.294673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d25c14-5112-4d4c-9625-0f8fc44bb3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:19.310699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:19.391309 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-69d25c14-5112-4d4c-9625-0f8fc44bb3f6 None None] MFA Rules not processed for user `49b69dad00934ce78cbede99f976439f`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:07:19.393451 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-69d25c14-5112-4d4c-9625-0f8fc44bb3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:19.481921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 651/1315] 10.222.0.46 () {58 vars in 1062 bytes} [Wed Aug 10 13:07:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:07:19.492715 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def85ae-9318-42f3-9926-8a9a0908e53f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:07:19.494540 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7def85ae-9318-42f3-9926-8a9a0908e53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:19.626129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def85ae-9318-42f3-9926-8a9a0908e53f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:07:19.704709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:19.707636 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28406e7a-8b6e-40b2-9c0c-7bea4738fe14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:07:19.708897 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28406e7a-8b6e-40b2-9c0c-7bea4738fe14 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:19.709400 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28406e7a-8b6e-40b2-9c0c-7bea4738fe14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:19.709786 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28406e7a-8b6e-40b2-9c0c-7bea4738fe14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:19.711877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-28406e7a-8b6e-40b2-9c0c-7bea4738fe14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:19.839537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28406e7a-8b6e-40b2-9c0c-7bea4738fe14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:07:19.841038 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28406e7a-8b6e-40b2-9c0c-7bea4738fe14 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:07:19.863228 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 665/1316] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:07:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:07:22.762628 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb49e1e-8cd4-4536-a424-1715427a5be9 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:22.763488 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb49e1e-8cd4-4536-a424-1715427a5be9 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:22.764005 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb49e1e-8cd4-4536-a424-1715427a5be9 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:22.767139 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 652/1317] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:07:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:07:22.773406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a91ed-0a3c-4385-a68f-80c172a0bb8b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:22.774232 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a91ed-0a3c-4385-a68f-80c172a0bb8b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:22.774232 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a91ed-0a3c-4385-a68f-80c172a0bb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:22.856865 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-209a91ed-0a3c-4385-a68f-80c172a0bb8b None None] MFA Rules not processed for user `3e999bbc5d4a4abe863d44cfcf3acf0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:07:22.858357 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-209a91ed-0a3c-4385-a68f-80c172a0bb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:22.917362 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:22.973663 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 666/1318] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:07:22 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:07:23.020209 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb49e1e-8cd4-4536-a424-1715427a5be9 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:07:23.022477 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3bb49e1e-8cd4-4536-a424-1715427a5be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:23.148249 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb49e1e-8cd4-4536-a424-1715427a5be9 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:07:23.154402 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:23.260884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ad36f-d479-4bfe-9fad-924735631a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:07:23.261509 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ad36f-d479-4bfe-9fad-924735631a60 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:23.261785 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ad36f-d479-4bfe-9fad-924735631a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:23.262054 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ad36f-d479-4bfe-9fad-924735631a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:23.264537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-b14ad36f-d479-4bfe-9fad-924735631a60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:23.448383 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ad36f-d479-4bfe-9fad-924735631a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:07:23.451138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ad36f-d479-4bfe-9fad-924735631a60 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:07:23.484921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 653/1319] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:07:23 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:07:26.688151 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069411ad-8dcc-4a6f-a144-4f3a31782dc6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:26.688763 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069411ad-8dcc-4a6f-a144-4f3a31782dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:26.689100 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069411ad-8dcc-4a6f-a144-4f3a31782dc6 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:26.691839 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 667/1320] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:07:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:07:26.702326 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2fe76-c88a-41d1-8073-439018539748 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:26.703239 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2fe76-c88a-41d1-8073-439018539748 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:26.703402 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2fe76-c88a-41d1-8073-439018539748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:26.770908 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:26.830665 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-84c2fe76-c88a-41d1-8073-439018539748 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:07:26.832551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-84c2fe76-c88a-41d1-8073-439018539748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:27.031486 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 654/1321] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:07:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:07:27.077169 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069411ad-8dcc-4a6f-a144-4f3a31782dc6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:07:27.078739 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-069411ad-8dcc-4a6f-a144-4f3a31782dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:27.228585 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069411ad-8dcc-4a6f-a144-4f3a31782dc6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:07:27.345875 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2496c2-9889-4dc6-8ec2-f8d47fc6eff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:07:27.346918 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2496c2-9889-4dc6-8ec2-f8d47fc6eff8 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:27.347458 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2496c2-9889-4dc6-8ec2-f8d47fc6eff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:27.347946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2496c2-9889-4dc6-8ec2-f8d47fc6eff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:27.351932 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9d2496c2-9889-4dc6-8ec2-f8d47fc6eff8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:27.379236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:27.533976 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2496c2-9889-4dc6-8ec2-f8d47fc6eff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:07:27.535660 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2496c2-9889-4dc6-8ec2-f8d47fc6eff8 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:07:27.558604 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 668/1322] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:07:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:07:31.007252 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782d97c-8560-4ed5-a2e3-3919b332dec2 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:31.007890 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782d97c-8560-4ed5-a2e3-3919b332dec2 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:31.007890 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782d97c-8560-4ed5-a2e3-3919b332dec2 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:31.009131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 655/1323] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:07:31.015122 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71883c0-fae5-465b-b9cb-d72bfc64dfe7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:31.015690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71883c0-fae5-465b-b9cb-d72bfc64dfe7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:31.015690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71883c0-fae5-465b-b9cb-d72bfc64dfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:31.097661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b71883c0-fae5-465b-b9cb-d72bfc64dfe7 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:07:31.101397 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b71883c0-fae5-465b-b9cb-d72bfc64dfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:31.172548 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:31.220739 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 669/1324] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:07:31.261689 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782d97c-8560-4ed5-a2e3-3919b332dec2 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:07:31.263504 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3782d97c-8560-4ed5-a2e3-3919b332dec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:31.399934 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782d97c-8560-4ed5-a2e3-3919b332dec2 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:07:31.413501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:31.523043 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99330a0c-ef7c-451b-a6a4-1b6ebb44e5a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:07:31.523776 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99330a0c-ef7c-451b-a6a4-1b6ebb44e5a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:31.524126 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99330a0c-ef7c-451b-a6a4-1b6ebb44e5a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:31.524465 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99330a0c-ef7c-451b-a6a4-1b6ebb44e5a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:31.526442 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-99330a0c-ef7c-451b-a6a4-1b6ebb44e5a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:31.705022 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99330a0c-ef7c-451b-a6a4-1b6ebb44e5a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:07:31.707847 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99330a0c-ef7c-451b-a6a4-1b6ebb44e5a1 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:07:31.746225 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 656/1325] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:07:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:07:34.148192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca68a8-bde9-4fab-bb5a-e17bac7d85ab None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:34.149059 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca68a8-bde9-4fab-bb5a-e17bac7d85ab None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:34.149059 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca68a8-bde9-4fab-bb5a-e17bac7d85ab None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:34.150121 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 670/1326] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:07:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:07:34.156127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3fc09-f68a-4805-9dc0-ebc40f44131b None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:34.156976 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3fc09-f68a-4805-9dc0-ebc40f44131b None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:34.156976 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3fc09-f68a-4805-9dc0-ebc40f44131b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:34.218603 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:34.250889 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-12b3fc09-f68a-4805-9dc0-ebc40f44131b None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:07:34.252262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-12b3fc09-f68a-4805-9dc0-ebc40f44131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:34.399450 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 657/1327] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:07:34.440246 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca68a8-bde9-4fab-bb5a-e17bac7d85ab None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:07:34.443270 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0cca68a8-bde9-4fab-bb5a-e17bac7d85ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:34.621483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca68a8-bde9-4fab-bb5a-e17bac7d85ab None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:07:34.753464 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3423a5f-1524-4b76-adfc-56bc7545772a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:07:34.754468 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3423a5f-1524-4b76-adfc-56bc7545772a service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:34.754956 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3423a5f-1524-4b76-adfc-56bc7545772a service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:34.755494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3423a5f-1524-4b76-adfc-56bc7545772a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:34.759938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d3423a5f-1524-4b76-adfc-56bc7545772a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:34.794004 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:34.966769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3423a5f-1524-4b76-adfc-56bc7545772a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:07:34.968549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3423a5f-1524-4b76-adfc-56bc7545772a service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:07:35.003736 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 671/1328] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:07:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:07:37.216509 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2e46c-15c3-476d-ac65-2aec41285a90 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:37.217396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2e46c-15c3-476d-ac65-2aec41285a90 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:37.217396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2e46c-15c3-476d-ac65-2aec41285a90 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:37.218455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 658/1329] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:07:37.226115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be60f5-45bb-438f-a706-72be1fa4d12e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:37.227121 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be60f5-45bb-438f-a706-72be1fa4d12e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:37.227502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be60f5-45bb-438f-a706-72be1fa4d12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:37.315504 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b1be60f5-45bb-438f-a706-72be1fa4d12e None None] MFA Rules not processed for user `3e999bbc5d4a4abe863d44cfcf3acf0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:07:37.317508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b1be60f5-45bb-438f-a706-72be1fa4d12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:37.400569 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:37.440740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 672/1330] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:07:37 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:07:37.482396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2e46c-15c3-476d-ac65-2aec41285a90 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:07:37.483992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-ccc2e46c-15c3-476d-ac65-2aec41285a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:37.621966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2e46c-15c3-476d-ac65-2aec41285a90 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:07:37.645753 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:37.711633 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea8c4e-e748-4c08-8cd4-48598a8b7061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:07:37.712244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea8c4e-e748-4c08-8cd4-48598a8b7061 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:37.712519 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea8c4e-e748-4c08-8cd4-48598a8b7061 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:37.712786 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea8c4e-e748-4c08-8cd4-48598a8b7061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:37.714701 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7aea8c4e-e748-4c08-8cd4-48598a8b7061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:37.857844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea8c4e-e748-4c08-8cd4-48598a8b7061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:07:37.860651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea8c4e-e748-4c08-8cd4-48598a8b7061 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:07:37.891379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 659/1331] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:07:37 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:07:40.514250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90b6ff-b657-4907-85cb-a45dc231e0c6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:40.514858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90b6ff-b657-4907-85cb-a45dc231e0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:40.514858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90b6ff-b657-4907-85cb-a45dc231e0c6 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:40.516258 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 673/1332] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:07:40.523418 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96d5cc-abba-403a-b87f-da7be5b0b873 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:40.524231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96d5cc-abba-403a-b87f-da7be5b0b873 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:40.524231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96d5cc-abba-403a-b87f-da7be5b0b873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:40.597785 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:40.601126 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-0b96d5cc-abba-403a-b87f-da7be5b0b873 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:07:40.603184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-0b96d5cc-abba-403a-b87f-da7be5b0b873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:40.718752 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 660/1333] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:07:40.757658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90b6ff-b657-4907-85cb-a45dc231e0c6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:07:40.759337 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fe90b6ff-b657-4907-85cb-a45dc231e0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:40.880978 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90b6ff-b657-4907-85cb-a45dc231e0c6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:07:40.974774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d65972-34dc-44dd-bbd8-24a2ff95513f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:07:40.976093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d65972-34dc-44dd-bbd8-24a2ff95513f service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:40.977483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d65972-34dc-44dd-bbd8-24a2ff95513f service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:40.977802 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d65972-34dc-44dd-bbd8-24a2ff95513f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:40.979766 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e9d65972-34dc-44dd-bbd8-24a2ff95513f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:41.028433 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:41.126360 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d65972-34dc-44dd-bbd8-24a2ff95513f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:07:41.127875 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d65972-34dc-44dd-bbd8-24a2ff95513f service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:07:41.150508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 674/1334] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:07:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:07:43.363247 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450bb35-2409-494a-8933-dc2795e96bac None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:43.363939 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450bb35-2409-494a-8933-dc2795e96bac None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:43.363939 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450bb35-2409-494a-8933-dc2795e96bac None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:43.365819 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 661/1335] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:07:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:07:43.372740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff93cc9-864f-48f5-a61e-70b60013f5c2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:43.373277 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff93cc9-864f-48f5-a61e-70b60013f5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:43.373692 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff93cc9-864f-48f5-a61e-70b60013f5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:43.498154 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-cff93cc9-864f-48f5-a61e-70b60013f5c2 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:07:43.499723 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cff93cc9-864f-48f5-a61e-70b60013f5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:43.596234 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:43.626100 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 675/1336] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:07:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:07:43.669113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450bb35-2409-494a-8933-dc2795e96bac None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:07:43.670645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-f450bb35-2409-494a-8933-dc2795e96bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:43.791930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450bb35-2409-494a-8933-dc2795e96bac None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:07:43.824406 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:43.874772 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bedfc9-e14f-4bbc-ae89-3381c80e2850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:07:43.875322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bedfc9-e14f-4bbc-ae89-3381c80e2850 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:43.875597 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bedfc9-e14f-4bbc-ae89-3381c80e2850 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:43.875864 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bedfc9-e14f-4bbc-ae89-3381c80e2850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:43.877797 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-09bedfc9-e14f-4bbc-ae89-3381c80e2850 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:44.017727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bedfc9-e14f-4bbc-ae89-3381c80e2850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:07:44.020522 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bedfc9-e14f-4bbc-ae89-3381c80e2850 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:07:44.057289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 662/1337] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:07:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:07:46.631044 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf1682-d157-4461-8022-a7acbd691066 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:46.631710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf1682-d157-4461-8022-a7acbd691066 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:46.631710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf1682-d157-4461-8022-a7acbd691066 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:46.632970 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 676/1338] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:07:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:07:46.639624 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bb71b-7caa-4915-a27a-a3d601e96c5e None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:46.640499 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bb71b-7caa-4915-a27a-a3d601e96c5e None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:46.640697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bb71b-7caa-4915-a27a-a3d601e96c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:46.719581 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-e06bb71b-7caa-4915-a27a-a3d601e96c5e None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:07:46.720831 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-e06bb71b-7caa-4915-a27a-a3d601e96c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:46.731069 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:46.836623 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 663/1339] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:07:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:07:46.874187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf1682-d157-4461-8022-a7acbd691066 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:07:46.875858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3bdf1682-d157-4461-8022-a7acbd691066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:47.010308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf1682-d157-4461-8022-a7acbd691066 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:07:47.158598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52094c0-4ac3-42e2-ab4b-e847b29c8daa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:07:47.159706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52094c0-4ac3-42e2-ab4b-e847b29c8daa service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:47.160199 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52094c0-4ac3-42e2-ab4b-e847b29c8daa service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:47.160648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52094c0-4ac3-42e2-ab4b-e847b29c8daa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:47.164183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f52094c0-4ac3-42e2-ab4b-e847b29c8daa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:47.230209 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:47.349587 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52094c0-4ac3-42e2-ab4b-e847b29c8daa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:07:47.351103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52094c0-4ac3-42e2-ab4b-e847b29c8daa service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:07:47.373055 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 677/1340] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:07:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:07:51.897855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51321933-563e-420b-b39b-940dfd276426 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:51.898545 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51321933-563e-420b-b39b-940dfd276426 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:51.899039 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51321933-563e-420b-b39b-940dfd276426 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:51.901636 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 664/1341] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:07:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:07:51.909917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc7463-f3a0-4127-a25a-87a31ee297bb None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:51.910494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc7463-f3a0-4127-a25a-87a31ee297bb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:51.910926 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc7463-f3a0-4127-a25a-87a31ee297bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:52.011189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6cfc7463-f3a0-4127-a25a-87a31ee297bb None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:07:52.012456 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6cfc7463-f3a0-4127-a25a-87a31ee297bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:52.119588 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:52.133162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 678/1342] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:07:52.173800 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51321933-563e-420b-b39b-940dfd276426 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:07:52.175380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-51321933-563e-420b-b39b-940dfd276426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:52.315314 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51321933-563e-420b-b39b-940dfd276426 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:07:52.360820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:52.406113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576f6d6-aa2b-4e27-9d55-3b6425a2ca93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:07:52.406763 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576f6d6-aa2b-4e27-9d55-3b6425a2ca93 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:52.407059 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576f6d6-aa2b-4e27-9d55-3b6425a2ca93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:52.407331 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576f6d6-aa2b-4e27-9d55-3b6425a2ca93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:52.409004 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-2576f6d6-aa2b-4e27-9d55-3b6425a2ca93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:52.567615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576f6d6-aa2b-4e27-9d55-3b6425a2ca93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:07:52.569068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576f6d6-aa2b-4e27-9d55-3b6425a2ca93 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:07:52.591891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 665/1343] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:07:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:07:55.790136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f80347-9b18-46df-86b8-f4fb2a8d4215 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:55.790880 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f80347-9b18-46df-86b8-f4fb2a8d4215 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:55.791098 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f80347-9b18-46df-86b8-f4fb2a8d4215 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:55.793890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 679/1344] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:07:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:07:55.802890 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ba56d-4556-4a1d-b6fa-2a6591e1f9df None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:55.803776 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ba56d-4556-4a1d-b6fa-2a6591e1f9df None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:55.803776 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ba56d-4556-4a1d-b6fa-2a6591e1f9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:55.897491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-5c1ba56d-4556-4a1d-b6fa-2a6591e1f9df None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:07:55.900205 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-5c1ba56d-4556-4a1d-b6fa-2a6591e1f9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:55.938378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:56.089610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 666/1345] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:07:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:07:56.132410 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f80347-9b18-46df-86b8-f4fb2a8d4215 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:07:56.134208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-14f80347-9b18-46df-86b8-f4fb2a8d4215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:56.269383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f80347-9b18-46df-86b8-f4fb2a8d4215 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:07:56.362082 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3dca30-5e9d-4bba-9317-e35afda30372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:07:56.362559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dca30-5e9d-4bba-9317-e35afda30372 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:07:56.362838 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dca30-5e9d-4bba-9317-e35afda30372 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:07:56.363142 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dca30-5e9d-4bba-9317-e35afda30372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:07:56.365451 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0d3dca30-5e9d-4bba-9317-e35afda30372 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:07:56.420739 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:56.544067 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3dca30-5e9d-4bba-9317-e35afda30372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:07:56.546480 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3dca30-5e9d-4bba-9317-e35afda30372 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:07:56.574352 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 680/1346] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:07:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:08:01.918678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914c99b-b898-4638-a9f9-ee11e3212392 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:01.919502 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914c99b-b898-4638-a9f9-ee11e3212392 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:01.919686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914c99b-b898-4638-a9f9-ee11e3212392 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:01.922278 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 667/1347] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:08:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:08:01.930495 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250578b-a708-445a-abba-230d93af0673 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:01.931428 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250578b-a708-445a-abba-230d93af0673 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:01.931428 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250578b-a708-445a-abba-230d93af0673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:02.022250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4250578b-a708-445a-abba-230d93af0673 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:02.023571 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4250578b-a708-445a-abba-230d93af0673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:02.199324 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:02.203259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 681/1348] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:08:02.265807 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914c99b-b898-4638-a9f9-ee11e3212392 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:08:02.267590 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-2914c99b-b898-4638-a9f9-ee11e3212392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:02.415183 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914c99b-b898-4638-a9f9-ee11e3212392 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:08:02.474789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:02.515528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04306e1c-a78d-41c5-9a2c-d80bff639486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:08:02.516577 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04306e1c-a78d-41c5-9a2c-d80bff639486 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:02.517006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04306e1c-a78d-41c5-9a2c-d80bff639486 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:02.517356 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04306e1c-a78d-41c5-9a2c-d80bff639486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:02.519229 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-04306e1c-a78d-41c5-9a2c-d80bff639486 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:02.693303 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04306e1c-a78d-41c5-9a2c-d80bff639486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:08:02.694987 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04306e1c-a78d-41c5-9a2c-d80bff639486 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:08:02.720241 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 668/1349] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:08:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:08:08.440880 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919f308-87df-4e5a-ba6a-eaac04a11e8f None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:08.442120 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919f308-87df-4e5a-ba6a-eaac04a11e8f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:08.442120 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919f308-87df-4e5a-ba6a-eaac04a11e8f None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:08.445480 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 682/1350] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 10 13:08:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:08:08.452594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c026e-75a9-41a0-bc41-2a5da817f7e3 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:08.453131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c026e-75a9-41a0-bc41-2a5da817f7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:08.453131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c026e-75a9-41a0-bc41-2a5da817f7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:08.558910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-bd7c026e-75a9-41a0-bc41-2a5da817f7e3 None None] MFA Rules not processed for user `15780b69faa745e9b99f1fffb6abe231`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:08.560383 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-bd7c026e-75a9-41a0-bc41-2a5da817f7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:08.593643 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:08.711855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 669/1351] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 10 13:08:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:08:14.384864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326077ef-8123-4bd2-bd33-bfc169316867 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:14.385723 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326077ef-8123-4bd2-bd33-bfc169316867 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:14.386138 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326077ef-8123-4bd2-bd33-bfc169316867 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:14.387812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 683/1352] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 10 13:08:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:08:14.393476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a2dac-f454-4ee1-a5de-eb4a5fb91ac0 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:14.394878 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a2dac-f454-4ee1-a5de-eb4a5fb91ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:14.394878 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a2dac-f454-4ee1-a5de-eb4a5fb91ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:14.495741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-599a2dac-f454-4ee1-a5de-eb4a5fb91ac0 None None] MFA Rules not processed for user `15780b69faa745e9b99f1fffb6abe231`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:14.497037 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-599a2dac-f454-4ee1-a5de-eb4a5fb91ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:14.592258 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:14.650158 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 670/1353] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 10 13:08:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:08:16.312594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83faa2c3-365b-4aa7-89a0-7871a9971d02 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:16.313345 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83faa2c3-365b-4aa7-89a0-7871a9971d02 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:16.313345 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83faa2c3-365b-4aa7-89a0-7871a9971d02 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:16.315691 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 684/1354] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 10 13:08:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:08:16.322585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dea5f3-3cac-4041-8008-d90c2a440916 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:16.323373 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dea5f3-3cac-4041-8008-d90c2a440916 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:16.323373 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dea5f3-3cac-4041-8008-d90c2a440916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:16.422888 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-e3dea5f3-3cac-4041-8008-d90c2a440916 None None] MFA Rules not processed for user `15780b69faa745e9b99f1fffb6abe231`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:16.424131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-e3dea5f3-3cac-4041-8008-d90c2a440916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:16.556385 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 671/1355] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 10 13:08:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:08:20.321601 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df427b8-3f61-4e03-82b9-9ab994c0c952 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:20.322583 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df427b8-3f61-4e03-82b9-9ab994c0c952 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:20.322583 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df427b8-3f61-4e03-82b9-9ab994c0c952 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:20.324000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 685/1356] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:08:20.333258 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b8a7e-8f62-4684-807b-1773d40b4db8 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:20.334096 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b8a7e-8f62-4684-807b-1773d40b4db8 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:20.334096 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b8a7e-8f62-4684-807b-1773d40b4db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:20.380875 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:20.422419 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-ba1b8a7e-8f62-4684-807b-1773d40b4db8 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:20.423941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-ba1b8a7e-8f62-4684-807b-1773d40b4db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:20.624635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 672/1357] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:08:20.691944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8840da-7e16-465d-b854-e26de08da035 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:20.693835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8840da-7e16-465d-b854-e26de08da035 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:20.694415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8840da-7e16-465d-b854-e26de08da035 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:20.697647 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 686/1358] 10.222.0.46 () {54 vars in 962 bytes} [Wed Aug 10 13:08:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:08:20.707665 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a85784-8db6-462c-9455-39fda03cbb13 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:20.708286 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a85784-8db6-462c-9455-39fda03cbb13 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:20.708744 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a85784-8db6-462c-9455-39fda03cbb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:20.836729 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-85a85784-8db6-462c-9455-39fda03cbb13 None None] MFA Rules not processed for user `7fd0f76f24ea481191dfd65fff2376af`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:20.838813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-85a85784-8db6-462c-9455-39fda03cbb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:20.919826 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:21.035259 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 673/1359] 10.222.0.46 () {58 vars in 1059 bytes} [Wed Aug 10 13:08:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:08:21.039152 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8840da-7e16-465d-b854-e26de08da035 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:08:21.042163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1a8840da-7e16-465d-b854-e26de08da035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:21.285832 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8840da-7e16-465d-b854-e26de08da035 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:08:21.411140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:21.501816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0576488-001d-4ff4-ad63-325aa51c4b35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:08:21.503303 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0576488-001d-4ff4-ad63-325aa51c4b35 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:21.504651 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0576488-001d-4ff4-ad63-325aa51c4b35 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:21.505284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0576488-001d-4ff4-ad63-325aa51c4b35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:21.508904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e0576488-001d-4ff4-ad63-325aa51c4b35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:21.694981 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0576488-001d-4ff4-ad63-325aa51c4b35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:08:21.698003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0576488-001d-4ff4-ad63-325aa51c4b35 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:08:21.735320 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 687/1360] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:08:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:08:24.715214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efaa2dc-3800-4199-b77f-b18c8e80d864 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:24.716276 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efaa2dc-3800-4199-b77f-b18c8e80d864 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:24.717276 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efaa2dc-3800-4199-b77f-b18c8e80d864 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:24.720168 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 674/1361] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:08:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:08:24.726112 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92796961-bf48-445f-a3ab-182ac5573dc6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:24.726889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92796961-bf48-445f-a3ab-182ac5573dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:24.726889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92796961-bf48-445f-a3ab-182ac5573dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:24.820394 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-92796961-bf48-445f-a3ab-182ac5573dc6 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:24.821760 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-92796961-bf48-445f-a3ab-182ac5573dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:24.874235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:24.959678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 688/1362] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:08:25.024524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efaa2dc-3800-4199-b77f-b18c8e80d864 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:08:25.027972 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-1efaa2dc-3800-4199-b77f-b18c8e80d864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:25.286873 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efaa2dc-3800-4199-b77f-b18c8e80d864 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:08:25.299257 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:25.456171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb4b57-3b7a-4ff9-8538-b1f7b09cdbd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:08:25.457647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb4b57-3b7a-4ff9-8538-b1f7b09cdbd4 service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:25.457924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb4b57-3b7a-4ff9-8538-b1f7b09cdbd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:25.458289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb4b57-3b7a-4ff9-8538-b1f7b09cdbd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:25.460387 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-0bdb4b57-3b7a-4ff9-8538-b1f7b09cdbd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:25.604934 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb4b57-3b7a-4ff9-8538-b1f7b09cdbd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:08:25.608598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb4b57-3b7a-4ff9-8538-b1f7b09cdbd4 service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:08:25.637410 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 675/1363] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:08:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:08:28.521449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7928831-696e-4d29-9a82-530eebbb0c87 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:28.522127 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7928831-696e-4d29-9a82-530eebbb0c87 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:28.522361 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7928831-696e-4d29-9a82-530eebbb0c87 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:28.531767 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 689/1364] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:08:28 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:08:28.533835 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ea5d4-4ed7-4f14-a6ec-202ba1fff700 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:28.535130 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ea5d4-4ed7-4f14-a6ec-202ba1fff700 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:28.535435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ea5d4-4ed7-4f14-a6ec-202ba1fff700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:28.567040 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:28.668502 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-949ea5d4-4ed7-4f14-a6ec-202ba1fff700 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:28.670911 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-949ea5d4-4ed7-4f14-a6ec-202ba1fff700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:28.889142 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 676/1365] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:08:28.967430 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1865c67-2a97-4c29-9373-4529efc1cb7c None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:28.968395 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1865c67-2a97-4c29-9373-4529efc1cb7c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:28.968975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1865c67-2a97-4c29-9373-4529efc1cb7c None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:28.971691 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 690/1366] 10.222.0.46 () {54 vars in 962 bytes} [Wed Aug 10 13:08:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:08:28.986853 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b7403-f447-4801-8957-b72cda9d6564 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:28.986853 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b7403-f447-4801-8957-b72cda9d6564 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:28.986853 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b7403-f447-4801-8957-b72cda9d6564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:29.149413 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-329b7403-f447-4801-8957-b72cda9d6564 None None] MFA Rules not processed for user `7fd0f76f24ea481191dfd65fff2376af`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:29.151574 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-329b7403-f447-4801-8957-b72cda9d6564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:29.229533 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:29.412238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 677/1367] 10.222.0.46 () {58 vars in 1059 bytes} [Wed Aug 10 13:08:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:08:29.428835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1865c67-2a97-4c29-9373-4529efc1cb7c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:08:29.431848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b1865c67-2a97-4c29-9373-4529efc1cb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:29.739613 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1865c67-2a97-4c29-9373-4529efc1cb7c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:08:29.782362 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:29.992704 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d85bd0-eecc-4195-bc8d-13e313442de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:08:29.995111 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d85bd0-eecc-4195-bc8d-13e313442de4 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:29.996006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d85bd0-eecc-4195-bc8d-13e313442de4 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:29.997050 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d85bd0-eecc-4195-bc8d-13e313442de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:30.000932 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-38d85bd0-eecc-4195-bc8d-13e313442de4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:30.182471 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d85bd0-eecc-4195-bc8d-13e313442de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:08:30.185578 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d85bd0-eecc-4195-bc8d-13e313442de4 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:08:30.221582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 691/1368] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:08:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 794 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:08:30.677605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4712bf5-dc62-4fdd-9f8d-39e745227169 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:30.705944 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4712bf5-dc62-4fdd-9f8d-39e745227169 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:30.705944 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4712bf5-dc62-4fdd-9f8d-39e745227169 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:30.705944 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 678/1369] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:08:30 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:08:30.706890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8376ab3-1287-46d4-86b5-19c0ef537eb0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:30.706890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8376ab3-1287-46d4-86b5-19c0ef537eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:30.706890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8376ab3-1287-46d4-86b5-19c0ef537eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:30.762953 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:30.839879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b8376ab3-1287-46d4-86b5-19c0ef537eb0 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:30.844379 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b8376ab3-1287-46d4-86b5-19c0ef537eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:31.074493 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 692/1370] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:08:31.396733 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68547913-b715-4db3-87d4-5f8ba1ae2ccb None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:31.397058 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68547913-b715-4db3-87d4-5f8ba1ae2ccb None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:31.397377 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68547913-b715-4db3-87d4-5f8ba1ae2ccb None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:31.398909 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 679/1371] 10.222.0.46 () {54 vars in 964 bytes} [Wed Aug 10 13:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:08:31.404368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb57a8-68c8-45da-bf4e-dd405cbc4cb7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:31.404668 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb57a8-68c8-45da-bf4e-dd405cbc4cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:31.404995 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb57a8-68c8-45da-bf4e-dd405cbc4cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:31.504235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ebfb57a8-68c8-45da-bf4e-dd405cbc4cb7 None None] MFA Rules not processed for user `ad44decbbaee4d11ac076220bb9c7f40`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:31.505481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ebfb57a8-68c8-45da-bf4e-dd405cbc4cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:31.576741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:31.649697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 693/1372] 10.222.0.46 () {58 vars in 1061 bytes} [Wed Aug 10 13:08:31 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:08:31.665454 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68547913-b715-4db3-87d4-5f8ba1ae2ccb None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:08:31.668935 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-68547913-b715-4db3-87d4-5f8ba1ae2ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:31.849935 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68547913-b715-4db3-87d4-5f8ba1ae2ccb None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:08:31.911702 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:31.961106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ffe10-78a4-4819-81bb-920a6c8ceb6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:08:31.961722 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ffe10-78a4-4819-81bb-920a6c8ceb6b service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:31.961994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ffe10-78a4-4819-81bb-920a6c8ceb6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:31.962273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ffe10-78a4-4819-81bb-920a6c8ceb6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:31.964248 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-8a4ffe10-78a4-4819-81bb-920a6c8ceb6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:32.120891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ffe10-78a4-4819-81bb-920a6c8ceb6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:08:32.120891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ffe10-78a4-4819-81bb-920a6c8ceb6b service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:08:32.142289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 680/1373] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:08:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:08:32.529364 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654e711-e0c7-421b-936b-fe6cfd67e14b None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:32.530184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654e711-e0c7-421b-936b-fe6cfd67e14b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:32.530331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654e711-e0c7-421b-936b-fe6cfd67e14b None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:32.533742 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 694/1374] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:08:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:08:32.539620 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d326e-d568-4ab9-a050-c6f35a18d9b1 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:32.540155 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d326e-d568-4ab9-a050-c6f35a18d9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:32.540400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d326e-d568-4ab9-a050-c6f35a18d9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:32.667285 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-8a2d326e-d568-4ab9-a050-c6f35a18d9b1 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:32.670022 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-8a2d326e-d568-4ab9-a050-c6f35a18d9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:32.716153 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:32.841022 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 681/1375] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:08:32.889997 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654e711-e0c7-421b-936b-fe6cfd67e14b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:08:32.891637 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0654e711-e0c7-421b-936b-fe6cfd67e14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:33.072694 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654e711-e0c7-421b-936b-fe6cfd67e14b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:08:33.135857 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:33.210549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce49087-294e-4070-996d-fbf037ea1872 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:08:33.211112 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce49087-294e-4070-996d-fbf037ea1872 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:33.211436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce49087-294e-4070-996d-fbf037ea1872 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:33.211783 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce49087-294e-4070-996d-fbf037ea1872 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:33.214002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1ce49087-294e-4070-996d-fbf037ea1872 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:33.322049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce49087-294e-4070-996d-fbf037ea1872 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:08:33.324452 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce49087-294e-4070-996d-fbf037ea1872 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:08:33.345401 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 695/1376] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:08:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:08:35.563078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d927fcc-8326-47cc-bda4-fee6b42ac3b2 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:35.564113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d927fcc-8326-47cc-bda4-fee6b42ac3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:35.564595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d927fcc-8326-47cc-bda4-fee6b42ac3b2 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:35.567522 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 682/1377] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:08:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:08:35.573195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba7c8a-2634-40d8-9c15-74a92e84502b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:35.573844 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba7c8a-2634-40d8-9c15-74a92e84502b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:35.573844 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba7c8a-2634-40d8-9c15-74a92e84502b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:35.655262 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-1fba7c8a-2634-40d8-9c15-74a92e84502b None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:35.656772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1fba7c8a-2634-40d8-9c15-74a92e84502b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:35.665468 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:35.775887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 696/1378] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:08:35.827356 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d927fcc-8326-47cc-bda4-fee6b42ac3b2 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:08:35.829971 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-4d927fcc-8326-47cc-bda4-fee6b42ac3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:36.104386 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d927fcc-8326-47cc-bda4-fee6b42ac3b2 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:08:36.114536 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:36.306804 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bde39c-f1a5-46a8-b211-c85210746311 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:08:36.307453 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bde39c-f1a5-46a8-b211-c85210746311 service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:36.307877 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bde39c-f1a5-46a8-b211-c85210746311 service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:36.308152 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bde39c-f1a5-46a8-b211-c85210746311 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:36.309807 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-81bde39c-f1a5-46a8-b211-c85210746311 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:36.477516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bde39c-f1a5-46a8-b211-c85210746311 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:08:36.480654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bde39c-f1a5-46a8-b211-c85210746311 service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:08:36.518610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 683/1379] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:08:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:08:38.860688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782f215-2cb6-4ddd-ac5f-b349fce40f14 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:38.861467 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782f215-2cb6-4ddd-ac5f-b349fce40f14 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:38.861467 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782f215-2cb6-4ddd-ac5f-b349fce40f14 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:38.862952 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 697/1380] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:08:38.868584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfe662-b69a-4469-bc3e-7e8307c804b0 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:38.869386 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfe662-b69a-4469-bc3e-7e8307c804b0 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:38.869386 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfe662-b69a-4469-bc3e-7e8307c804b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:38.881622 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:38.960865 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-26dfe662-b69a-4469-bc3e-7e8307c804b0 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:38.962153 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-26dfe662-b69a-4469-bc3e-7e8307c804b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:39.147840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 684/1381] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:08:39.200669 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782f215-2cb6-4ddd-ac5f-b349fce40f14 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:08:39.202379 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7782f215-2cb6-4ddd-ac5f-b349fce40f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:39.396967 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:39.406913 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782f215-2cb6-4ddd-ac5f-b349fce40f14 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:08:39.607390 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d2db6-f0ce-4a0b-95a0-29d31172777f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:08:39.608662 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d2db6-f0ce-4a0b-95a0-29d31172777f service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:39.609160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d2db6-f0ce-4a0b-95a0-29d31172777f service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:39.609642 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d2db6-f0ce-4a0b-95a0-29d31172777f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:39.613024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0e1d2db6-f0ce-4a0b-95a0-29d31172777f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:39.799241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d2db6-f0ce-4a0b-95a0-29d31172777f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:08:39.803227 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d2db6-f0ce-4a0b-95a0-29d31172777f service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:08:39.826363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:39.858397 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 698/1382] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:08:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:08:42.711722 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea1fcf-a06f-4b95-9c37-9e4a84779d31 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:42.712804 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea1fcf-a06f-4b95-9c37-9e4a84779d31 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:42.713618 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea1fcf-a06f-4b95-9c37-9e4a84779d31 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:42.715309 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 685/1383] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:08:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:08:42.725703 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890a912-274f-4db1-abfe-bc16bc097e0a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:42.726263 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890a912-274f-4db1-abfe-bc16bc097e0a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:42.726650 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890a912-274f-4db1-abfe-bc16bc097e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:42.850080 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2890a912-274f-4db1-abfe-bc16bc097e0a None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:42.852225 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2890a912-274f-4db1-abfe-bc16bc097e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:43.064226 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 699/1384] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:08:43.124275 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea1fcf-a06f-4b95-9c37-9e4a84779d31 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:08:43.127158 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-abea1fcf-a06f-4b95-9c37-9e4a84779d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:43.276064 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:43.381130 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea1fcf-a06f-4b95-9c37-9e4a84779d31 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:08:43.581432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00c257-3b84-4673-8849-4ddd2f6241b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:08:43.582396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00c257-3b84-4673-8849-4ddd2f6241b3 service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:43.582901 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00c257-3b84-4673-8849-4ddd2f6241b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:43.583330 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00c257-3b84-4673-8849-4ddd2f6241b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:43.585491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-eb00c257-3b84-4673-8849-4ddd2f6241b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:43.671334 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:43.740714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00c257-3b84-4673-8849-4ddd2f6241b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:08:43.742482 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00c257-3b84-4673-8849-4ddd2f6241b3 service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:08:43.769494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 686/1385] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:08:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:08:46.111912 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da87a3f-f0bb-46b2-b418-1f4abf48b39f None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:46.113401 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da87a3f-f0bb-46b2-b418-1f4abf48b39f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:46.113401 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da87a3f-f0bb-46b2-b418-1f4abf48b39f None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:46.115363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 700/1386] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:08:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:08:46.123519 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b1212-4552-45c4-b283-3e662d7dbf47 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:46.124114 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b1212-4552-45c4-b283-3e662d7dbf47 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:46.124459 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b1212-4552-45c4-b283-3e662d7dbf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:46.208696 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-643b1212-4552-45c4-b283-3e662d7dbf47 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:46.210492 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-643b1212-4552-45c4-b283-3e662d7dbf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:46.349071 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 687/1387] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:08:46.400963 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da87a3f-f0bb-46b2-b418-1f4abf48b39f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:08:46.403484 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9da87a3f-f0bb-46b2-b418-1f4abf48b39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:46.509520 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:46.656797 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da87a3f-f0bb-46b2-b418-1f4abf48b39f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:08:46.847569 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61eb39-a976-4e61-9f7d-a51583394b3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:08:46.848257 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61eb39-a976-4e61-9f7d-a51583394b3b service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:46.848564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61eb39-a976-4e61-9f7d-a51583394b3b service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:46.848856 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61eb39-a976-4e61-9f7d-a51583394b3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:46.850789 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0f61eb39-a976-4e61-9f7d-a51583394b3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:46.913823 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:47.004962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61eb39-a976-4e61-9f7d-a51583394b3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:08:47.008146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61eb39-a976-4e61-9f7d-a51583394b3b service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:08:47.045555 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 701/1388] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:08:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:08:49.246548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a1ee3-a1fe-4bd5-9940-64fa68ffc34c None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:49.247422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a1ee3-a1fe-4bd5-9940-64fa68ffc34c None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:49.247582 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a1ee3-a1fe-4bd5-9940-64fa68ffc34c None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:49.250227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 688/1389] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:08:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:08:49.257113 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34200f63-555d-4f52-a95b-edeea4216e75 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:49.257991 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34200f63-555d-4f52-a95b-edeea4216e75 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:49.257991 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34200f63-555d-4f52-a95b-edeea4216e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:49.347445 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-34200f63-555d-4f52-a95b-edeea4216e75 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:49.348913 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-34200f63-555d-4f52-a95b-edeea4216e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:49.479056 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 702/1390] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:08:49.528406 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a1ee3-a1fe-4bd5-9940-64fa68ffc34c None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:08:49.529958 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-4f0a1ee3-a1fe-4bd5-9940-64fa68ffc34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:49.567584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:49.718150 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a1ee3-a1fe-4bd5-9940-64fa68ffc34c None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:08:49.740610 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13124e-68be-4e6f-bfa0-c43672c950cd None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:49.740941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13124e-68be-4e6f-bfa0-c43672c950cd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:49.741148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13124e-68be-4e6f-bfa0-c43672c950cd None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:49.742539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 703/1391] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:08:49.748394 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4732e3-eff6-406a-8b63-afb99f1d6dc6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:49.748699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4732e3-eff6-406a-8b63-afb99f1d6dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:49.748929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4732e3-eff6-406a-8b63-afb99f1d6dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:49.766218 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:49.842625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ff4732e3-eff6-406a-8b63-afb99f1d6dc6 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:49.846959 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ff4732e3-eff6-406a-8b63-afb99f1d6dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:49.872029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:49.886390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0437ff-06c9-4673-b024-446edc2cf81e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:08:49.887101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0437ff-06c9-4673-b024-446edc2cf81e service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:49.887517 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0437ff-06c9-4673-b024-446edc2cf81e service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:49.887692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0437ff-06c9-4673-b024-446edc2cf81e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:49.889315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-ae0437ff-06c9-4673-b024-446edc2cf81e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:49.985608 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 704/1392] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:08:50.013520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0437ff-06c9-4673-b024-446edc2cf81e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:08:50.015856 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0437ff-06c9-4673-b024-446edc2cf81e service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:08:50.041670 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 689/1393] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:08:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:08:50.059343 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846505f-18f1-4a15-8984-a89d031ce823 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:50.060080 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846505f-18f1-4a15-8984-a89d031ce823 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:50.060471 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846505f-18f1-4a15-8984-a89d031ce823 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:50.063147 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 705/1394] 10.222.0.46 () {54 vars in 967 bytes} [Wed Aug 10 13:08:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:08:50.071533 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce24909-3c30-462d-895b-22b370faf241 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:50.071820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce24909-3c30-462d-895b-22b370faf241 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:50.072062 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce24909-3c30-462d-895b-22b370faf241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:50.176943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-3ce24909-3c30-462d-895b-22b370faf241 None None] MFA Rules not processed for user `5979be13ad31421b886069faf0dcc915`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:50.178422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3ce24909-3c30-462d-895b-22b370faf241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:50.255146 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:50.288007 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 690/1395] 10.222.0.46 () {58 vars in 1064 bytes} [Wed Aug 10 13:08:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:08:50.297018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846505f-18f1-4a15-8984-a89d031ce823 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:08:50.300355 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6846505f-18f1-4a15-8984-a89d031ce823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:50.438021 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:50.443625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846505f-18f1-4a15-8984-a89d031ce823 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:08:50.555471 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8113f-e24f-4bb9-ae2f-76bf3dbcdf80 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5979be13ad31421b886069faf0dcc915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:08:50.556245 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8113f-e24f-4bb9-ae2f-76bf3dbcdf80 service glance] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:50.556614 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8113f-e24f-4bb9-ae2f-76bf3dbcdf80 service glance] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:50.557041 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8113f-e24f-4bb9-ae2f-76bf3dbcdf80 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:50.559200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fed8113f-e24f-4bb9-ae2f-76bf3dbcdf80 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:50.700463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8113f-e24f-4bb9-ae2f-76bf3dbcdf80 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:08:50.702009 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8113f-e24f-4bb9-ae2f-76bf3dbcdf80 service glance] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:08:50.723807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 706/1396] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:08:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:08:51.585588 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c9eb8-1a49-4ccd-9ad2-33499af9e0d3 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:51.586409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c9eb8-1a49-4ccd-9ad2-33499af9e0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:51.586409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c9eb8-1a49-4ccd-9ad2-33499af9e0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:51.681141 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-ad6c9eb8-1a49-4ccd-9ad2-33499af9e0d3 None None] MFA Rules not processed for user `182eec86daa44cd48d6ef1c38f58e89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:51.682570 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-ad6c9eb8-1a49-4ccd-9ad2-33499af9e0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:51.801173 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 691/1397] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 10 13:08:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:08:51.866424 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a045aed-c64b-41e2-900e-55314f382c34 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:51.867311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a045aed-c64b-41e2-900e-55314f382c34 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:51.867472 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a045aed-c64b-41e2-900e-55314f382c34 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:51.869095 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 707/1398] 10.222.0.46 () {54 vars in 943 bytes} [Wed Aug 10 13:08:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:08:51.877713 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50936b-5843-4d4c-982c-9e8bff307b4b None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:51.879520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50936b-5843-4d4c-982c-9e8bff307b4b None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:51.879854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50936b-5843-4d4c-982c-9e8bff307b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:52.008459 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-3f50936b-5843-4d4c-982c-9e8bff307b4b None None] MFA Rules not processed for user `5c86ef66c9564e0395c325a84ca9c4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:52.009710 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3f50936b-5843-4d4c-982c-9e8bff307b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:52.029052 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:52.166394 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 692/1399] 10.222.0.46 () {58 vars in 1040 bytes} [Wed Aug 10 13:08:51 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:08:52.177538 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a045aed-c64b-41e2-900e-55314f382c34 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:08:52.179327 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4a045aed-c64b-41e2-900e-55314f382c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:52.209091 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:52.357323 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3aa15-85da-4e27-984a-1be0016eb510 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:52.357774 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3aa15-85da-4e27-984a-1be0016eb510 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:52.358186 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3aa15-85da-4e27-984a-1be0016eb510 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:52.359953 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 693/1400] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:08:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:08:52.366938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867cb4c-1001-4a40-8d39-4c8de1a87571 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:52.367418 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867cb4c-1001-4a40-8d39-4c8de1a87571 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:52.367846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867cb4c-1001-4a40-8d39-4c8de1a87571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:52.408856 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a045aed-c64b-41e2-900e-55314f382c34 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:08:52.449852 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-9867cb4c-1001-4a40-8d39-4c8de1a87571 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:52.451138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-9867cb4c-1001-4a40-8d39-4c8de1a87571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:52.553351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:52.580321 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 694/1401] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:08:52.583797 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e634ae2-47a2-4423-bb80-a8560d148b49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c86ef66c9564e0395c325a84ca9c4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:08:52.584905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e634ae2-47a2-4423-bb80-a8560d148b49 service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:52.585405 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e634ae2-47a2-4423-bb80-a8560d148b49 service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:52.585921 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e634ae2-47a2-4423-bb80-a8560d148b49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:52.589474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0e634ae2-47a2-4423-bb80-a8560d148b49 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:52.605271 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:52.632499 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867cb4c-1001-4a40-8d39-4c8de1a87571 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:08:52.633963 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-9867cb4c-1001-4a40-8d39-4c8de1a87571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:52.722870 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e634ae2-47a2-4423-bb80-a8560d148b49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:08:52.725700 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e634ae2-47a2-4423-bb80-a8560d148b49 service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:08:52.742192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 708/1402] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 10 13:08:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 13:08:52.819973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867cb4c-1001-4a40-8d39-4c8de1a87571 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:08:52.952274 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:53.011176 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd10c59-f861-4fcc-b1ec-024012f49473 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:08:53.012218 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd10c59-f861-4fcc-b1ec-024012f49473 service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:53.012711 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd10c59-f861-4fcc-b1ec-024012f49473 service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:53.013190 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd10c59-f861-4fcc-b1ec-024012f49473 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:53.016348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-ffd10c59-f861-4fcc-b1ec-024012f49473 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:53.156676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd10c59-f861-4fcc-b1ec-024012f49473 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:08:53.159795 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd10c59-f861-4fcc-b1ec-024012f49473 service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:08:53.197423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 695/1403] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:08:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:08:55.854451 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03739c-d05a-4cae-bcc0-3c93d81d68d0 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:55.855396 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03739c-d05a-4cae-bcc0-3c93d81d68d0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:55.855396 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03739c-d05a-4cae-bcc0-3c93d81d68d0 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:55.860011 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 709/1404] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:08:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:08:55.862452 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ee112-715d-4c26-8a03-679a233b340d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:55.863337 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ee112-715d-4c26-8a03-679a233b340d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:55.863337 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ee112-715d-4c26-8a03-679a233b340d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:55.961282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-483ee112-715d-4c26-8a03-679a233b340d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:55.963636 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-483ee112-715d-4c26-8a03-679a233b340d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:56.073958 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:56.141579 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 696/1405] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:08:56.224754 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03739c-d05a-4cae-bcc0-3c93d81d68d0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:08:56.228060 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-db03739c-d05a-4cae-bcc0-3c93d81d68d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:56.553332 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03739c-d05a-4cae-bcc0-3c93d81d68d0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:08:56.556854 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:56.757557 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d039d5-c926-4bf9-8bfc-fe617da7989f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:08:56.758776 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d039d5-c926-4bf9-8bfc-fe617da7989f service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:56.759290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d039d5-c926-4bf9-8bfc-fe617da7989f service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:56.759817 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d039d5-c926-4bf9-8bfc-fe617da7989f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:56.762929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-62d039d5-c926-4bf9-8bfc-fe617da7989f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:08:56.944300 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d039d5-c926-4bf9-8bfc-fe617da7989f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:08:56.947254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d039d5-c926-4bf9-8bfc-fe617da7989f service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:08:57.001479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 710/1406] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:08:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 778 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:08:59.796036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c0bfc-ef95-4672-941b-3b8d2b2287b8 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:59.796901 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c0bfc-ef95-4672-941b-3b8d2b2287b8 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:59.796901 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c0bfc-ef95-4672-941b-3b8d2b2287b8 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:59.797952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 697/1407] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:08:59.805390 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a00d8d-2e04-4b39-87db-e950bc4667c5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:08:59.806244 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a00d8d-2e04-4b39-87db-e950bc4667c5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:08:59.806244 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a00d8d-2e04-4b39-87db-e950bc4667c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:08:59.817948 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:59.891729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-97a00d8d-2e04-4b39-87db-e950bc4667c5 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:08:59.893333 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-97a00d8d-2e04-4b39-87db-e950bc4667c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:00.081721 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 711/1408] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:09:00.140924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c0bfc-ef95-4672-941b-3b8d2b2287b8 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:09:00.142734 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-591c0bfc-ef95-4672-941b-3b8d2b2287b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:00.350634 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c0bfc-ef95-4672-941b-3b8d2b2287b8 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:09:00.411563 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:00.539563 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f7795-12e5-406f-84fb-23705a8a7f2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:09:00.540971 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f7795-12e5-406f-84fb-23705a8a7f2c service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:00.541520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f7795-12e5-406f-84fb-23705a8a7f2c service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:00.542056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f7795-12e5-406f-84fb-23705a8a7f2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:00.545288 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-0c2f7795-12e5-406f-84fb-23705a8a7f2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:00.705341 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f7795-12e5-406f-84fb-23705a8a7f2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:09:00.709088 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f7795-12e5-406f-84fb-23705a8a7f2c service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:09:00.751205 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 698/1409] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:09:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:09:10.077757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=62 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:10.748010 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=82 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:17.594499 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d62102-5d70-49eb-87ff-2db40b6d19d9 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:17.595102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d62102-5d70-49eb-87ff-2db40b6d19d9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:17.595102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d62102-5d70-49eb-87ff-2db40b6d19d9 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:17.596486 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 712/1410] 10.222.0.46 () {54 vars in 918 bytes} [Wed Aug 10 13:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:09:17.602413 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a312f-7f14-4a56-9499-f5f5b6d6d8cc None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:17.602977 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a312f-7f14-4a56-9499-f5f5b6d6d8cc None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:17.602977 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a312f-7f14-4a56-9499-f5f5b6d6d8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:17.698335 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-395a312f-7f14-4a56-9499-f5f5b6d6d8cc None None] MFA Rules not processed for user `15780b69faa745e9b99f1fffb6abe231`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:09:17.699596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-395a312f-7f14-4a56-9499-f5f5b6d6d8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:17.825316 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 699/1411] 10.222.0.46 () {58 vars in 1015 bytes} [Wed Aug 10 13:09:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:09:17.843773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d75ca0-3e77-406d-b57f-92a70cc0a512 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:17.844256 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d75ca0-3e77-406d-b57f-92a70cc0a512 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:17.844758 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d75ca0-3e77-406d-b57f-92a70cc0a512 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:17.848116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 713/1412] 10.222.0.46 () {54 vars in 918 bytes} [Wed Aug 10 13:09:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:09:17.853919 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b0e65-0cb7-4ebb-995f-4000215fef4a None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:17.854194 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b0e65-0cb7-4ebb-995f-4000215fef4a None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:17.854544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b0e65-0cb7-4ebb-995f-4000215fef4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:17.977661 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:17.980896 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-023b0e65-0cb7-4ebb-995f-4000215fef4a None None] MFA Rules not processed for user `7fd0f76f24ea481191dfd65fff2376af`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:09:17.983122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-023b0e65-0cb7-4ebb-995f-4000215fef4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:18.132053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 700/1413] 10.222.0.46 () {58 vars in 1015 bytes} [Wed Aug 10 13:09:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:09:20.785008 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f6e9a-a8dc-48b7-9c4f-30fd184229df None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:20.785619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f6e9a-a8dc-48b7-9c4f-30fd184229df None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:20.785619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f6e9a-a8dc-48b7-9c4f-30fd184229df None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:20.787146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 13:09:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:09:20.793455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05be9f7-5747-4080-98da-b6c72ba392c5 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:20.794121 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05be9f7-5747-4080-98da-b6c72ba392c5 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:20.794121 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05be9f7-5747-4080-98da-b6c72ba392c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:20.873742 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-d05be9f7-5747-4080-98da-b6c72ba392c5 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:09:20.874985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d05be9f7-5747-4080-98da-b6c72ba392c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:20.940047 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:20.991378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 13:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:09:21.042251 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f6e9a-a8dc-48b7-9c4f-30fd184229df None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:09:21.044156 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-080f6e9a-a8dc-48b7-9c4f-30fd184229df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:21.280578 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f6e9a-a8dc-48b7-9c4f-30fd184229df None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:09:21.416746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:21.468526 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761fd7a-63bc-4135-9625-20b6e4a65424 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:09:21.469144 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761fd7a-63bc-4135-9625-20b6e4a65424 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:21.469416 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761fd7a-63bc-4135-9625-20b6e4a65424 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:21.469684 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761fd7a-63bc-4135-9625-20b6e4a65424 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:21.472006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0761fd7a-63bc-4135-9625-20b6e4a65424 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:21.578836 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761fd7a-63bc-4135-9625-20b6e4a65424 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:09:21.581244 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761fd7a-63bc-4135-9625-20b6e4a65424 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:09:21.603253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 715/1416] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:09:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:09:22.701300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddb6cb-0473-422c-90b6-35beefec4d5e None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:22.701930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddb6cb-0473-422c-90b6-35beefec4d5e None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:22.701930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddb6cb-0473-422c-90b6-35beefec4d5e None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:22.703345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 13:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:09:22.709215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c22f3b-813f-4577-ad50-6982e1e6b643 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:22.709833 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c22f3b-813f-4577-ad50-6982e1e6b643 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:22.709833 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c22f3b-813f-4577-ad50-6982e1e6b643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:22.799932 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d3c22f3b-813f-4577-ad50-6982e1e6b643 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:09:22.801279 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d3c22f3b-813f-4577-ad50-6982e1e6b643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:22.852863 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:22.948618 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 13:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:09:23.183753 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddb6cb-0473-422c-90b6-35beefec4d5e None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:09:23.185358 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-1eddb6cb-0473-422c-90b6-35beefec4d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:23.383351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddb6cb-0473-422c-90b6-35beefec4d5e None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:09:23.435111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:23.532535 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6913ae-7369-4397-9b97-7f499c21cc21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:09:23.533158 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6913ae-7369-4397-9b97-7f499c21cc21 service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:23.533460 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6913ae-7369-4397-9b97-7f499c21cc21 service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:23.534257 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6913ae-7369-4397-9b97-7f499c21cc21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:23.536062 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-2e6913ae-7369-4397-9b97-7f499c21cc21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:23.641108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6913ae-7369-4397-9b97-7f499c21cc21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:09:23.642670 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6913ae-7369-4397-9b97-7f499c21cc21 service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:09:23.663968 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 703/1419] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:09:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:09:24.647984 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ef8cc-7bb1-46ba-83ad-ac2778b93c3f None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:24.648817 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ef8cc-7bb1-46ba-83ad-ac2778b93c3f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:24.648817 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ef8cc-7bb1-46ba-83ad-ac2778b93c3f None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:24.650427 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 13:09:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:09:24.657106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e054a-b0a3-4991-ab3b-2ffb1ec2d9a4 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:24.657697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e054a-b0a3-4991-ab3b-2ffb1ec2d9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:24.657697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e054a-b0a3-4991-ab3b-2ffb1ec2d9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:24.723963 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:24.752239 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-353e054a-b0a3-4991-ab3b-2ffb1ec2d9a4 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:09:24.755179 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-353e054a-b0a3-4991-ab3b-2ffb1ec2d9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:24.875684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 13:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:09:25.173749 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ef8cc-7bb1-46ba-83ad-ac2778b93c3f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:09:25.177222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-953ef8cc-7bb1-46ba-83ad-ac2778b93c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:25.381914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ef8cc-7bb1-46ba-83ad-ac2778b93c3f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:09:25.396061 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:25.524649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f18abf-2d5f-4408-8880-93d984ee43d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:09:25.525422 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f18abf-2d5f-4408-8880-93d984ee43d3 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:25.525794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f18abf-2d5f-4408-8880-93d984ee43d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:25.526174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f18abf-2d5f-4408-8880-93d984ee43d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:25.528081 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-01f18abf-2d5f-4408-8880-93d984ee43d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:25.636562 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f18abf-2d5f-4408-8880-93d984ee43d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:09:25.638144 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f18abf-2d5f-4408-8880-93d984ee43d3 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:09:25.659678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 718/1422] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:09:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:09:26.584477 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5daeaf5-56fc-4e41-8331-9a2e53c89f81 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:26.585142 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5daeaf5-56fc-4e41-8331-9a2e53c89f81 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:26.585142 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5daeaf5-56fc-4e41-8331-9a2e53c89f81 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:26.586442 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 13:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:09:26.592817 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf218c5a-3e87-4a67-bf98-f653bd19b91a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:26.593248 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf218c5a-3e87-4a67-bf98-f653bd19b91a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:26.593648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf218c5a-3e87-4a67-bf98-f653bd19b91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:26.616985 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:26.687756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-cf218c5a-3e87-4a67-bf98-f653bd19b91a None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:09:26.689118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cf218c5a-3e87-4a67-bf98-f653bd19b91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:26.809704 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 13:09:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:09:26.965917 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5daeaf5-56fc-4e41-8331-9a2e53c89f81 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:09:26.967437 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d5daeaf5-56fc-4e41-8331-9a2e53c89f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:27.131653 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:27.183993 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5daeaf5-56fc-4e41-8331-9a2e53c89f81 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:09:27.325475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b9033-ff59-41ae-a7b7-26aa1d6aa13e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:09:27.326199 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b9033-ff59-41ae-a7b7-26aa1d6aa13e service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:27.326528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b9033-ff59-41ae-a7b7-26aa1d6aa13e service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:27.326840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b9033-ff59-41ae-a7b7-26aa1d6aa13e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:27.328799 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7c8b9033-ff59-41ae-a7b7-26aa1d6aa13e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:27.436240 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:27.453598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b9033-ff59-41ae-a7b7-26aa1d6aa13e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:09:27.455310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b9033-ff59-41ae-a7b7-26aa1d6aa13e service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:09:27.480006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 706/1425] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:09:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:09:28.483412 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5bd28-ebd8-4cb9-9338-924407734338 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:28.484305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5bd28-ebd8-4cb9-9338-924407734338 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:28.484305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5bd28-ebd8-4cb9-9338-924407734338 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:28.485718 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 13:09:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:09:28.492079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f14be2-b236-44a7-98ff-5976de51bfca None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:28.492697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f14be2-b236-44a7-98ff-5976de51bfca None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:28.492697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f14be2-b236-44a7-98ff-5976de51bfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:28.584601 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-29f14be2-b236-44a7-98ff-5976de51bfca None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:09:28.586032 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-29f14be2-b236-44a7-98ff-5976de51bfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:28.704948 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 13:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:09:28.860181 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5bd28-ebd8-4cb9-9338-924407734338 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:09:28.862866 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f6f5bd28-ebd8-4cb9-9338-924407734338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:28.981026 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:29.077130 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5bd28-ebd8-4cb9-9338-924407734338 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:09:29.300482 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902de500-9068-4ade-958d-460d8d012a99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:09:29.301435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902de500-9068-4ade-958d-460d8d012a99 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:29.301854 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902de500-9068-4ade-958d-460d8d012a99 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:29.302313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902de500-9068-4ade-958d-460d8d012a99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:29.305486 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-902de500-9068-4ade-958d-460d8d012a99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:29.396505 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:29.448555 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902de500-9068-4ade-958d-460d8d012a99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:09:29.450211 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902de500-9068-4ade-958d-460d8d012a99 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:09:29.472285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 721/1428] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:09:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:09:30.336031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a9339-219c-4f4f-bafc-5b927e949a0c None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:30.336917 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a9339-219c-4f4f-bafc-5b927e949a0c None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:30.336917 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a9339-219c-4f4f-bafc-5b927e949a0c None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:30.338303 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 13:09:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:09:30.344478 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54d9f9-aff4-4e84-bf8a-aeb0df113d5f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:30.345049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54d9f9-aff4-4e84-bf8a-aeb0df113d5f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:30.345049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54d9f9-aff4-4e84-bf8a-aeb0df113d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:30.438609 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0b54d9f9-aff4-4e84-bf8a-aeb0df113d5f None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:09:30.440188 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0b54d9f9-aff4-4e84-bf8a-aeb0df113d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:30.560990 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 13:09:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:09:30.718425 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a9339-219c-4f4f-bafc-5b927e949a0c None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:09:30.720156 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-fa4a9339-219c-4f4f-bafc-5b927e949a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:30.808103 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:30.946120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a9339-219c-4f4f-bafc-5b927e949a0c None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:09:31.213392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc91d9-ad25-469c-bbbd-e85dfc8356ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:09:31.214270 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc91d9-ad25-469c-bbbd-e85dfc8356ab service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:31.214541 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc91d9-ad25-469c-bbbd-e85dfc8356ab service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:31.214807 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc91d9-ad25-469c-bbbd-e85dfc8356ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:31.216552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c5cc91d9-ad25-469c-bbbd-e85dfc8356ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:31.224677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:31.319395 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc91d9-ad25-469c-bbbd-e85dfc8356ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:09:31.321084 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc91d9-ad25-469c-bbbd-e85dfc8356ab service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:09:31.343405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 709/1431] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:09:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:09:32.214023 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbc784-8cb2-4730-a87e-659ea5a1dd3d None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:32.214796 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbc784-8cb2-4730-a87e-659ea5a1dd3d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:32.214796 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbc784-8cb2-4730-a87e-659ea5a1dd3d None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:32.215986 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 13:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:09:32.222546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cd3fb-6969-4dbb-ad62-9bb41114805d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:32.222825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cd3fb-6969-4dbb-ad62-9bb41114805d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:32.223126 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cd3fb-6969-4dbb-ad62-9bb41114805d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:32.314818 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-4f3cd3fb-6969-4dbb-ad62-9bb41114805d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:09:32.316129 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-4f3cd3fb-6969-4dbb-ad62-9bb41114805d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:32.395475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:32.429723 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 13:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:09:32.585918 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbc784-8cb2-4730-a87e-659ea5a1dd3d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:09:32.587508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d5bbc784-8cb2-4730-a87e-659ea5a1dd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:32.607849 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:32.765105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbc784-8cb2-4730-a87e-659ea5a1dd3d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:09:32.879499 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:32.911599 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a6d13-5da6-4ec7-a95a-d3649982f74d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:09:32.912222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a6d13-5da6-4ec7-a95a-d3649982f74d service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:32.912501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a6d13-5da6-4ec7-a95a-d3649982f74d service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:32.912785 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a6d13-5da6-4ec7-a95a-d3649982f74d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:32.914514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-280a6d13-5da6-4ec7-a95a-d3649982f74d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:33.023041 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a6d13-5da6-4ec7-a95a-d3649982f74d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:09:33.024715 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a6d13-5da6-4ec7-a95a-d3649982f74d service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:09:33.046101 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 724/1434] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:09:33.949381 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418d1c4-1224-434d-8d03-74d7ffa67fac None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:33.950157 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418d1c4-1224-434d-8d03-74d7ffa67fac None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:33.950157 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418d1c4-1224-434d-8d03-74d7ffa67fac None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:33.951529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 13:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:09:33.958003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04b707-852e-43cc-9938-a9e2407144ce None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:33.958598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04b707-852e-43cc-9938-a9e2407144ce None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:33.958598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04b707-852e-43cc-9938-a9e2407144ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:34.048353 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6e04b707-852e-43cc-9938-a9e2407144ce None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:09:34.049637 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6e04b707-852e-43cc-9938-a9e2407144ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:34.101789 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:34.192637 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 13:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:09:34.353502 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418d1c4-1224-434d-8d03-74d7ffa67fac None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:09:34.355151 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-b418d1c4-1224-434d-8d03-74d7ffa67fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:34.530184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418d1c4-1224-434d-8d03-74d7ffa67fac None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:09:34.593773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:34.675624 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31304a71-fe80-4179-9510-6bec566ad40b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:09:34.676249 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31304a71-fe80-4179-9510-6bec566ad40b service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:34.676520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31304a71-fe80-4179-9510-6bec566ad40b service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:34.676785 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31304a71-fe80-4179-9510-6bec566ad40b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:34.678504 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-31304a71-fe80-4179-9510-6bec566ad40b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:34.793036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31304a71-fe80-4179-9510-6bec566ad40b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:09:34.794559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31304a71-fe80-4179-9510-6bec566ad40b service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:09:34.816223 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 712/1437] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:09:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:09:35.673766 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc008573-1b0f-4243-8ba8-3e8c863e857b None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:35.674908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc008573-1b0f-4243-8ba8-3e8c863e857b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:35.674908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc008573-1b0f-4243-8ba8-3e8c863e857b None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:35.676163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 13:09:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:09:35.682043 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b9762-9476-46c7-88c6-7c0c2c00a5b0 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:35.682746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b9762-9476-46c7-88c6-7c0c2c00a5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:35.682746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b9762-9476-46c7-88c6-7c0c2c00a5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:35.779657 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-696b9762-9476-46c7-88c6-7c0c2c00a5b0 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:09:35.780933 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-696b9762-9476-46c7-88c6-7c0c2c00a5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:35.783421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:35.896351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 13:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:09:36.052978 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc008573-1b0f-4243-8ba8-3e8c863e857b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:09:36.054538 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fc008573-1b0f-4243-8ba8-3e8c863e857b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:36.233732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc008573-1b0f-4243-8ba8-3e8c863e857b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:09:36.268281 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:36.374538 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12647120-7a0e-4016-bf13-3e40214d67e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:09:36.375199 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12647120-7a0e-4016-bf13-3e40214d67e8 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:36.375477 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12647120-7a0e-4016-bf13-3e40214d67e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:36.375745 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12647120-7a0e-4016-bf13-3e40214d67e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:36.378043 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-12647120-7a0e-4016-bf13-3e40214d67e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:36.490284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12647120-7a0e-4016-bf13-3e40214d67e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:09:36.492053 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12647120-7a0e-4016-bf13-3e40214d67e8 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:09:36.514217 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 727/1440] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:09:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:09:38.527894 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c66e6-c1c9-4aa5-ad28-cbfcbdafd1f5 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:38.528521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c66e6-c1c9-4aa5-ad28-cbfcbdafd1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:38.528521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c66e6-c1c9-4aa5-ad28-cbfcbdafd1f5 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:38.529921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 13:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:09:38.536140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a837c-d131-4891-bcea-30c5b6c489f0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:38.536702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a837c-d131-4891-bcea-30c5b6c489f0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:38.536702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a837c-d131-4891-bcea-30c5b6c489f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:38.584097 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:38.622643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-370a837c-d131-4891-bcea-30c5b6c489f0 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:09:38.623924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-370a837c-d131-4891-bcea-30c5b6c489f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:38.753619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 13:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:09:38.798813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c66e6-c1c9-4aa5-ad28-cbfcbdafd1f5 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:09:38.802220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-4c8c66e6-c1c9-4aa5-ad28-cbfcbdafd1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:38.968428 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c66e6-c1c9-4aa5-ad28-cbfcbdafd1f5 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:09:39.009400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:39.065206 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36348d2-a469-41d5-9eb4-8936f6899af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:09:39.065831 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36348d2-a469-41d5-9eb4-8936f6899af7 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:39.066105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36348d2-a469-41d5-9eb4-8936f6899af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:39.067322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36348d2-a469-41d5-9eb4-8936f6899af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:39.068234 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-a36348d2-a469-41d5-9eb4-8936f6899af7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:39.199174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36348d2-a469-41d5-9eb4-8936f6899af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:09:39.200637 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36348d2-a469-41d5-9eb4-8936f6899af7 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:09:39.221369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 715/1443] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:09:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:09:41.536546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee76e7-3d6b-44a2-827a-7c29303972c5 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:41.537163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee76e7-3d6b-44a2-827a-7c29303972c5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:41.537163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee76e7-3d6b-44a2-827a-7c29303972c5 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:41.538429 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 13:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:09:41.544651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f2967-733f-4cfc-9f50-7aad75f555c9 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:41.545298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f2967-733f-4cfc-9f50-7aad75f555c9 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:41.545444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f2967-733f-4cfc-9f50-7aad75f555c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:41.624444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-4b1f2967-733f-4cfc-9f50-7aad75f555c9 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:09:41.625688 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-4b1f2967-733f-4cfc-9f50-7aad75f555c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:41.640949 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:41.746828 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 13:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:09:41.787357 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee76e7-3d6b-44a2-827a-7c29303972c5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:09:41.788907 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bbee76e7-3d6b-44a2-827a-7c29303972c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:41.914899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee76e7-3d6b-44a2-827a-7c29303972c5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:09:41.929291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:42.002213 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102a1b6-74fb-4ebd-9c38-b4fcb3361245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:09:42.003439 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102a1b6-74fb-4ebd-9c38-b4fcb3361245 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:42.003704 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102a1b6-74fb-4ebd-9c38-b4fcb3361245 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:42.004211 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102a1b6-74fb-4ebd-9c38-b4fcb3361245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:42.006189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8102a1b6-74fb-4ebd-9c38-b4fcb3361245 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:42.185840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102a1b6-74fb-4ebd-9c38-b4fcb3361245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:09:42.188513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102a1b6-74fb-4ebd-9c38-b4fcb3361245 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:09:42.222065 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 730/1446] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:09:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:09:44.875660 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad45b8-6c7d-4c81-87c8-db22d670b8be None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:44.876345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad45b8-6c7d-4c81-87c8-db22d670b8be None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:44.876345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad45b8-6c7d-4c81-87c8-db22d670b8be None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:44.877622 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 13:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:09:44.883949 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5521f3-8626-4b09-9de2-ae14654b5967 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:44.884844 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5521f3-8626-4b09-9de2-ae14654b5967 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:44.884844 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5521f3-8626-4b09-9de2-ae14654b5967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:44.941057 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:44.965394 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3a5521f3-8626-4b09-9de2-ae14654b5967 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:09:44.966820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3a5521f3-8626-4b09-9de2-ae14654b5967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:45.084682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 13:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:09:45.126456 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad45b8-6c7d-4c81-87c8-db22d670b8be None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:09:45.128725 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-e0ad45b8-6c7d-4c81-87c8-db22d670b8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:45.260140 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad45b8-6c7d-4c81-87c8-db22d670b8be None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:09:45.305968 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:45.343638 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3e04b-e0d6-4176-9f13-84bb3b9bb667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:09:45.344163 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3e04b-e0d6-4176-9f13-84bb3b9bb667 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:45.344441 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3e04b-e0d6-4176-9f13-84bb3b9bb667 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:45.344713 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3e04b-e0d6-4176-9f13-84bb3b9bb667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:45.346920 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-b4f3e04b-e0d6-4176-9f13-84bb3b9bb667 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:45.483567 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3e04b-e0d6-4176-9f13-84bb3b9bb667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:09:45.485983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3e04b-e0d6-4176-9f13-84bb3b9bb667 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:09:45.511707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 718/1449] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:09:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:09:47.794577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abb2ee-ce1a-41b1-bdbd-1b8f7b6eef3b None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:47.795549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abb2ee-ce1a-41b1-bdbd-1b8f7b6eef3b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:47.795549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abb2ee-ce1a-41b1-bdbd-1b8f7b6eef3b None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:47.797072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 13:09:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:09:47.803921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75328ed-d7eb-44ff-bdb1-3fd08bdf347a None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:47.804504 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75328ed-d7eb-44ff-bdb1-3fd08bdf347a None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:47.804504 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75328ed-d7eb-44ff-bdb1-3fd08bdf347a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:47.877682 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-d75328ed-d7eb-44ff-bdb1-3fd08bdf347a None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:09:47.878898 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d75328ed-d7eb-44ff-bdb1-3fd08bdf347a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:47.903053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:47.993332 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 13:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:09:48.032153 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abb2ee-ce1a-41b1-bdbd-1b8f7b6eef3b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:09:48.034289 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-25abb2ee-ce1a-41b1-bdbd-1b8f7b6eef3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:48.173731 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abb2ee-ce1a-41b1-bdbd-1b8f7b6eef3b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:09:48.212592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:48.281326 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7933f5-5072-4932-8567-401c2d9c8b84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:09:48.281994 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7933f5-5072-4932-8567-401c2d9c8b84 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:48.282315 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7933f5-5072-4932-8567-401c2d9c8b84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:48.282621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7933f5-5072-4932-8567-401c2d9c8b84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:48.285109 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bb7933f5-5072-4932-8567-401c2d9c8b84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:48.416607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7933f5-5072-4932-8567-401c2d9c8b84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:09:48.418070 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7933f5-5072-4932-8567-401c2d9c8b84 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:09:48.439355 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 733/1452] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:09:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:09:50.612955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1363134-ba2e-461c-a0c7-6572995a43f3 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:50.613578 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1363134-ba2e-461c-a0c7-6572995a43f3 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:50.613578 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1363134-ba2e-461c-a0c7-6572995a43f3 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:50.615153 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 13:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:09:50.623487 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f929d4c-799b-4cfc-a999-beb825e73d84 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:50.624088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f929d4c-799b-4cfc-a999-beb825e73d84 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:50.630220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f929d4c-799b-4cfc-a999-beb825e73d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:50.720681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:50.724050 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3f929d4c-799b-4cfc-a999-beb825e73d84 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:09:50.726875 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3f929d4c-799b-4cfc-a999-beb825e73d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:50.874661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 13:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:09:50.915886 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1363134-ba2e-461c-a0c7-6572995a43f3 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:09:50.917697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d1363134-ba2e-461c-a0c7-6572995a43f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:51.075161 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1363134-ba2e-461c-a0c7-6572995a43f3 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:09:51.133800 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:51.164374 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8b132-5ffb-4344-b7b4-ca30e1848fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:09:51.165027 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8b132-5ffb-4344-b7b4-ca30e1848fea service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:51.165348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8b132-5ffb-4344-b7b4-ca30e1848fea service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:51.165812 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8b132-5ffb-4344-b7b4-ca30e1848fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:51.167871 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d9c8b132-5ffb-4344-b7b4-ca30e1848fea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:51.300766 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8b132-5ffb-4344-b7b4-ca30e1848fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:09:51.302227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8b132-5ffb-4344-b7b4-ca30e1848fea service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:09:51.333099 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 721/1455] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:09:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:09:53.564215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03548aa-4b25-4eda-a8ce-bee5d3f67d19 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:53.565370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03548aa-4b25-4eda-a8ce-bee5d3f67d19 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:53.565370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03548aa-4b25-4eda-a8ce-bee5d3f67d19 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:53.566704 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 13:09:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:09:53.572741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b94aa3-de13-4a14-91c8-858f77bdfb1c None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:53.573332 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b94aa3-de13-4a14-91c8-858f77bdfb1c None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:53.573332 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b94aa3-de13-4a14-91c8-858f77bdfb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:53.655771 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-54b94aa3-de13-4a14-91c8-858f77bdfb1c None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:09:53.657143 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-54b94aa3-de13-4a14-91c8-858f77bdfb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:53.693145 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:53.771704 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 13:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:09:53.811646 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03548aa-4b25-4eda-a8ce-bee5d3f67d19 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:09:53.813223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c03548aa-4b25-4eda-a8ce-bee5d3f67d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:53.933770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03548aa-4b25-4eda-a8ce-bee5d3f67d19 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:09:53.967963 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:54.021124 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36178b-00ec-4060-8da6-7dcb559ee341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:09:54.021741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36178b-00ec-4060-8da6-7dcb559ee341 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:54.022019 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36178b-00ec-4060-8da6-7dcb559ee341 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:54.022291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36178b-00ec-4060-8da6-7dcb559ee341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:54.024008 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1c36178b-00ec-4060-8da6-7dcb559ee341 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:54.149539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36178b-00ec-4060-8da6-7dcb559ee341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:09:54.151051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36178b-00ec-4060-8da6-7dcb559ee341 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:09:54.171990 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 736/1458] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:09:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:09:56.414239 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3cac7-b0b3-40ed-b688-edbe3b92450d None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:56.414968 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3cac7-b0b3-40ed-b688-edbe3b92450d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:56.414968 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3cac7-b0b3-40ed-b688-edbe3b92450d None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:56.416479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 13:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:09:56.422835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f70ac9-da83-41ed-a099-193192369def None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:56.423525 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f70ac9-da83-41ed-a099-193192369def None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:56.423525 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f70ac9-da83-41ed-a099-193192369def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:56.504434 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-68f70ac9-da83-41ed-a099-193192369def None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:09:56.505785 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-68f70ac9-da83-41ed-a099-193192369def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:56.516139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:56.633649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 13:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:09:56.681416 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3cac7-b0b3-40ed-b688-edbe3b92450d None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:09:56.683098 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-60c3cac7-b0b3-40ed-b688-edbe3b92450d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:56.829269 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3cac7-b0b3-40ed-b688-edbe3b92450d None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:09:56.940265 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:56.976716 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5f9fc-1bf9-4160-ba69-621d2d25783e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:09:56.977757 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5f9fc-1bf9-4160-ba69-621d2d25783e service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:56.978251 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5f9fc-1bf9-4160-ba69-621d2d25783e service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:56.978715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5f9fc-1bf9-4160-ba69-621d2d25783e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:56.981995 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-48d5f9fc-1bf9-4160-ba69-621d2d25783e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:57.153407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5f9fc-1bf9-4160-ba69-621d2d25783e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:09:57.154889 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5f9fc-1bf9-4160-ba69-621d2d25783e service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:09:57.178280 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 724/1461] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:09:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:09:59.673529 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5537d-bb05-4542-bcee-b501918fd33e None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:59.674945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5537d-bb05-4542-bcee-b501918fd33e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:59.674945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5537d-bb05-4542-bcee-b501918fd33e None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:59.677132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 13:09:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:09:59.683587 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17bbfd-9519-4832-8b88-40a64c869878 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:09:59.684512 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17bbfd-9519-4832-8b88-40a64c869878 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:09:59.684512 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17bbfd-9519-4832-8b88-40a64c869878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:09:59.771052 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-5f17bbfd-9519-4832-8b88-40a64c869878 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:09:59.772371 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-5f17bbfd-9519-4832-8b88-40a64c869878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:09:59.819087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:59.921916 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 13:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:09:59.964007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5537d-bb05-4542-bcee-b501918fd33e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:09:59.965980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d7d5537d-bb05-4542-bcee-b501918fd33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:00.110958 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5537d-bb05-4542-bcee-b501918fd33e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:10:00.195423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:10:00.266129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb29be3-883f-4a03-b9cf-5f65ebb8f519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:10:00.267221 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb29be3-883f-4a03-b9cf-5f65ebb8f519 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:00.267797 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb29be3-883f-4a03-b9cf-5f65ebb8f519 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:00.268284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb29be3-883f-4a03-b9cf-5f65ebb8f519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:00.271658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-deb29be3-883f-4a03-b9cf-5f65ebb8f519 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:00.443367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb29be3-883f-4a03-b9cf-5f65ebb8f519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:10:00.446280 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb29be3-883f-4a03-b9cf-5f65ebb8f519 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:10:00.483523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 739/1464] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:09:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:10:02.706640 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fd90f-b38a-4ff9-a813-8b7e2bbddd59 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:02.707337 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fd90f-b38a-4ff9-a813-8b7e2bbddd59 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:02.707337 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fd90f-b38a-4ff9-a813-8b7e2bbddd59 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:02.709226 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 13:10:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:10:02.715973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7f388-35fd-4a29-a305-1eaf377c6cb8 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:02.716588 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7f388-35fd-4a29-a305-1eaf377c6cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:02.716743 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7f388-35fd-4a29-a305-1eaf377c6cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:02.801228 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5ed7f388-35fd-4a29-a305-1eaf377c6cb8 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:10:02.802548 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5ed7f388-35fd-4a29-a305-1eaf377c6cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:02.824313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:10:02.931511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 13:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:10:02.974370 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fd90f-b38a-4ff9-a813-8b7e2bbddd59 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:10:02.977017 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-6b4fd90f-b38a-4ff9-a813-8b7e2bbddd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:03.127872 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fd90f-b38a-4ff9-a813-8b7e2bbddd59 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:10:03.222881 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:10:03.232930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f99e8-354e-4879-820f-5321e0623d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:10:03.233623 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f99e8-354e-4879-820f-5321e0623d55 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:03.233959 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f99e8-354e-4879-820f-5321e0623d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:03.234358 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f99e8-354e-4879-820f-5321e0623d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:03.236407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-f50f99e8-354e-4879-820f-5321e0623d55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:03.372684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f99e8-354e-4879-820f-5321e0623d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:10:03.374198 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f99e8-354e-4879-820f-5321e0623d55 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:10:03.395902 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 727/1467] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:10:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:10:05.599070 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efe4bf-3755-4754-aaef-f7d8a4877dbc None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:05.599933 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efe4bf-3755-4754-aaef-f7d8a4877dbc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:05.599933 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efe4bf-3755-4754-aaef-f7d8a4877dbc None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:05.601202 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 13:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:10:05.607418 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795b86b-ab09-4144-a693-833650fd9716 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:05.608246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795b86b-ab09-4144-a693-833650fd9716 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:05.608246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795b86b-ab09-4144-a693-833650fd9716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:05.690175 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-1795b86b-ab09-4144-a693-833650fd9716 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:10:05.691373 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-1795b86b-ab09-4144-a693-833650fd9716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:05.751983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:10:05.812382 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 13:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:10:05.857140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efe4bf-3755-4754-aaef-f7d8a4877dbc None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:10:05.858731 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-07efe4bf-3755-4754-aaef-f7d8a4877dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:06.003544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efe4bf-3755-4754-aaef-f7d8a4877dbc None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:10:06.205034 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:10:06.239969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322bc67-f907-49da-86e9-fc753cff3b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:10:06.240499 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322bc67-f907-49da-86e9-fc753cff3b79 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:06.240776 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322bc67-f907-49da-86e9-fc753cff3b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:06.241048 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322bc67-f907-49da-86e9-fc753cff3b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:06.242907 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8322bc67-f907-49da-86e9-fc753cff3b79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:06.400464 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322bc67-f907-49da-86e9-fc753cff3b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:10:06.402124 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322bc67-f907-49da-86e9-fc753cff3b79 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:10:06.444414 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 742/1470] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:10:15.810360 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=22 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:10:16.441486 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=66 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:10:27.333708 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52257d-e7cc-4c8a-93da-e0118503559a None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:27.334400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52257d-e7cc-4c8a-93da-e0118503559a None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:27.334655 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52257d-e7cc-4c8a-93da-e0118503559a None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:27.337195 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 729/1471] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:10:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:10:27.343696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5150c3d-799b-4dcb-a6e7-c4f41f4300c3 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:27.344274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5150c3d-799b-4dcb-a6e7-c4f41f4300c3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:27.344274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5150c3d-799b-4dcb-a6e7-c4f41f4300c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:27.420567 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d5150c3d-799b-4dcb-a6e7-c4f41f4300c3 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:10:27.421831 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d5150c3d-799b-4dcb-a6e7-c4f41f4300c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:27.533998 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 743/1472] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:10:27.629608 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fec30-090d-4913-a96d-bbce442b9e75 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:27.629884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fec30-090d-4913-a96d-bbce442b9e75 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:27.630139 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fec30-090d-4913-a96d-bbce442b9e75 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:27.631572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 730/1473] 10.222.0.46 () {54 vars in 967 bytes} [Wed Aug 10 13:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:10:27.637880 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318486bb-5cd3-4a69-b607-a1420b3a4553 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:27.638333 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318486bb-5cd3-4a69-b607-a1420b3a4553 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:27.638784 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318486bb-5cd3-4a69-b607-a1420b3a4553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:27.783449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-318486bb-5cd3-4a69-b607-a1420b3a4553 None None] MFA Rules not processed for user `5979be13ad31421b886069faf0dcc915`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:10:27.785533 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-318486bb-5cd3-4a69-b607-a1420b3a4553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:27.812389 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:10:27.898244 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 744/1474] 10.222.0.46 () {58 vars in 1064 bytes} [Wed Aug 10 13:10:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:10:27.910531 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fec30-090d-4913-a96d-bbce442b9e75 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:10:27.912182 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-585fec30-090d-4913-a96d-bbce442b9e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:28.086976 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fec30-090d-4913-a96d-bbce442b9e75 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:10:28.203810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b5d35-89d2-4b2b-89d7-bda23edb392f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5979be13ad31421b886069faf0dcc915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:10:28.204934 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b5d35-89d2-4b2b-89d7-bda23edb392f service glance] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:28.205210 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b5d35-89d2-4b2b-89d7-bda23edb392f service glance] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:28.205478 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b5d35-89d2-4b2b-89d7-bda23edb392f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:28.207226 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-ff9b5d35-89d2-4b2b-89d7-bda23edb392f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:28.306736 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:10:28.378635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b5d35-89d2-4b2b-89d7-bda23edb392f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:10:28.380127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b5d35-89d2-4b2b-89d7-bda23edb392f service glance] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:10:28.401777 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 731/1475] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:10:30.691110 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6738b-8df0-412e-b1ef-efde6ff58dd7 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:30.691729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6738b-8df0-412e-b1ef-efde6ff58dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:30.691729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6738b-8df0-412e-b1ef-efde6ff58dd7 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:30.693112 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 745/1476] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:10:30.699449 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049f676-35cc-436c-a5e5-efaef911bbc9 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:30.700068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049f676-35cc-436c-a5e5-efaef911bbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:30.700068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049f676-35cc-436c-a5e5-efaef911bbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:30.779924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-a049f676-35cc-436c-a5e5-efaef911bbc9 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:10:30.781181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-a049f676-35cc-436c-a5e5-efaef911bbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:30.905803 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 732/1477] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:10:30.930299 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6738b-8df0-412e-b1ef-efde6ff58dd7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:10:30.931925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f8e6738b-8df0-412e-b1ef-efde6ff58dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:31.088646 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6738b-8df0-412e-b1ef-efde6ff58dd7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:10:31.146411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:10:31.197567 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881c804-8223-40a1-9f6a-b4bdd0a8f4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:10:31.198181 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881c804-8223-40a1-9f6a-b4bdd0a8f4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:31.198453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881c804-8223-40a1-9f6a-b4bdd0a8f4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:31.198714 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881c804-8223-40a1-9f6a-b4bdd0a8f4f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:31.199415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881c804-8223-40a1-9f6a-b4bdd0a8f4f6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:10:31.201216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: WARNING py.warnings [None req-0881c804-8223-40a1-9f6a-b4bdd0a8f4f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:10:31.201216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: warnings.warn(msg) Aug 10 13:10:31.201216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: Aug 10 13:10:31.202354 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881c804-8223-40a1-9f6a-b4bdd0a8f4f6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:10:31.225391 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 746/1478] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 10 13:10:30 2022] GET /identity/v3/projects => generated 2553 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:10:33.367839 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd9120-0a78-469a-8d8e-85ff209034f4 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:33.368711 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd9120-0a78-469a-8d8e-85ff209034f4 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:33.368711 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd9120-0a78-469a-8d8e-85ff209034f4 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:33.370500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 733/1479] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:10:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:10:33.376764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153d0d8-b73d-4e7b-9519-b37da80ecb6c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:33.377372 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153d0d8-b73d-4e7b-9519-b37da80ecb6c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:33.377372 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153d0d8-b73d-4e7b-9519-b37da80ecb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:33.460984 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9153d0d8-b73d-4e7b-9519-b37da80ecb6c None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:10:33.462255 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9153d0d8-b73d-4e7b-9519-b37da80ecb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:33.576051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 747/1480] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:10:33.623387 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd9120-0a78-469a-8d8e-85ff209034f4 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:10:33.624956 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-06cd9120-0a78-469a-8d8e-85ff209034f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:33.640801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:10:33.807141 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd9120-0a78-469a-8d8e-85ff209034f4 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:10:33.900775 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:10:33.940465 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898b2bb-6857-42a6-806e-57d6ca41deb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:10:33.941079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898b2bb-6857-42a6-806e-57d6ca41deb2 service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:33.941355 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898b2bb-6857-42a6-806e-57d6ca41deb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:33.941625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898b2bb-6857-42a6-806e-57d6ca41deb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:33.943359 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c898b2bb-6857-42a6-806e-57d6ca41deb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:34.058032 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898b2bb-6857-42a6-806e-57d6ca41deb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:10:34.059703 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898b2bb-6857-42a6-806e-57d6ca41deb2 service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:10:34.094377 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 734/1481] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:10:36.444238 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4ce71-b569-406f-8ee6-b406bd7a55b0 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:36.444871 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4ce71-b569-406f-8ee6-b406bd7a55b0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:36.444871 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4ce71-b569-406f-8ee6-b406bd7a55b0 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:36.446189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 748/1482] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:10:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:10:36.454912 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fecbba-33c1-4fd1-9138-c6da43ef1380 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:36.455798 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fecbba-33c1-4fd1-9138-c6da43ef1380 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:36.455798 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fecbba-33c1-4fd1-9138-c6da43ef1380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:36.537730 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-40fecbba-33c1-4fd1-9138-c6da43ef1380 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:10:36.539034 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-40fecbba-33c1-4fd1-9138-c6da43ef1380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:36.600094 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:10:36.683964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 735/1483] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:10:36.730674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4ce71-b569-406f-8ee6-b406bd7a55b0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:10:36.732278 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-72d4ce71-b569-406f-8ee6-b406bd7a55b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:36.761449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:10:36.876603 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4ce71-b569-406f-8ee6-b406bd7a55b0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:10:36.982415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217c5e2-a917-40be-860b-1fb83281ff18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:10:36.983688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217c5e2-a917-40be-860b-1fb83281ff18 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:36.983975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217c5e2-a917-40be-860b-1fb83281ff18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:36.984253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217c5e2-a917-40be-860b-1fb83281ff18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:36.986022 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6217c5e2-a917-40be-860b-1fb83281ff18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:37.093817 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:10:37.140359 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217c5e2-a917-40be-860b-1fb83281ff18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:10:37.141873 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217c5e2-a917-40be-860b-1fb83281ff18 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:10:37.170010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 749/1484] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:10:39.359126 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed05db5-963c-49fc-971a-2b2722ffc38c None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:39.359755 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed05db5-963c-49fc-971a-2b2722ffc38c None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:39.359755 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed05db5-963c-49fc-971a-2b2722ffc38c None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:39.361204 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 736/1485] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:10:39.367074 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b5c03-13c1-46eb-8c59-ead8c19dc878 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:39.367074 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b5c03-13c1-46eb-8c59-ead8c19dc878 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:39.369462 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b5c03-13c1-46eb-8c59-ead8c19dc878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:39.448662 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-884b5c03-13c1-46eb-8c59-ead8c19dc878 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:10:39.450058 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-884b5c03-13c1-46eb-8c59-ead8c19dc878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:39.579401 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 750/1486] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:10:39.619070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed05db5-963c-49fc-971a-2b2722ffc38c None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:10:39.620590 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7ed05db5-963c-49fc-971a-2b2722ffc38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:39.805199 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed05db5-963c-49fc-971a-2b2722ffc38c None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:10:39.906621 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:10:39.908955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19385f-05da-471b-a11a-9cc2385749e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:10:39.909592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19385f-05da-471b-a11a-9cc2385749e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:39.910143 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19385f-05da-471b-a11a-9cc2385749e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:39.910774 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19385f-05da-471b-a11a-9cc2385749e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:39.912794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-0c19385f-05da-471b-a11a-9cc2385749e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:40.059296 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19385f-05da-471b-a11a-9cc2385749e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:10:40.060971 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19385f-05da-471b-a11a-9cc2385749e9 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:10:40.084162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 737/1487] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:10:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:10:42.514199 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cf544-6394-4031-9a9c-f1eaf9fe56ee None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:42.514831 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cf544-6394-4031-9a9c-f1eaf9fe56ee None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:42.515234 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cf544-6394-4031-9a9c-f1eaf9fe56ee None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:42.518369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 751/1488] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:10:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:10:42.525829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3774cc-23a4-4bab-917a-113c66da55fa None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:42.526450 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3774cc-23a4-4bab-917a-113c66da55fa None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:42.526619 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3774cc-23a4-4bab-917a-113c66da55fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:42.614124 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-fc3774cc-23a4-4bab-917a-113c66da55fa None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:10:42.615927 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-fc3774cc-23a4-4bab-917a-113c66da55fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:42.687844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:10:42.742238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 738/1489] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:10:42.785663 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cf544-6394-4031-9a9c-f1eaf9fe56ee None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:10:42.787290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b24cf544-6394-4031-9a9c-f1eaf9fe56ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:42.830768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:10:42.940314 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cf544-6394-4031-9a9c-f1eaf9fe56ee None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:10:43.031099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54211569-c01a-4289-9ea7-3d941d970133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:10:43.031627 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54211569-c01a-4289-9ea7-3d941d970133 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:43.031907 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54211569-c01a-4289-9ea7-3d941d970133 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:43.032204 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54211569-c01a-4289-9ea7-3d941d970133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:43.033967 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-54211569-c01a-4289-9ea7-3d941d970133 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:43.127510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:10:43.162321 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54211569-c01a-4289-9ea7-3d941d970133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:10:43.163851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54211569-c01a-4289-9ea7-3d941d970133 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:10:43.189346 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 752/1490] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:10:45.981542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e93ca7-ec09-49d3-a732-a9ebbee58898 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:45.982135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e93ca7-ec09-49d3-a732-a9ebbee58898 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:45.982244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e93ca7-ec09-49d3-a732-a9ebbee58898 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:45.983751 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 739/1491] 10.222.0.46 () {54 vars in 927 bytes} [Wed Aug 10 13:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:10:45.992550 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505afb3a-f7c6-4036-a68a-7a43763b2bd7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:45.992550 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505afb3a-f7c6-4036-a68a-7a43763b2bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:45.993316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505afb3a-f7c6-4036-a68a-7a43763b2bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:46.078059 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-505afb3a-f7c6-4036-a68a-7a43763b2bd7 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:10:46.081264 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-505afb3a-f7c6-4036-a68a-7a43763b2bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:46.209686 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 753/1492] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Aug 10 13:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:10:46.253092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e93ca7-ec09-49d3-a732-a9ebbee58898 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:10:46.254766 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-04e93ca7-ec09-49d3-a732-a9ebbee58898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:46.421272 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e93ca7-ec09-49d3-a732-a9ebbee58898 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:10:46.516907 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74eb01-509f-49b7-88ef-9f95291b5fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:10:46.517525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74eb01-509f-49b7-88ef-9f95291b5fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:10:46.517925 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74eb01-509f-49b7-88ef-9f95291b5fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:10:46.518263 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74eb01-509f-49b7-88ef-9f95291b5fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:10:46.520500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-ce74eb01-509f-49b7-88ef-9f95291b5fa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:10:46.537245 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:10:46.667437 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74eb01-509f-49b7-88ef-9f95291b5fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:10:46.668902 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74eb01-509f-49b7-88ef-9f95291b5fa0 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:10:46.691032 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 740/1493] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:10:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:10:56.207276 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=82 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:10:56.689289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=50 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:12:10.507842 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebfd34-e1e8-4148-aed3-baba8091fd05 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:12:10.508513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebfd34-e1e8-4148-aed3-baba8091fd05 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:12:10.508513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebfd34-e1e8-4148-aed3-baba8091fd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:12:10.599465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-61ebfd34-e1e8-4148-aed3-baba8091fd05 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:12:10.600618 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-61ebfd34-e1e8-4148-aed3-baba8091fd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:12:10.716492 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 754/1494] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:12:10.725356 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eaa01-b81d-4fce-983a-f3d505cc47fb None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:12:10.726019 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eaa01-b81d-4fce-983a-f3d505cc47fb None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:12:10.726019 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eaa01-b81d-4fce-983a-f3d505cc47fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:12:10.814325 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-ce5eaa01-b81d-4fce-983a-f3d505cc47fb None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:12:10.815617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-ce5eaa01-b81d-4fce-983a-f3d505cc47fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:12:10.966071 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 741/1495] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:12:10.971613 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebfd34-e1e8-4148-aed3-baba8091fd05 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:12:10.972892 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-61ebfd34-e1e8-4148-aed3-baba8091fd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:12:10.986338 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebfd34-e1e8-4148-aed3-baba8091fd05 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:12:11.058372 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:12:11.102410 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f81c2-c43d-49f4-8851-47f698c8419c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:12:11.103063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f81c2-c43d-49f4-8851-47f698c8419c admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:12:11.103339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f81c2-c43d-49f4-8851-47f698c8419c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:12:11.103621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f81c2-c43d-49f4-8851-47f698c8419c admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:12:11.104276 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f81c2-c43d-49f4-8851-47f698c8419c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:12:11.104575 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f81c2-c43d-49f4-8851-47f698c8419c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:12:11.105606 dv-cinder-836027-5-smb devstack@keystone.service[80296]: WARNING py.warnings [None req-f49f81c2-c43d-49f4-8851-47f698c8419c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:12:11.105606 dv-cinder-836027-5-smb devstack@keystone.service[80296]: warnings.warn(msg) Aug 10 13:12:11.105606 dv-cinder-836027-5-smb devstack@keystone.service[80296]: Aug 10 13:12:11.106520 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f81c2-c43d-49f4-8851-47f698c8419c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:12:11.130775 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 755/1496] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:12:11.139932 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5eaa01-b81d-4fce-983a-f3d505cc47fb None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:12:11.150475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5eaa01-b81d-4fce-983a-f3d505cc47fb None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:12:11.224982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:12:11.268507 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd9c7c-6140-407d-8e83-b67dcf14c038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:12:11.269179 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd9c7c-6140-407d-8e83-b67dcf14c038 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:12:11.269495 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd9c7c-6140-407d-8e83-b67dcf14c038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:12:11.269805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd9c7c-6140-407d-8e83-b67dcf14c038 admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:12:11.270507 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd9c7c-6140-407d-8e83-b67dcf14c038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:12:11.272482 dv-cinder-836027-5-smb devstack@keystone.service[80297]: WARNING py.warnings [None req-32bd9c7c-6140-407d-8e83-b67dcf14c038 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:12:11.272482 dv-cinder-836027-5-smb devstack@keystone.service[80297]: warnings.warn(msg) Aug 10 13:12:11.272482 dv-cinder-836027-5-smb devstack@keystone.service[80297]: Aug 10 13:12:11.273965 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd9c7c-6140-407d-8e83-b67dcf14c038 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:12:11.347823 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 742/1497] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:12:11 2022] POST /identity/v3/projects => generated 379 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:12:11.352460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f81c2-c43d-49f4-8851-47f698c8419c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:12:11.354090 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f49f81c2-c43d-49f4-8851-47f698c8419c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:12:11.396691 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f81c2-c43d-49f4-8851-47f698c8419c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:12:11.524640 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959d522-d6ea-4d6e-8498-e2b675e97797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:12:11.525759 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959d522-d6ea-4d6e-8498-e2b675e97797 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:12:11.525759 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959d522-d6ea-4d6e-8498-e2b675e97797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:12:11.526056 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959d522-d6ea-4d6e-8498-e2b675e97797 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:12:11.526681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959d522-d6ea-4d6e-8498-e2b675e97797 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:12:11.527777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: WARNING py.warnings [None req-d959d522-d6ea-4d6e-8498-e2b675e97797 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:12:11.527777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: warnings.warn(msg) Aug 10 13:12:11.527777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: Aug 10 13:12:11.529010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959d522-d6ea-4d6e-8498-e2b675e97797 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:12:11.580476 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 756/1498] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:12:11 2022] POST /identity/v3/users => generated 290 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:12:11.586093 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd9c7c-6140-407d-8e83-b67dcf14c038 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:12:11.588699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-32bd9c7c-6140-407d-8e83-b67dcf14c038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:12:11.697041 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd9c7c-6140-407d-8e83-b67dcf14c038 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:12:11.801168 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:12:11.817141 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a92a0-9d11-4cf4-a4f3-d316cc22d792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:12:11.817759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a92a0-9d11-4cf4-a4f3-d316cc22d792 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:12:11.818036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a92a0-9d11-4cf4-a4f3-d316cc22d792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:12:11.818303 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a92a0-9d11-4cf4-a4f3-d316cc22d792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:12:11.818955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a92a0-9d11-4cf4-a4f3-d316cc22d792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:12:11.820075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: WARNING py.warnings [None req-d22a92a0-9d11-4cf4-a4f3-d316cc22d792 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:12:11.820075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: warnings.warn(msg) Aug 10 13:12:11.820075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: Aug 10 13:12:11.821021 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a92a0-9d11-4cf4-a4f3-d316cc22d792 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:12:11.835987 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 743/1499] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:12:11.841178 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959d522-d6ea-4d6e-8498-e2b675e97797 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:12:11.843272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d959d522-d6ea-4d6e-8498-e2b675e97797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:12:11.855857 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959d522-d6ea-4d6e-8498-e2b675e97797 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:12:11.887188 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:12:11.975178 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4bb35-40c1-42cf-96bd-20527e71ed43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:12:11.975784 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4bb35-40c1-42cf-96bd-20527e71ed43 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:12:11.976122 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4bb35-40c1-42cf-96bd-20527e71ed43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:12:11.976439 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4bb35-40c1-42cf-96bd-20527e71ed43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:12:11.977174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4bb35-40c1-42cf-96bd-20527e71ed43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:12:11.978383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: WARNING py.warnings [None req-2ec4bb35-40c1-42cf-96bd-20527e71ed43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:12:11.978383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: warnings.warn(msg) Aug 10 13:12:11.978383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: Aug 10 13:12:11.979552 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4bb35-40c1-42cf-96bd-20527e71ed43 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:12:11.997078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 757/1500] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:12:12.001387 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a92a0-9d11-4cf4-a4f3-d316cc22d792 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:12:12.002969 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d22a92a0-9d11-4cf4-a4f3-d316cc22d792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:12:12.042333 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a92a0-9d11-4cf4-a4f3-d316cc22d792 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:12:12.155763 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50faac8-feaa-4f63-899c-b0299ca23fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:12:12.156429 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50faac8-feaa-4f63-899c-b0299ca23fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:12:12.156700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50faac8-feaa-4f63-899c-b0299ca23fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:12:12.156964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50faac8-feaa-4f63-899c-b0299ca23fb7 admin admin] PATH_INFO: `/v3/projects/118d782dfb1c4ab2a6458d372f0c2b5b/users/a3207dcec2ef43e480a98f74c829670d/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:12:12.183464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50faac8-feaa-4f63-899c-b0299ca23fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=118d782dfb1c4ab2a6458d372f0c2b5b, user_id=a3207dcec2ef43e480a98f74c829670d, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:12:12.184502 dv-cinder-836027-5-smb devstack@keystone.service[80297]: WARNING py.warnings [None req-b50faac8-feaa-4f63-899c-b0299ca23fb7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:12:12.184502 dv-cinder-836027-5-smb devstack@keystone.service[80297]: warnings.warn(msg) Aug 10 13:12:12.184502 dv-cinder-836027-5-smb devstack@keystone.service[80297]: Aug 10 13:12:12.186564 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50faac8-feaa-4f63-899c-b0299ca23fb7 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:12:12.217192 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 744/1501] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:12:12 2022] PUT /identity/v3/projects/118d782dfb1c4ab2a6458d372f0c2b5b/users/a3207dcec2ef43e480a98f74c829670d/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:12:12.230890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb847e7-9668-4b8c-890c-52010aaf0d28 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:12:12.231168 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb847e7-9668-4b8c-890c-52010aaf0d28 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:12:12.231496 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb847e7-9668-4b8c-890c-52010aaf0d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:12:12.301624 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4cb847e7-9668-4b8c-890c-52010aaf0d28 None None] MFA Rules not processed for user `a3207dcec2ef43e480a98f74c829670d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:12:12.303514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4cb847e7-9668-4b8c-890c-52010aaf0d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:12:12.401876 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 758/1502] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:12:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:12:12.418764 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ce91-f28f-47a9-b304-da3e0a84fd38 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:12:12.419122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ce91-f28f-47a9-b304-da3e0a84fd38 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:12:12.419442 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ce91-f28f-47a9-b304-da3e0a84fd38 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:12:12.420981 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 745/1503] 10.222.0.46 () {54 vars in 964 bytes} [Wed Aug 10 13:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:12:12.427117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bb7f1-f82e-4eb5-baaf-6d5fbfc0bb68 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:12:12.427492 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bb7f1-f82e-4eb5-baaf-6d5fbfc0bb68 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:12:12.427885 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bb7f1-f82e-4eb5-baaf-6d5fbfc0bb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:12:12.465225 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:12:12.522764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-170bb7f1-f82e-4eb5-baaf-6d5fbfc0bb68 None None] MFA Rules not processed for user `ad44decbbaee4d11ac076220bb9c7f40`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:12:12.524066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-170bb7f1-f82e-4eb5-baaf-6d5fbfc0bb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:12:12.629232 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 759/1504] 10.222.0.46 () {58 vars in 1061 bytes} [Wed Aug 10 13:12:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:12:12.637676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9ce91-f28f-47a9-b304-da3e0a84fd38 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:12:12.639485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-8dd9ce91-f28f-47a9-b304-da3e0a84fd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:12:12.711215 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:12:12.783795 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9ce91-f28f-47a9-b304-da3e0a84fd38 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:12:12.875138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d4f97-774a-4b8e-ba62-8ffff1fea239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:12:12.876101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d4f97-774a-4b8e-ba62-8ffff1fea239 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:12:12.876281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d4f97-774a-4b8e-ba62-8ffff1fea239 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:12:12.876624 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d4f97-774a-4b8e-ba62-8ffff1fea239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:12:12.878410 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-800d4f97-774a-4b8e-ba62-8ffff1fea239 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:12:13.000801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d4f97-774a-4b8e-ba62-8ffff1fea239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:12:13.002305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d4f97-774a-4b8e-ba62-8ffff1fea239 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:12:13.006940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:12:13.031731 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 746/1505] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:12:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:12:13.083581 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91081282-6312-4809-aed6-ac2b44d1559c None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:12:13.083846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91081282-6312-4809-aed6-ac2b44d1559c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:12:13.084121 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91081282-6312-4809-aed6-ac2b44d1559c None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:12:13.085409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 760/1506] 10.222.0.46 () {52 vars in 830 bytes} [Wed Aug 10 13:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:12:13.090308 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d4f97-774a-4b8e-ba62-8ffff1fea239 service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:12:13.091890 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-800d4f97-774a-4b8e-ba62-8ffff1fea239 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:12:13.208893 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d4f97-774a-4b8e-ba62-8ffff1fea239 service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:12:13.358797 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8943c-2336-4974-906a-f0e2a6413c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:12:13.359807 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8943c-2336-4974-906a-f0e2a6413c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:12:13.360271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8943c-2336-4974-906a-f0e2a6413c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:12:13.360758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8943c-2336-4974-906a-f0e2a6413c9d admin admin] PATH_INFO: `/v3/users/a3207dcec2ef43e480a98f74c829670d` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:12:13.384889 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8943c-2336-4974-906a-f0e2a6413c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3207dcec2ef43e480a98f74c829670d)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:12:13.386717 dv-cinder-836027-5-smb devstack@keystone.service[80297]: WARNING py.warnings [None req-0bb8943c-2336-4974-906a-f0e2a6413c9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:12:13.386717 dv-cinder-836027-5-smb devstack@keystone.service[80297]: warnings.warn(msg) Aug 10 13:12:13.386717 dv-cinder-836027-5-smb devstack@keystone.service[80297]: Aug 10 13:12:13.389666 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8943c-2336-4974-906a-f0e2a6413c9d admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:12:13.408915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:12:13.501777 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-0bb8943c-2336-4974-906a-f0e2a6413c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3207dcec2ef43e480a98f74c829670d'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:12:13.502236 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-0bb8943c-2336-4974-906a-f0e2a6413c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3207dcec2ef43e480a98f74c829670d'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:12:13.515128 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-0bb8943c-2336-4974-906a-f0e2a6413c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3207dcec2ef43e480a98f74c829670d'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:12:13.533185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-0bb8943c-2336-4974-906a-f0e2a6413c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3207dcec2ef43e480a98f74c829670d'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:12:13.566115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-0bb8943c-2336-4974-906a-f0e2a6413c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3207dcec2ef43e480a98f74c829670d'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:12:13.573769 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 747/1507] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:12:13 2022] DELETE /identity/v3/users/a3207dcec2ef43e480a98f74c829670d => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:12:13.579083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683891c-d954-4127-817b-48e16abbf0b1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:12:13.579373 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683891c-d954-4127-817b-48e16abbf0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:12:13.579647 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683891c-d954-4127-817b-48e16abbf0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:12:13.685663 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8683891c-d954-4127-817b-48e16abbf0b1 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:12:13.687799 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8683891c-d954-4127-817b-48e16abbf0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:12:13.846314 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:12:13.876797 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 761/1508] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:12:13.887451 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8943c-2336-4974-906a-f0e2a6413c9d admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:12:13.889907 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-0bb8943c-2336-4974-906a-f0e2a6413c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:12:14.021305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8943c-2336-4974-906a-f0e2a6413c9d admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:12:14.087830 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:12:14.115491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943ca96-a426-4b43-8c4b-e319b051688c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:12:14.116265 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943ca96-a426-4b43-8c4b-e319b051688c service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:12:14.116674 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943ca96-a426-4b43-8c4b-e319b051688c service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:12:14.117011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943ca96-a426-4b43-8c4b-e319b051688c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:12:14.118836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-e943ca96-a426-4b43-8c4b-e319b051688c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:12:14.247877 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943ca96-a426-4b43-8c4b-e319b051688c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:12:14.249775 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943ca96-a426-4b43-8c4b-e319b051688c service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:12:14.274716 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 748/1509] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:12:14.709647 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683891c-d954-4127-817b-48e16abbf0b1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:12:14.711247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8683891c-d954-4127-817b-48e16abbf0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:12:14.724192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683891c-d954-4127-817b-48e16abbf0b1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:12:14.859542 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d84c46-28bf-4d7c-ae30-c25e3409e70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:12:14.860325 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d84c46-28bf-4d7c-ae30-c25e3409e70c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:12:14.860712 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d84c46-28bf-4d7c-ae30-c25e3409e70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:12:14.861156 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d84c46-28bf-4d7c-ae30-c25e3409e70c admin admin] PATH_INFO: `/v3/projects/118d782dfb1c4ab2a6458d372f0c2b5b` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:12:14.873926 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d84c46-28bf-4d7c-ae30-c25e3409e70c admin admin] RBAC: Authorizing `identity:delete_project(project_id=118d782dfb1c4ab2a6458d372f0c2b5b)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:12:14.875312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: WARNING py.warnings [None req-d6d84c46-28bf-4d7c-ae30-c25e3409e70c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:12:14.875312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: warnings.warn(msg) Aug 10 13:12:14.875312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: Aug 10 13:12:14.876687 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d84c46-28bf-4d7c-ae30-c25e3409e70c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:12:14.947268 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d6d84c46-28bf-4d7c-ae30-c25e3409e70c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '118d782dfb1c4ab2a6458d372f0c2b5b', 'request_id': 'req-d6d84c46-28bf-4d7c-ae30-c25e3409e70c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:12:14.960236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d6d84c46-28bf-4d7c-ae30-c25e3409e70c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '118d782dfb1c4ab2a6458d372f0c2b5b', 'request_id': 'req-d6d84c46-28bf-4d7c-ae30-c25e3409e70c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:12:14.976455 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d6d84c46-28bf-4d7c-ae30-c25e3409e70c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '118d782dfb1c4ab2a6458d372f0c2b5b', 'request_id': 'req-d6d84c46-28bf-4d7c-ae30-c25e3409e70c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:12:15.010145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d6d84c46-28bf-4d7c-ae30-c25e3409e70c admin admin] The token cache is being invalidate because project 118d782dfb1c4ab2a6458d372f0c2b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:12:15.010433 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d6d84c46-28bf-4d7c-ae30-c25e3409e70c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:12:15.012445 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d6d84c46-28bf-4d7c-ae30-c25e3409e70c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:12:15.015039 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 762/1510] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:12:14 2022] DELETE /identity/v3/projects/118d782dfb1c4ab2a6458d372f0c2b5b => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:12:24.275182 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=62 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:12:25.006298 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:13:56.848417 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069271c-bc0b-4459-84fa-6af6362ffc78 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:13:56.849077 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069271c-bc0b-4459-84fa-6af6362ffc78 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:13:56.849077 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069271c-bc0b-4459-84fa-6af6362ffc78 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:13:56.850427 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 13:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:13:56.855931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3f263-c12e-4b3e-9400-9bf47683fc8a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:13:56.856499 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3f263-c12e-4b3e-9400-9bf47683fc8a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:13:56.856499 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3f263-c12e-4b3e-9400-9bf47683fc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:13:56.944002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b4c3f263-c12e-4b3e-9400-9bf47683fc8a None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:13:56.945337 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b4c3f263-c12e-4b3e-9400-9bf47683fc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:13:57.058692 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 13:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:13:57.215317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069271c-bc0b-4459-84fa-6af6362ffc78 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:13:57.217785 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-5069271c-bc0b-4459-84fa-6af6362ffc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:13:57.345220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069271c-bc0b-4459-84fa-6af6362ffc78 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:13:57.350860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05d704-9db2-4192-9ac5-c335c1c08c87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:13:57.351503 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05d704-9db2-4192-9ac5-c335c1c08c87 service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:13:57.351835 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05d704-9db2-4192-9ac5-c335c1c08c87 service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:13:57.352055 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05d704-9db2-4192-9ac5-c335c1c08c87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:13:57.361451 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05d704-9db2-4192-9ac5-c335c1c08c87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:13:57.363172 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05d704-9db2-4192-9ac5-c335c1c08c87 service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:13:57.373535 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 750/1513] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:13:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:13:58.234906 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a7eab-1028-4c9a-88a8-e02087589968 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:13:58.235580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a7eab-1028-4c9a-88a8-e02087589968 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:13:58.235580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a7eab-1028-4c9a-88a8-e02087589968 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:13:58.238449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 13:13:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:13:58.245661 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217edec-7f16-4430-828c-f267fea8265b None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:13:58.246207 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217edec-7f16-4430-828c-f267fea8265b None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:13:58.246207 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217edec-7f16-4430-828c-f267fea8265b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:13:58.272701 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-e217edec-7f16-4430-828c-f267fea8265b None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:13:58.273936 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-e217edec-7f16-4430-828c-f267fea8265b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:13:58.283316 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 13:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:13:58.320971 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ff571-ebff-4a3b-93c7-7a011cb2f8d9 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:13:58.321245 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ff571-ebff-4a3b-93c7-7a011cb2f8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:13:58.321731 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ff571-ebff-4a3b-93c7-7a011cb2f8d9 None None] PATH_INFO: `/v3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:13:58.329810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 765/1516] 10.222.0.15 () {54 vars in 925 bytes} [Wed Aug 10 13:13:58 2022] GET /identity/v3 => generated 255 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:13:58.338614 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba9560-be7b-41c5-b345-cbe814570594 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:13:58.338897 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba9560-be7b-41c5-b345-cbe814570594 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:13:58.339452 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba9560-be7b-41c5-b345-cbe814570594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:13:58.406688 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-7eba9560-be7b-41c5-b345-cbe814570594 None None] MFA Rules not processed for user `15780b69faa745e9b99f1fffb6abe231`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:13:58.407941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7eba9560-be7b-41c5-b345-cbe814570594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:13:58.436611 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ff571-ebff-4a3b-93c7-7a011cb2f8d9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:13:58.451277 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ff571-ebff-4a3b-93c7-7a011cb2f8d9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:13:58.456971 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8786b-aca5-4507-b1b0-6f4ddfb93fd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:13:58.457594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8786b-aca5-4507-b1b0-6f4ddfb93fd3 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:13:58.457878 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8786b-aca5-4507-b1b0-6f4ddfb93fd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:13:58.458158 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8786b-aca5-4507-b1b0-6f4ddfb93fd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:13:58.463838 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:13:58.468636 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8786b-aca5-4507-b1b0-6f4ddfb93fd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:13:58.470255 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8786b-aca5-4507-b1b0-6f4ddfb93fd3 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:13:58.482330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 766/1517] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:13:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:13:58.484517 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 752/1518] 10.222.0.15 () {58 vars in 1015 bytes} [Wed Aug 10 13:13:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:14:07.390346 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e0360-52d1-4299-a2de-bc2db9dc3707 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:14:07.390962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e0360-52d1-4299-a2de-bc2db9dc3707 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:14:07.390962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e0360-52d1-4299-a2de-bc2db9dc3707 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:14:07.392250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 767/1519] 10.222.0.46 () {54 vars in 961 bytes} [Wed Aug 10 13:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:14:07.397905 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747c6ab-6258-4a37-bb98-be6d933ce2b2 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:14:07.398418 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747c6ab-6258-4a37-bb98-be6d933ce2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:14:07.398528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747c6ab-6258-4a37-bb98-be6d933ce2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:14:07.417874 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-7747c6ab-6258-4a37-bb98-be6d933ce2b2 None None] MFA Rules not processed for user `15780b69faa745e9b99f1fffb6abe231`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:14:07.419109 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7747c6ab-6258-4a37-bb98-be6d933ce2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:14:07.427690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 753/1520] 10.222.0.46 () {58 vars in 1058 bytes} [Wed Aug 10 13:14:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:14:07.436005 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e0360-52d1-4299-a2de-bc2db9dc3707 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:14:07.449960 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e0360-52d1-4299-a2de-bc2db9dc3707 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:14:07.454923 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a8382-7506-47f0-ac64-1ec953f9c9ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15780b69faa745e9b99f1fffb6abe231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:14:07.455559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a8382-7506-47f0-ac64-1ec953f9c9ee service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:14:07.455837 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a8382-7506-47f0-ac64-1ec953f9c9ee service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:14:07.456112 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a8382-7506-47f0-ac64-1ec953f9c9ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:14:07.465321 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a8382-7506-47f0-ac64-1ec953f9c9ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:14:07.466929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a8382-7506-47f0-ac64-1ec953f9c9ee service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:14:07.476944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 768/1521] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:14:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:14:09.742219 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca466687-64be-4071-a275-6a0ad4ad8711 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:14:09.742756 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca466687-64be-4071-a275-6a0ad4ad8711 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:14:09.742756 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca466687-64be-4071-a275-6a0ad4ad8711 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:14:09.744248 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 754/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 13:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:14:09.748990 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2c8c7-533e-47ed-bce7-b33b4e468580 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:14:09.749412 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2c8c7-533e-47ed-bce7-b33b4e468580 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:14:09.749522 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2c8c7-533e-47ed-bce7-b33b4e468580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:14:09.768303 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-1fc2c8c7-533e-47ed-bce7-b33b4e468580 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:14:09.769499 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1fc2c8c7-533e-47ed-bce7-b33b4e468580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:14:09.777929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 769/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 13:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:14:09.935955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca466687-64be-4071-a275-6a0ad4ad8711 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:14:09.951350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca466687-64be-4071-a275-6a0ad4ad8711 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:14:09.957496 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e0cbf-bdf4-48d5-906a-d4c4af176ad2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:14:09.958145 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e0cbf-bdf4-48d5-906a-d4c4af176ad2 service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:14:09.958423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e0cbf-bdf4-48d5-906a-d4c4af176ad2 service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:14:09.958695 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e0cbf-bdf4-48d5-906a-d4c4af176ad2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:14:09.970648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e0cbf-bdf4-48d5-906a-d4c4af176ad2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:14:09.972272 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e0cbf-bdf4-48d5-906a-d4c4af176ad2 service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:14:09.982806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 755/1524] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:14:10.877109 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b5e27-76ba-4265-8994-c50a334fd3df None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:14:10.877693 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b5e27-76ba-4265-8994-c50a334fd3df None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:14:10.877693 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b5e27-76ba-4265-8994-c50a334fd3df None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:14:10.879081 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 770/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 13:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:14:10.886453 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d41b15-16cf-4385-a68c-dc6179bbebb0 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:14:10.886829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d41b15-16cf-4385-a68c-dc6179bbebb0 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:14:10.886978 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d41b15-16cf-4385-a68c-dc6179bbebb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:14:10.907778 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-99d41b15-16cf-4385-a68c-dc6179bbebb0 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:14:10.909091 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-99d41b15-16cf-4385-a68c-dc6179bbebb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:14:10.923895 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 756/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 13:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:14:11.076778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b5e27-76ba-4265-8994-c50a334fd3df None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:14:11.097719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b5e27-76ba-4265-8994-c50a334fd3df None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:14:11.103484 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241218a-7908-4d5d-b04e-c0684e709bae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:14:11.104131 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241218a-7908-4d5d-b04e-c0684e709bae service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:14:11.104407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241218a-7908-4d5d-b04e-c0684e709bae service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:14:11.104677 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241218a-7908-4d5d-b04e-c0684e709bae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:14:11.113600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241218a-7908-4d5d-b04e-c0684e709bae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:14:11.115354 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241218a-7908-4d5d-b04e-c0684e709bae service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:14:11.126119 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 771/1527] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:14:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:14:15.435969 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f9a40-edda-4617-82f0-812f5fa638b9 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:14:15.436551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f9a40-edda-4617-82f0-812f5fa638b9 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:14:15.436551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f9a40-edda-4617-82f0-812f5fa638b9 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:14:15.437864 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 757/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 13:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:14:15.443269 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed2184-074b-4459-940f-c428ad9a54a4 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:14:15.443788 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed2184-074b-4459-940f-c428ad9a54a4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:14:15.443946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed2184-074b-4459-940f-c428ad9a54a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:14:15.466671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-62ed2184-074b-4459-940f-c428ad9a54a4 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:14:15.468054 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-62ed2184-074b-4459-940f-c428ad9a54a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:14:15.476293 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 772/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 13:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:14:15.553898 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f9a40-edda-4617-82f0-812f5fa638b9 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:14:15.556020 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-dc0f9a40-edda-4617-82f0-812f5fa638b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:14:15.646869 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f9a40-edda-4617-82f0-812f5fa638b9 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:14:15.650514 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f26d3-29dc-4ac0-a441-f8348202174e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:14:15.651153 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f26d3-29dc-4ac0-a441-f8348202174e service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:14:15.651434 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f26d3-29dc-4ac0-a441-f8348202174e service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:14:15.651700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f26d3-29dc-4ac0-a441-f8348202174e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:14:15.661073 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f26d3-29dc-4ac0-a441-f8348202174e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:14:15.662495 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f26d3-29dc-4ac0-a441-f8348202174e service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:14:15.672186 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 758/1530] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:14:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:14:17.718813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d10d5-f5f0-4481-9a89-d3512d5a4c3b None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:14:17.719405 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d10d5-f5f0-4481-9a89-d3512d5a4c3b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:14:17.719405 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d10d5-f5f0-4481-9a89-d3512d5a4c3b None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:14:17.720748 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 773/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 13:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:14:17.726185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175d94e-ab2c-4aee-b677-7d2457b7c71c None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:14:17.726662 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175d94e-ab2c-4aee-b677-7d2457b7c71c None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:14:17.726762 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175d94e-ab2c-4aee-b677-7d2457b7c71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:14:17.747131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-e175d94e-ab2c-4aee-b677-7d2457b7c71c None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:14:17.748323 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-e175d94e-ab2c-4aee-b677-7d2457b7c71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:14:17.756238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 759/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 13:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:14:17.792061 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d10d5-f5f0-4481-9a89-d3512d5a4c3b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:14:17.802716 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d10d5-f5f0-4481-9a89-d3512d5a4c3b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:14:17.806751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f88f16-c69f-47d9-9070-25ca4ff3494e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:14:17.807401 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f88f16-c69f-47d9-9070-25ca4ff3494e service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:14:17.807663 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f88f16-c69f-47d9-9070-25ca4ff3494e service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:14:17.807935 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f88f16-c69f-47d9-9070-25ca4ff3494e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:14:17.816819 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f88f16-c69f-47d9-9070-25ca4ff3494e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:14:17.818256 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f88f16-c69f-47d9-9070-25ca4ff3494e service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:14:17.828333 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 774/1533] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:14:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:14:21.435635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adf0ac-fe74-4aa3-bc96-be943be22d66 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:14:21.436208 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adf0ac-fe74-4aa3-bc96-be943be22d66 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:14:21.436208 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adf0ac-fe74-4aa3-bc96-be943be22d66 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:14:21.437504 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 760/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 13:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:14:21.442943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9461001-1919-4220-83be-1f4984256436 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:14:21.443410 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9461001-1919-4220-83be-1f4984256436 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:14:21.443516 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9461001-1919-4220-83be-1f4984256436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:14:21.451171 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:14:21.464492 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c9461001-1919-4220-83be-1f4984256436 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:14:21.465710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c9461001-1919-4220-83be-1f4984256436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:14:21.473742 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 775/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 13:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:14:21.787535 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adf0ac-fe74-4aa3-bc96-be943be22d66 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:14:21.789224 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-e1adf0ac-fe74-4aa3-bc96-be943be22d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:14:21.868096 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adf0ac-fe74-4aa3-bc96-be943be22d66 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:14:21.871819 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e4498-5257-400b-960a-56f0b9b632c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:14:21.872424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e4498-5257-400b-960a-56f0b9b632c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:14:21.872703 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e4498-5257-400b-960a-56f0b9b632c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:14:21.872972 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e4498-5257-400b-960a-56f0b9b632c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:14:21.882169 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e4498-5257-400b-960a-56f0b9b632c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:14:21.883635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e4498-5257-400b-960a-56f0b9b632c0 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:14:21.893704 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 761/1536] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:14:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:14:23.932159 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ceef1-dd95-46d5-9312-d7067b5d1bd9 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:14:23.932732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ceef1-dd95-46d5-9312-d7067b5d1bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:14:23.932732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ceef1-dd95-46d5-9312-d7067b5d1bd9 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:14:23.933937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 776/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 13:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:14:23.939032 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02e54a-a4cc-465f-907f-97f87a19a6c1 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:14:23.939458 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02e54a-a4cc-465f-907f-97f87a19a6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:14:23.939560 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02e54a-a4cc-465f-907f-97f87a19a6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:14:23.958482 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-8c02e54a-a4cc-465f-907f-97f87a19a6c1 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:14:23.959769 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-8c02e54a-a4cc-465f-907f-97f87a19a6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:14:23.968206 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 762/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 13:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:14:24.279967 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ceef1-dd95-46d5-9312-d7067b5d1bd9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:14:24.281633 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b93ceef1-dd95-46d5-9312-d7067b5d1bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:14:24.294479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ceef1-dd95-46d5-9312-d7067b5d1bd9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:14:24.298079 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73726bd4-4d2f-4be0-a04e-1b6678f24139 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:14:24.298674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73726bd4-4d2f-4be0-a04e-1b6678f24139 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:14:24.298952 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73726bd4-4d2f-4be0-a04e-1b6678f24139 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:14:24.299256 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73726bd4-4d2f-4be0-a04e-1b6678f24139 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:14:24.309153 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73726bd4-4d2f-4be0-a04e-1b6678f24139 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:14:24.310579 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73726bd4-4d2f-4be0-a04e-1b6678f24139 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:14:24.319920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 777/1539] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:14:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:14:33.953833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=92 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:14:34.315738 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=8 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:15:54.075305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0b73f-d226-4dd6-acc7-61bac7c7ac1d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:54.076793 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0b73f-d226-4dd6-acc7-61bac7c7ac1d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:54.076793 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0b73f-d226-4dd6-acc7-61bac7c7ac1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:54.109055 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-a5b0b73f-d226-4dd6-acc7-61bac7c7ac1d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:54.110559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-a5b0b73f-d226-4dd6-acc7-61bac7c7ac1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:54.123502 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 763/1540] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:54.134066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142696e-01a8-43b7-b876-217f10dc0f63 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:54.134703 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142696e-01a8-43b7-b876-217f10dc0f63 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:54.134703 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142696e-01a8-43b7-b876-217f10dc0f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:54.172336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2142696e-01a8-43b7-b876-217f10dc0f63 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:54.174625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2142696e-01a8-43b7-b876-217f10dc0f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:54.185878 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 778/1541] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:15:54.190725 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0b73f-d226-4dd6-acc7-61bac7c7ac1d None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:54.205989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0b73f-d226-4dd6-acc7-61bac7c7ac1d None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:54.216508 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54265bf6-d5f1-4c8c-bddf-5b43c00ebb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:54.217543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54265bf6-d5f1-4c8c-bddf-5b43c00ebb42 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:54.218038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54265bf6-d5f1-4c8c-bddf-5b43c00ebb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:54.218853 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54265bf6-d5f1-4c8c-bddf-5b43c00ebb42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:54.220302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54265bf6-d5f1-4c8c-bddf-5b43c00ebb42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:15:54.220879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54265bf6-d5f1-4c8c-bddf-5b43c00ebb42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:54.222163 dv-cinder-836027-5-smb devstack@keystone.service[80297]: WARNING py.warnings [None req-54265bf6-d5f1-4c8c-bddf-5b43c00ebb42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:15:54.222163 dv-cinder-836027-5-smb devstack@keystone.service[80297]: warnings.warn(msg) Aug 10 13:15:54.222163 dv-cinder-836027-5-smb devstack@keystone.service[80297]: Aug 10 13:15:54.223662 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54265bf6-d5f1-4c8c-bddf-5b43c00ebb42 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:54.246189 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 764/1542] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:15:54.254871 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142696e-01a8-43b7-b876-217f10dc0f63 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:54.270489 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142696e-01a8-43b7-b876-217f10dc0f63 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:54.279850 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c336cc2-6c1e-4e19-a77e-49d1034cbaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:54.280548 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c336cc2-6c1e-4e19-a77e-49d1034cbaea admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:54.281482 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c336cc2-6c1e-4e19-a77e-49d1034cbaea admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:54.281776 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c336cc2-6c1e-4e19-a77e-49d1034cbaea admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:54.282478 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c336cc2-6c1e-4e19-a77e-49d1034cbaea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:54.283585 dv-cinder-836027-5-smb devstack@keystone.service[80296]: WARNING py.warnings [None req-3c336cc2-6c1e-4e19-a77e-49d1034cbaea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:15:54.283585 dv-cinder-836027-5-smb devstack@keystone.service[80296]: warnings.warn(msg) Aug 10 13:15:54.283585 dv-cinder-836027-5-smb devstack@keystone.service[80296]: Aug 10 13:15:54.284867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c336cc2-6c1e-4e19-a77e-49d1034cbaea admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:54.364189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 779/1543] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:15:54 2022] POST /identity/v3/projects => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:15:54.369436 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54265bf6-d5f1-4c8c-bddf-5b43c00ebb42 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:54.387657 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54265bf6-d5f1-4c8c-bddf-5b43c00ebb42 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:54.498431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83ace8-de97-48cb-a276-f4fc56425866 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:54.498651 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83ace8-de97-48cb-a276-f4fc56425866 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:54.498890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83ace8-de97-48cb-a276-f4fc56425866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:54.506525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a7275-cb9f-401e-a7a2-8a0ef9de7238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:54.507874 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a7275-cb9f-401e-a7a2-8a0ef9de7238 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:54.508521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a7275-cb9f-401e-a7a2-8a0ef9de7238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:54.509037 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a7275-cb9f-401e-a7a2-8a0ef9de7238 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:54.510037 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a7275-cb9f-401e-a7a2-8a0ef9de7238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:54.511421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: WARNING py.warnings [None req-da6a7275-cb9f-401e-a7a2-8a0ef9de7238 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:15:54.511421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: warnings.warn(msg) Aug 10 13:15:54.511421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: Aug 10 13:15:54.513078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a7275-cb9f-401e-a7a2-8a0ef9de7238 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:54.536156 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ce83ace8-de97-48cb-a276-f4fc56425866 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:54.538320 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ce83ace8-de97-48cb-a276-f4fc56425866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:54.553908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 780/1544] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:15:54.555764 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 765/1545] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:15:54 2022] POST /identity/v3/users => generated 284 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:15:54.560229 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83ace8-de97-48cb-a276-f4fc56425866 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:54.562837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08d48a-9ba4-43e0-a235-e56bb66c8300 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:54.563445 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08d48a-9ba4-43e0-a235-e56bb66c8300 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:54.563947 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08d48a-9ba4-43e0-a235-e56bb66c8300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:54.576213 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83ace8-de97-48cb-a276-f4fc56425866 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:54.588757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0272b-2113-4ff7-a53b-feaaa8d29d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:54.589639 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0272b-2113-4ff7-a53b-feaaa8d29d97 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:54.590085 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0272b-2113-4ff7-a53b-feaaa8d29d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:54.590569 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0272b-2113-4ff7-a53b-feaaa8d29d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:54.591601 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0272b-2113-4ff7-a53b-feaaa8d29d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:54.593289 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0272b-2113-4ff7-a53b-feaaa8d29d97 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:54.613947 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-0d08d48a-9ba4-43e0-a235-e56bb66c8300 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:54.614422 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 781/1546] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:15:54.616460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76c89b-4714-4588-9567-0663c6876877 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:54.616797 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-0d08d48a-9ba4-43e0-a235-e56bb66c8300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:54.616919 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76c89b-4714-4588-9567-0663c6876877 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:54.617109 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76c89b-4714-4588-9567-0663c6876877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:54.635600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 766/1547] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:15:54.636931 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08d48a-9ba4-43e0-a235-e56bb66c8300 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:54.662757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6b76c89b-4714-4588-9567-0663c6876877 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:54.664074 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6b76c89b-4714-4588-9567-0663c6876877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:54.666110 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08d48a-9ba4-43e0-a235-e56bb66c8300 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:54.672320 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78010b8b-1cca-48e4-b566-e1d9096c8001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:54.673300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78010b8b-1cca-48e4-b566-e1d9096c8001 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:54.673805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78010b8b-1cca-48e4-b566-e1d9096c8001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:54.674301 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78010b8b-1cca-48e4-b566-e1d9096c8001 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:54.675224 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78010b8b-1cca-48e4-b566-e1d9096c8001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:54.681876 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78010b8b-1cca-48e4-b566-e1d9096c8001 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:54.691601 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 782/1548] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:54.692448 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76c89b-4714-4588-9567-0663c6876877 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:54.703376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 767/1549] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:15:54.706730 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b84ad5-6cba-4a1c-abf9-0f0310970299 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:54.707030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b84ad5-6cba-4a1c-abf9-0f0310970299 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:54.707315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b84ad5-6cba-4a1c-abf9-0f0310970299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:54.709087 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76c89b-4714-4588-9567-0663c6876877 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:54.726025 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcff70-9bed-49e2-9e7e-4837fb437da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:54.726674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcff70-9bed-49e2-9e7e-4837fb437da7 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:54.726953 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcff70-9bed-49e2-9e7e-4837fb437da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:54.727275 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcff70-9bed-49e2-9e7e-4837fb437da7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:54.727991 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dcff70-9bed-49e2-9e7e-4837fb437da7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:15:54.728297 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dcff70-9bed-49e2-9e7e-4837fb437da7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:54.730081 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dcff70-9bed-49e2-9e7e-4837fb437da7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:54.752689 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-75b84ad5-6cba-4a1c-abf9-0f0310970299 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:54.752911 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 783/1550] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:15:54.754016 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-75b84ad5-6cba-4a1c-abf9-0f0310970299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:54.754235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b21ab-d987-44ad-9313-b067d14741fc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:54.754483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b21ab-d987-44ad-9313-b067d14741fc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:54.754758 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b21ab-d987-44ad-9313-b067d14741fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:54.763955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 768/1551] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:54.768147 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b84ad5-6cba-4a1c-abf9-0f0310970299 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:54.780105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-1e4b21ab-d987-44ad-9313-b067d14741fc None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:54.782756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1e4b21ab-d987-44ad-9313-b067d14741fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:54.786708 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b84ad5-6cba-4a1c-abf9-0f0310970299 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:54.791896 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b782c4c-d3ef-47d2-b001-31a3b0636bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:54.792578 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782c4c-d3ef-47d2-b001-31a3b0636bed admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:54.792856 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782c4c-d3ef-47d2-b001-31a3b0636bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:54.793135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782c4c-d3ef-47d2-b001-31a3b0636bed admin admin] PATH_INFO: `/v3/projects/9183b93af21c49148f141da49d7d74c1/users/2d1789225c8e457d8d864f22213e7797/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:54.794931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 784/1552] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:54.796334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84ada4-614a-4fa1-bd2b-f746b60e6ae2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:54.796626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84ada4-614a-4fa1-bd2b-f746b60e6ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:54.796898 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84ada4-614a-4fa1-bd2b-f746b60e6ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:54.811644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b782c4c-d3ef-47d2-b001-31a3b0636bed admin admin] RBAC: Authorizing `identity:create_grant(project_id=9183b93af21c49148f141da49d7d74c1, user_id=2d1789225c8e457d8d864f22213e7797, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:54.814403 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b782c4c-d3ef-47d2-b001-31a3b0636bed admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:54.817353 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8b84ada4-614a-4fa1-bd2b-f746b60e6ae2 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:54.819206 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8b84ada4-614a-4fa1-bd2b-f746b60e6ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:54.827587 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 785/1553] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:54.828805 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e04285-639c-4bec-baf0-97e7a11bc967 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:54.829096 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e04285-639c-4bec-baf0-97e7a11bc967 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:54.829371 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e04285-639c-4bec-baf0-97e7a11bc967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:54.840218 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 769/1554] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:15:54 2022] PUT /identity/v3/projects/9183b93af21c49148f141da49d7d74c1/users/2d1789225c8e457d8d864f22213e7797/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:15:54.840218 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b782c4c-d3ef-47d2-b001-31a3b0636bed admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:54.861375 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f3e04285-639c-4bec-baf0-97e7a11bc967 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:54.862903 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f3e04285-639c-4bec-baf0-97e7a11bc967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:54.928430 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b782c4c-d3ef-47d2-b001-31a3b0636bed admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:54.933416 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74c06b-75bf-4e68-81fc-9bd3366dbf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:54.934036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74c06b-75bf-4e68-81fc-9bd3366dbf0f admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:54.934151 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 786/1555] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:54.934313 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74c06b-75bf-4e68-81fc-9bd3366dbf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:54.934583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74c06b-75bf-4e68-81fc-9bd3366dbf0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:54.935250 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74c06b-75bf-4e68-81fc-9bd3366dbf0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:54.935381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4768ce6-9147-4bd3-affd-20e7c55b521b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:54.935629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4768ce6-9147-4bd3-affd-20e7c55b521b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:54.935904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4768ce6-9147-4bd3-affd-20e7c55b521b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:54.937219 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74c06b-75bf-4e68-81fc-9bd3366dbf0f admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:54.960224 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a4768ce6-9147-4bd3-affd-20e7c55b521b None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:54.961620 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a4768ce6-9147-4bd3-affd-20e7c55b521b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:54.969864 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 770/1556] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:15:54 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:15:54.970563 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 787/1557] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:54.971178 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8280d91-1faf-4988-8710-c9d0805f364d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:54.971461 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8280d91-1faf-4988-8710-c9d0805f364d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:54.971716 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4768ce6-9147-4bd3-affd-20e7c55b521b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:54.971864 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8280d91-1faf-4988-8710-c9d0805f364d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:54.989698 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4768ce6-9147-4bd3-affd-20e7c55b521b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:54.991248 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:15:54.997980 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-c8280d91-1faf-4988-8710-c9d0805f364d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:54.999239 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c8280d91-1faf-4988-8710-c9d0805f364d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:55.060259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858336d7-2516-4eac-9e10-d003f778aa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:55.060878 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858336d7-2516-4eac-9e10-d003f778aa4f admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:55.061160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858336d7-2516-4eac-9e10-d003f778aa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:55.061439 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858336d7-2516-4eac-9e10-d003f778aa4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:55.062093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858336d7-2516-4eac-9e10-d003f778aa4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:15:55.062396 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858336d7-2516-4eac-9e10-d003f778aa4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:55.064045 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858336d7-2516-4eac-9e10-d003f778aa4f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:55.067022 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 771/1558] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:55.067635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6c7ee-5b81-41df-a75e-5f557b1012f1 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:55.068459 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6c7ee-5b81-41df-a75e-5f557b1012f1 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:55.068726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6c7ee-5b81-41df-a75e-5f557b1012f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:55.075446 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:15:55.077990 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 788/1559] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:15:55.079452 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f996b59-2cce-4743-afb8-943db106759e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:55.079822 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f996b59-2cce-4743-afb8-943db106759e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:55.080168 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f996b59-2cce-4743-afb8-943db106759e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:55.099185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-e3e6c7ee-5b81-41df-a75e-5f557b1012f1 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:55.100401 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-e3e6c7ee-5b81-41df-a75e-5f557b1012f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:55.110097 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 772/1560] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:55.113227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bf174-59a8-4e3c-a495-8dd3fefda52c None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:55.114118 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bf174-59a8-4e3c-a495-8dd3fefda52c None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:55.114722 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bf174-59a8-4e3c-a495-8dd3fefda52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:55.115857 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9f996b59-2cce-4743-afb8-943db106759e None None] MFA Rules not processed for user `2d1789225c8e457d8d864f22213e7797`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:55.117107 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9f996b59-2cce-4743-afb8-943db106759e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:55.139688 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-e09bf174-59a8-4e3c-a495-8dd3fefda52c None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:55.140946 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-e09bf174-59a8-4e3c-a495-8dd3fefda52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:55.149807 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 773/1561] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:55.151243 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e79718-c7e3-4b3e-8116-520274c3b08b None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:55.151529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e79718-c7e3-4b3e-8116-520274c3b08b None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:55.151812 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e79718-c7e3-4b3e-8116-520274c3b08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:55.173880 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-62e79718-c7e3-4b3e-8116-520274c3b08b None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:55.174915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-62e79718-c7e3-4b3e-8116-520274c3b08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:55.184331 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 774/1562] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:55.185378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e79718-c7e3-4b3e-8116-520274c3b08b None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:55.196219 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e79718-c7e3-4b3e-8116-520274c3b08b None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:55.198902 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 789/1563] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:55.200811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f996b59-2cce-4743-afb8-943db106759e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:55.205961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f404e1c-3481-4331-bcb0-0e9a16c40cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:55.206585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f404e1c-3481-4331-bcb0-0e9a16c40cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:55.206863 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f404e1c-3481-4331-bcb0-0e9a16c40cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:55.207335 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f404e1c-3481-4331-bcb0-0e9a16c40cb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:55.207964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f404e1c-3481-4331-bcb0-0e9a16c40cb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:55.210209 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f404e1c-3481-4331-bcb0-0e9a16c40cb7 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:55.220912 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f996b59-2cce-4743-afb8-943db106759e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:55.229286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d0cb9-bfd8-4a30-b280-f3ad0ccdb74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:55.230321 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d0cb9-bfd8-4a30-b280-f3ad0ccdb74b admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:55.230817 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d0cb9-bfd8-4a30-b280-f3ad0ccdb74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:55.231341 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d0cb9-bfd8-4a30-b280-f3ad0ccdb74b admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:55.232159 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d0cb9-bfd8-4a30-b280-f3ad0ccdb74b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:15:55.232467 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d0cb9-bfd8-4a30-b280-f3ad0ccdb74b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:55.235500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d0cb9-bfd8-4a30-b280-f3ad0ccdb74b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:55.235655 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 775/1564] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:15:55 2022] POST /identity/v3/users => generated 290 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:15:55.236974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0938e06-8048-44bd-88bb-85b4dcffdf2b None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:55.237259 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0938e06-8048-44bd-88bb-85b4dcffdf2b None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:55.237539 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0938e06-8048-44bd-88bb-85b4dcffdf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:55.250680 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 790/1565] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:15:55.257272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d0cb9-bfd8-4a30-b280-f3ad0ccdb74b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:55.263204 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-e0938e06-8048-44bd-88bb-85b4dcffdf2b None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:55.264426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-e0938e06-8048-44bd-88bb-85b4dcffdf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:55.264625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d0cb9-bfd8-4a30-b280-f3ad0ccdb74b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:55.270628 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6b8a9-ce68-41a8-965b-bb6ad7304eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:55.271320 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6b8a9-ce68-41a8-965b-bb6ad7304eba admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:55.271605 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6b8a9-ce68-41a8-965b-bb6ad7304eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:55.271944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6b8a9-ce68-41a8-965b-bb6ad7304eba admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:55.272555 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6b8a9-ce68-41a8-965b-bb6ad7304eba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:55.273158 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 776/1566] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:55.274073 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0938e06-8048-44bd-88bb-85b4dcffdf2b None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:55.278546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6b8a9-ce68-41a8-965b-bb6ad7304eba admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:55.284755 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0938e06-8048-44bd-88bb-85b4dcffdf2b None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:55.292335 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab2bbc-9153-47ab-84a3-19f39a72a209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:55.293384 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab2bbc-9153-47ab-84a3-19f39a72a209 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:55.293891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab2bbc-9153-47ab-84a3-19f39a72a209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:55.294389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab2bbc-9153-47ab-84a3-19f39a72a209 admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:55.295621 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab2bbc-9153-47ab-84a3-19f39a72a209 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:15:55.296179 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab2bbc-9153-47ab-84a3-19f39a72a209 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:55.299344 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab2bbc-9153-47ab-84a3-19f39a72a209 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:55.311904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 791/1567] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:15:55 2022] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:15:55.311904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a61ff-939d-479a-87df-84c17468b8e7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:55.311904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a61ff-939d-479a-87df-84c17468b8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:55.311904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a61ff-939d-479a-87df-84c17468b8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:55.328153 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 777/1568] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:15:55.328153 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab2bbc-9153-47ab-84a3-19f39a72a209 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:55.342814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab2bbc-9153-47ab-84a3-19f39a72a209 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:55.343149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8e6a61ff-939d-479a-87df-84c17468b8e7 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:55.344548 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8e6a61ff-939d-479a-87df-84c17468b8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:55.410640 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6400b7-7df9-47ca-80a9-36efc580df9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:55.411805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6400b7-7df9-47ca-80a9-36efc580df9a admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:55.412258 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6400b7-7df9-47ca-80a9-36efc580df9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:55.412533 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 792/1569] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:55.412706 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6400b7-7df9-47ca-80a9-36efc580df9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:55.413858 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6400b7-7df9-47ca-80a9-36efc580df9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:15:55.414039 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a61ff-939d-479a-87df-84c17468b8e7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:55.414358 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6400b7-7df9-47ca-80a9-36efc580df9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:55.416948 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6400b7-7df9-47ca-80a9-36efc580df9a admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:55.436634 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 778/1570] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:15:55.438195 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6400b7-7df9-47ca-80a9-36efc580df9a admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:55.453083 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6400b7-7df9-47ca-80a9-36efc580df9a admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:55.458135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f59fb-7a86-4ff6-a5d3-329332749316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:55.458801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f59fb-7a86-4ff6-a5d3-329332749316 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:55.461996 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f59fb-7a86-4ff6-a5d3-329332749316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:55.461996 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f59fb-7a86-4ff6-a5d3-329332749316 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:55.461996 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f59fb-7a86-4ff6-a5d3-329332749316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:55.461996 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f59fb-7a86-4ff6-a5d3-329332749316 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:55.472795 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 779/1571] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:15:55.473679 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f59fb-7a86-4ff6-a5d3-329332749316 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:55.484014 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f59fb-7a86-4ff6-a5d3-329332749316 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:55.489322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367dbae-05e7-4943-979b-fe3e59bfd89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:55.490505 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367dbae-05e7-4943-979b-fe3e59bfd89e admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:55.490620 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a61ff-939d-479a-87df-84c17468b8e7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:55.490778 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367dbae-05e7-4943-979b-fe3e59bfd89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:55.491077 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367dbae-05e7-4943-979b-fe3e59bfd89e admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:55.491701 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367dbae-05e7-4943-979b-fe3e59bfd89e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:55.493604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367dbae-05e7-4943-979b-fe3e59bfd89e admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:55.494337 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcd5fd-99d8-4313-9e5e-a6ebc5ea276d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:55.494940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcd5fd-99d8-4313-9e5e-a6ebc5ea276d service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:55.495248 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcd5fd-99d8-4313-9e5e-a6ebc5ea276d service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:55.495516 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcd5fd-99d8-4313-9e5e-a6ebc5ea276d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:55.506315 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:15:55.527864 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 780/1572] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:15:55 2022] POST /identity/v3/projects => generated 405 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:15:55.529344 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367dbae-05e7-4943-979b-fe3e59bfd89e admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:55.544775 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:15:55.568416 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcd5fd-99d8-4313-9e5e-a6ebc5ea276d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:55.569913 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcd5fd-99d8-4313-9e5e-a6ebc5ea276d service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:55.585336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 793/1573] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:15:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:15:55.586175 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcd5fd-99d8-4313-9e5e-a6ebc5ea276d service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:55.597322 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcd5fd-99d8-4313-9e5e-a6ebc5ea276d service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:55.610380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367dbae-05e7-4943-979b-fe3e59bfd89e admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:55.617855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b7c36-bcae-4e8a-b234-e7b435809322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:55.618196 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b7c36-bcae-4e8a-b234-e7b435809322 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:55.618412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b7c36-bcae-4e8a-b234-e7b435809322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:55.618680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b7c36-bcae-4e8a-b234-e7b435809322 admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:55.619388 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b7c36-bcae-4e8a-b234-e7b435809322 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:15:55.619689 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b7c36-bcae-4e8a-b234-e7b435809322 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:55.621344 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b7c36-bcae-4e8a-b234-e7b435809322 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:55.642725 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 781/1574] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:15:55.643694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b7c36-bcae-4e8a-b234-e7b435809322 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:55.656974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b7c36-bcae-4e8a-b234-e7b435809322 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:55.663171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9cfbe-c317-476c-bbce-6397cd02d4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:55.663884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9cfbe-c317-476c-bbce-6397cd02d4f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:55.664218 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9cfbe-c317-476c-bbce-6397cd02d4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:55.664568 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9cfbe-c317-476c-bbce-6397cd02d4f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:55.665214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9cfbe-c317-476c-bbce-6397cd02d4f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:55.667305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9cfbe-c317-476c-bbce-6397cd02d4f7 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:55.678292 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7042a2-c623-4e53-ab0a-bf257c179f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:55.679959 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7042a2-c623-4e53-ab0a-bf257c179f51 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:55.680723 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7042a2-c623-4e53-ab0a-bf257c179f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:55.681302 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7042a2-c623-4e53-ab0a-bf257c179f51 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:55.682808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7042a2-c623-4e53-ab0a-bf257c179f51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:55.686989 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7042a2-c623-4e53-ab0a-bf257c179f51 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:55.721146 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 782/1575] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:15:55 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:15:55.721146 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9cfbe-c317-476c-bbce-6397cd02d4f7 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:55.728348 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 794/1576] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:15:55 2022] POST /identity/v3/users => generated 297 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:15:55.729083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7042a2-c623-4e53-ab0a-bf257c179f51 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:55.740261 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7042a2-c623-4e53-ab0a-bf257c179f51 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:55.798943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9cfbe-c317-476c-bbce-6397cd02d4f7 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:55.804562 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459b4e1-18e8-4142-b5dc-f4b0bf2298b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:55.804895 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459b4e1-18e8-4142-b5dc-f4b0bf2298b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:55.805201 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459b4e1-18e8-4142-b5dc-f4b0bf2298b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:55.805434 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459b4e1-18e8-4142-b5dc-f4b0bf2298b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:55.806095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459b4e1-18e8-4142-b5dc-f4b0bf2298b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:15:55.806399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459b4e1-18e8-4142-b5dc-f4b0bf2298b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:55.808066 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459b4e1-18e8-4142-b5dc-f4b0bf2298b9 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:55.827864 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 783/1577] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:15:55.828347 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459b4e1-18e8-4142-b5dc-f4b0bf2298b9 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:55.832033 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde1990-5ec7-4217-9db2-347ae14d4888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:55.833193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde1990-5ec7-4217-9db2-347ae14d4888 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:55.834307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde1990-5ec7-4217-9db2-347ae14d4888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:55.834456 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde1990-5ec7-4217-9db2-347ae14d4888 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:55.835294 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde1990-5ec7-4217-9db2-347ae14d4888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:55.837724 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde1990-5ec7-4217-9db2-347ae14d4888 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:55.840674 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459b4e1-18e8-4142-b5dc-f4b0bf2298b9 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:55.847031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1687f-2fe6-451e-8f99-8ce0cbc5c875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:55.847770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1687f-2fe6-451e-8f99-8ce0cbc5c875 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:55.848132 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1687f-2fe6-451e-8f99-8ce0cbc5c875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:55.848498 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1687f-2fe6-451e-8f99-8ce0cbc5c875 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:55.849292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1687f-2fe6-451e-8f99-8ce0cbc5c875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:55.851189 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1687f-2fe6-451e-8f99-8ce0cbc5c875 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:55.868088 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 784/1578] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:15:55.868088 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1687f-2fe6-451e-8f99-8ce0cbc5c875 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:55.876577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 795/1579] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:15:55 2022] POST /identity/v3/projects => generated 389 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:15:55.877776 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde1990-5ec7-4217-9db2-347ae14d4888 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:55.884040 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1687f-2fe6-451e-8f99-8ce0cbc5c875 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:55.913001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:15:55.975906 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde1990-5ec7-4217-9db2-347ae14d4888 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:55.981013 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d37265-d2c9-4011-a5f7-54a2a133141c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:55.981803 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d37265-d2c9-4011-a5f7-54a2a133141c admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:55.982104 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d37265-d2c9-4011-a5f7-54a2a133141c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:55.982452 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d37265-d2c9-4011-a5f7-54a2a133141c admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:55.984057 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d37265-d2c9-4011-a5f7-54a2a133141c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:55.986102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d37265-d2c9-4011-a5f7-54a2a133141c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:55.987825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09f671-6d01-4f89-8209-8a4aa8ed2b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:55.989154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09f671-6d01-4f89-8209-8a4aa8ed2b63 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:55.989726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09f671-6d01-4f89-8209-8a4aa8ed2b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:55.990402 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09f671-6d01-4f89-8209-8a4aa8ed2b63 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:55.991694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09f671-6d01-4f89-8209-8a4aa8ed2b63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:55.996972 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09f671-6d01-4f89-8209-8a4aa8ed2b63 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:56.013442 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:15:56.023055 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 796/1580] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:15:55 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:15:56.024441 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d37265-d2c9-4011-a5f7-54a2a133141c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:56.036487 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 785/1581] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:15:55 2022] POST /identity/v3/users => generated 303 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:15:56.038583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09f671-6d01-4f89-8209-8a4aa8ed2b63 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:56.056093 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09f671-6d01-4f89-8209-8a4aa8ed2b63 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:56.132357 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d37265-d2c9-4011-a5f7-54a2a133141c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:56.138857 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe66804-68d4-4e82-b987-f2ac4be65dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:56.140111 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe66804-68d4-4e82-b987-f2ac4be65dec admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.140584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe66804-68d4-4e82-b987-f2ac4be65dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.141051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe66804-68d4-4e82-b987-f2ac4be65dec admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.142100 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe66804-68d4-4e82-b987-f2ac4be65dec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:56.144954 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe66804-68d4-4e82-b987-f2ac4be65dec admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:56.145774 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb2dc5-f931-4825-b5dd-1d8da785346a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:56.147381 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb2dc5-f931-4825-b5dd-1d8da785346a admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.147381 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb2dc5-f931-4825-b5dd-1d8da785346a admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.147764 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb2dc5-f931-4825-b5dd-1d8da785346a admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.148519 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb2dc5-f931-4825-b5dd-1d8da785346a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:56.150324 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb2dc5-f931-4825-b5dd-1d8da785346a admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:56.166042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 786/1582] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:15:56.166042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb2dc5-f931-4825-b5dd-1d8da785346a admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:56.178016 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb2dc5-f931-4825-b5dd-1d8da785346a admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:56.182920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 797/1583] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:15:56 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:15:56.182920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe66804-68d4-4e82-b987-f2ac4be65dec admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:56.187534 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2296c-64c6-4a57-a4c9-41539fc15d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:56.188180 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2296c-64c6-4a57-a4c9-41539fc15d44 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.188459 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2296c-64c6-4a57-a4c9-41539fc15d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.188737 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2296c-64c6-4a57-a4c9-41539fc15d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.189469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2296c-64c6-4a57-a4c9-41539fc15d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:56.191571 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2296c-64c6-4a57-a4c9-41539fc15d44 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:56.198862 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe66804-68d4-4e82-b987-f2ac4be65dec admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:56.204554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b136afa-9c8c-4bc6-8bfe-77803489c796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:56.205907 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b136afa-9c8c-4bc6-8bfe-77803489c796 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.207761 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b136afa-9c8c-4bc6-8bfe-77803489c796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.208100 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b136afa-9c8c-4bc6-8bfe-77803489c796 admin admin] PATH_INFO: `/v3/projects/eb78c1e20a224de69589c22996e16a83/users/92795f97c5e04b32a74aab762332cbea/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.230878 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b136afa-9c8c-4bc6-8bfe-77803489c796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb78c1e20a224de69589c22996e16a83, user_id=92795f97c5e04b32a74aab762332cbea, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:56.232200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: WARNING py.warnings [None req-7b136afa-9c8c-4bc6-8bfe-77803489c796 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:15:56.232200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: warnings.warn(msg) Aug 10 13:15:56.232200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: Aug 10 13:15:56.234355 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b136afa-9c8c-4bc6-8bfe-77803489c796 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:56.240812 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 787/1584] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:15:56 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:15:56.244156 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2296c-64c6-4a57-a4c9-41539fc15d44 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:56.255048 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 798/1585] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:15:56 2022] PUT /identity/v3/projects/eb78c1e20a224de69589c22996e16a83/users/92795f97c5e04b32a74aab762332cbea/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:15:56.255911 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b136afa-9c8c-4bc6-8bfe-77803489c796 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:56.357087 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b136afa-9c8c-4bc6-8bfe-77803489c796 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:56.364963 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2296c-64c6-4a57-a4c9-41539fc15d44 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:56.369246 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e72ca-562c-4a2e-a2c3-15cd8de65c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:56.369806 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e72ca-562c-4a2e-a2c3-15cd8de65c37 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.370083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e72ca-562c-4a2e-a2c3-15cd8de65c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.370353 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e72ca-562c-4a2e-a2c3-15cd8de65c37 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.370987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e72ca-562c-4a2e-a2c3-15cd8de65c37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:56.373278 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e72ca-562c-4a2e-a2c3-15cd8de65c37 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:56.379980 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fe7a2-225d-4853-aaba-fd8225078f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:56.381461 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fe7a2-225d-4853-aaba-fd8225078f2f admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.381874 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fe7a2-225d-4853-aaba-fd8225078f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.382347 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fe7a2-225d-4853-aaba-fd8225078f2f admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.383221 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fe7a2-225d-4853-aaba-fd8225078f2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:56.391495 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fe7a2-225d-4853-aaba-fd8225078f2f admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:56.405541 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 799/1586] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:15:56 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:15:56.406397 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e72ca-562c-4a2e-a2c3-15cd8de65c37 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:56.417773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:15:56.423102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e72ca-562c-4a2e-a2c3-15cd8de65c37 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:56.430007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f828e03-dfae-449a-81b5-fd15df0b1b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:56.430647 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f828e03-dfae-449a-81b5-fd15df0b1b8b admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.430923 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f828e03-dfae-449a-81b5-fd15df0b1b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.431294 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f828e03-dfae-449a-81b5-fd15df0b1b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.431936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f828e03-dfae-449a-81b5-fd15df0b1b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:56.433393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 788/1587] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:15:56 2022] POST /identity/v3/users => generated 295 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:15:56.433552 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f828e03-dfae-449a-81b5-fd15df0b1b8b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:56.434367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fe7a2-225d-4853-aaba-fd8225078f2f admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:56.445891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fe7a2-225d-4853-aaba-fd8225078f2f admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:56.447708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 800/1588] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:15:56.448378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f828e03-dfae-449a-81b5-fd15df0b1b8b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:56.454837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05e213-9f5f-4311-81f3-ff9bc566190c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:56.455749 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05e213-9f5f-4311-81f3-ff9bc566190c admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.456218 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05e213-9f5f-4311-81f3-ff9bc566190c admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.456632 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05e213-9f5f-4311-81f3-ff9bc566190c admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.457447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05e213-9f5f-4311-81f3-ff9bc566190c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:56.459820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05e213-9f5f-4311-81f3-ff9bc566190c admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:56.469622 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f828e03-dfae-449a-81b5-fd15df0b1b8b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:56.474176 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 789/1589] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:15:56.475142 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05e213-9f5f-4311-81f3-ff9bc566190c admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:56.477089 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72c915-0d2b-4262-8e86-e8da6b06434f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:56.478063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72c915-0d2b-4262-8e86-e8da6b06434f admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.478185 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72c915-0d2b-4262-8e86-e8da6b06434f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.478467 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72c915-0d2b-4262-8e86-e8da6b06434f admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.479125 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72c915-0d2b-4262-8e86-e8da6b06434f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:56.481014 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72c915-0d2b-4262-8e86-e8da6b06434f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:56.486571 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05e213-9f5f-4311-81f3-ff9bc566190c admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:56.494825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8279a8-500d-4723-819e-52ccbc605086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:56.495195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 801/1590] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:15:56.496146 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8279a8-500d-4723-819e-52ccbc605086 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.496607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ea57c-3a0d-4d12-a748-54ad4a2c38e4 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.496797 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8279a8-500d-4723-819e-52ccbc605086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.496988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ea57c-3a0d-4d12-a748-54ad4a2c38e4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.497352 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ea57c-3a0d-4d12-a748-54ad4a2c38e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.497529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8279a8-500d-4723-819e-52ccbc605086 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.498773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8279a8-500d-4723-819e-52ccbc605086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:56.501873 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8279a8-500d-4723-819e-52ccbc605086 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:56.520331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-582ea57c-3a0d-4d12-a748-54ad4a2c38e4 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:56.521808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-582ea57c-3a0d-4d12-a748-54ad4a2c38e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:56.529689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 802/1591] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:56.530563 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ea57c-3a0d-4d12-a748-54ad4a2c38e4 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:56.538365 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 790/1592] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:15:56 2022] POST /identity/v3/users => generated 293 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:15:56.540107 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8279a8-500d-4723-819e-52ccbc605086 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:56.541315 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ea57c-3a0d-4d12-a748-54ad4a2c38e4 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:56.546124 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853c634-53d5-4e96-8389-34f690cc5499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:56.546750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853c634-53d5-4e96-8389-34f690cc5499 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.547054 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853c634-53d5-4e96-8389-34f690cc5499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.547326 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853c634-53d5-4e96-8389-34f690cc5499 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.547988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853c634-53d5-4e96-8389-34f690cc5499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:56.549633 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853c634-53d5-4e96-8389-34f690cc5499 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:56.556404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8279a8-500d-4723-819e-52ccbc605086 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:56.562905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 803/1593] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:15:56.563136 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73814d-e92a-4bf6-bc76-ba81da01f6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:56.563623 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73814d-e92a-4bf6-bc76-ba81da01f6ce admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.563792 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853c634-53d5-4e96-8389-34f690cc5499 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:56.563889 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73814d-e92a-4bf6-bc76-ba81da01f6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.564188 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73814d-e92a-4bf6-bc76-ba81da01f6ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.564841 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73814d-e92a-4bf6-bc76-ba81da01f6ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:56.566455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73814d-e92a-4bf6-bc76-ba81da01f6ce admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:56.578439 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 791/1594] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:15:56.579046 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853c634-53d5-4e96-8389-34f690cc5499 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:56.579317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73814d-e92a-4bf6-bc76-ba81da01f6ce admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:56.584839 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764e856-ec0b-4d4d-9ba4-31268c164aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:56.585227 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764e856-ec0b-4d4d-9ba4-31268c164aba admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.585505 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764e856-ec0b-4d4d-9ba4-31268c164aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.585773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764e856-ec0b-4d4d-9ba4-31268c164aba admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.586420 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764e856-ec0b-4d4d-9ba4-31268c164aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:56.588368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764e856-ec0b-4d4d-9ba4-31268c164aba admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:56.590379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73814d-e92a-4bf6-bc76-ba81da01f6ce admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:56.595309 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4092ac-fc0c-4d4d-9ebd-c44429e5b309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:56.595994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4092ac-fc0c-4d4d-9ebd-c44429e5b309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.596271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4092ac-fc0c-4d4d-9ebd-c44429e5b309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.596547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4092ac-fc0c-4d4d-9ebd-c44429e5b309 admin admin] PATH_INFO: `/v3/projects/99760fe295f24443ad0b816bbf69d007/users/c851345eb1c8444e957b1dae85776695/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.601201 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 804/1595] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:15:56.602758 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764e856-ec0b-4d4d-9ba4-31268c164aba admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:56.617499 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764e856-ec0b-4d4d-9ba4-31268c164aba admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:56.619156 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4092ac-fc0c-4d4d-9ebd-c44429e5b309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99760fe295f24443ad0b816bbf69d007, user_id=c851345eb1c8444e957b1dae85776695, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:56.622286 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4092ac-fc0c-4d4d-9ebd-c44429e5b309 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:56.622900 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d72a0-9e29-4deb-885d-49b6bd956cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:56.623645 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d72a0-9e29-4deb-885d-49b6bd956cee admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.623965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d72a0-9e29-4deb-885d-49b6bd956cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.624283 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d72a0-9e29-4deb-885d-49b6bd956cee admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.625037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d72a0-9e29-4deb-885d-49b6bd956cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:56.626387 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:15:56.626919 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d72a0-9e29-4deb-885d-49b6bd956cee admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:56.639153 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 805/1596] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:15:56.640067 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d72a0-9e29-4deb-885d-49b6bd956cee admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:56.648336 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 792/1597] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:15:56 2022] PUT /identity/v3/projects/99760fe295f24443ad0b816bbf69d007/users/c851345eb1c8444e957b1dae85776695/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:15:56.651170 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d72a0-9e29-4deb-885d-49b6bd956cee admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:56.652664 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4092ac-fc0c-4d4d-9ebd-c44429e5b309 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:56.717953 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2346967-050d-4da7-80ff-7fa6639c203c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:56.718706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2346967-050d-4da7-80ff-7fa6639c203c admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.719136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2346967-050d-4da7-80ff-7fa6639c203c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.719477 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2346967-050d-4da7-80ff-7fa6639c203c admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.720133 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2346967-050d-4da7-80ff-7fa6639c203c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:56.721313 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4092ac-fc0c-4d4d-9ebd-c44429e5b309 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:56.721889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2346967-050d-4da7-80ff-7fa6639c203c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:56.725462 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e1296-297e-485e-8447-3a454ef7ef14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:56.726205 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e1296-297e-485e-8447-3a454ef7ef14 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.726586 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e1296-297e-485e-8447-3a454ef7ef14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.726954 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e1296-297e-485e-8447-3a454ef7ef14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.736420 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 806/1598] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:15:56.737888 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2346967-050d-4da7-80ff-7fa6639c203c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:56.741332 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e1296-297e-485e-8447-3a454ef7ef14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:56.744304 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e1296-297e-485e-8447-3a454ef7ef14 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:56.750029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2346967-050d-4da7-80ff-7fa6639c203c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:56.754798 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc6039-bf96-4ea9-885d-6a6c03bae799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:56.755448 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc6039-bf96-4ea9-885d-6a6c03bae799 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.755825 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc6039-bf96-4ea9-885d-6a6c03bae799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.756112 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc6039-bf96-4ea9-885d-6a6c03bae799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.756760 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc6039-bf96-4ea9-885d-6a6c03bae799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:56.758377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc6039-bf96-4ea9-885d-6a6c03bae799 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:56.760170 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 793/1599] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:15:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:15:56.761147 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e1296-297e-485e-8447-3a454ef7ef14 service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:56.772793 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e1296-297e-485e-8447-3a454ef7ef14 service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:56.775251 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 807/1600] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:15:56.776697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc6039-bf96-4ea9-885d-6a6c03bae799 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:56.779885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb53afb-56b8-4e4f-b448-ad0f1b2798a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:56.780768 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb53afb-56b8-4e4f-b448-ad0f1b2798a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.781048 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb53afb-56b8-4e4f-b448-ad0f1b2798a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.781367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb53afb-56b8-4e4f-b448-ad0f1b2798a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.782259 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb53afb-56b8-4e4f-b448-ad0f1b2798a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:56.784361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb53afb-56b8-4e4f-b448-ad0f1b2798a8 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:56.795371 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc6039-bf96-4ea9-885d-6a6c03bae799 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:56.802949 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 794/1601] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:15:56.802949 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb53afb-56b8-4e4f-b448-ad0f1b2798a8 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:56.806480 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9932e23-011f-45b3-b13d-df082754b163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:56.807326 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9932e23-011f-45b3-b13d-df082754b163 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.807690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9932e23-011f-45b3-b13d-df082754b163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.808047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9932e23-011f-45b3-b13d-df082754b163 admin admin] PATH_INFO: `/v3/projects/94b0beb705674032a3b7dc5f34c0b44c/users/56e711e82d1542a4ba429f6d84c9681d/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.817250 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb53afb-56b8-4e4f-b448-ad0f1b2798a8 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:56.824900 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ce889-1e62-4518-bbf9-cd02b2aa48f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:56.825555 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ce889-1e62-4518-bbf9-cd02b2aa48f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.825800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9932e23-011f-45b3-b13d-df082754b163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b0beb705674032a3b7dc5f34c0b44c, user_id=56e711e82d1542a4ba429f6d84c9681d, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:56.825979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ce889-1e62-4518-bbf9-cd02b2aa48f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.826326 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ce889-1e62-4518-bbf9-cd02b2aa48f9 admin admin] PATH_INFO: `/v3/projects/5e671363e00546c38de2ea49386d02e7/users/52113f9d6e2045cca391ee6c7578eb4e/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.828925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9932e23-011f-45b3-b13d-df082754b163 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:56.847900 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ce889-1e62-4518-bbf9-cd02b2aa48f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e671363e00546c38de2ea49386d02e7, user_id=52113f9d6e2045cca391ee6c7578eb4e, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:56.863189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 808/1602] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:15:56 2022] PUT /identity/v3/projects/94b0beb705674032a3b7dc5f34c0b44c/users/56e711e82d1542a4ba429f6d84c9681d/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:15:56.863189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc58da-c500-41c6-8389-37ba58e11f51 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.863189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc58da-c500-41c6-8389-37ba58e11f51 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.863189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc58da-c500-41c6-8389-37ba58e11f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.863694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ce889-1e62-4518-bbf9-cd02b2aa48f9 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:56.880829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 795/1603] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:15:56 2022] PUT /identity/v3/projects/5e671363e00546c38de2ea49386d02e7/users/52113f9d6e2045cca391ee6c7578eb4e/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:15:56.881974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ce889-1e62-4518-bbf9-cd02b2aa48f9 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:56.901666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-acdc58da-c500-41c6-8389-37ba58e11f51 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:56.904361 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-acdc58da-c500-41c6-8389-37ba58e11f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:56.982979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ce889-1e62-4518-bbf9-cd02b2aa48f9 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:56.993316 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ef7b5-85a5-4050-9dd0-0010ef141d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:56.994034 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ef7b5-85a5-4050-9dd0-0010ef141d0d admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:56.994375 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ef7b5-85a5-4050-9dd0-0010ef141d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:56.994818 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ef7b5-85a5-4050-9dd0-0010ef141d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:56.995598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ef7b5-85a5-4050-9dd0-0010ef141d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:56.997308 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ef7b5-85a5-4050-9dd0-0010ef141d0d admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:57.000322 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 809/1604] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:57.001484 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc58da-c500-41c6-8389-37ba58e11f51 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:57.014391 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 796/1605] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:15:57.014391 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ef7b5-85a5-4050-9dd0-0010ef141d0d admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:57.015724 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:15:57.024483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc58da-c500-41c6-8389-37ba58e11f51 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:57.027102 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ef7b5-85a5-4050-9dd0-0010ef141d0d admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:57.034312 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2b781-3ce3-4b99-ab51-5c86fceb417c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:57.034524 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80f9ab-64d9-4ab3-8b0e-cd049f374c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:57.035231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2b781-3ce3-4b99-ab51-5c86fceb417c admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:57.035550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2b781-3ce3-4b99-ab51-5c86fceb417c admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:57.035918 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80f9ab-64d9-4ab3-8b0e-cd049f374c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:57.036002 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2b781-3ce3-4b99-ab51-5c86fceb417c admin admin] PATH_INFO: `/v3/projects/7c70cdaaf35542b9b169414f08b7e11d/users/9c02f3fe4aa64e97b8172369816a9584/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:57.036284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80f9ab-64d9-4ab3-8b0e-cd049f374c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:57.036826 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80f9ab-64d9-4ab3-8b0e-cd049f374c56 admin admin] PATH_INFO: `/v3/projects/c8d1b71ba4814b6da8dd056018684ce1/users/0ed48747fc084496ba252279614be4c2/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:57.061119 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2b781-3ce3-4b99-ab51-5c86fceb417c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c70cdaaf35542b9b169414f08b7e11d, user_id=9c02f3fe4aa64e97b8172369816a9584, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:57.065936 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2b781-3ce3-4b99-ab51-5c86fceb417c admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:57.077117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80f9ab-64d9-4ab3-8b0e-cd049f374c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d1b71ba4814b6da8dd056018684ce1, user_id=0ed48747fc084496ba252279614be4c2, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:57.082463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80f9ab-64d9-4ab3-8b0e-cd049f374c56 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:57.085601 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 797/1606] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:15:57 2022] PUT /identity/v3/projects/7c70cdaaf35542b9b169414f08b7e11d/users/9c02f3fe4aa64e97b8172369816a9584/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:15:57.087653 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f690cfd-0bf7-456a-893c-f99291ed9dd4 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:57.087940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f690cfd-0bf7-456a-893c-f99291ed9dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:57.088888 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f690cfd-0bf7-456a-893c-f99291ed9dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:57.106498 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 810/1607] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:15:57 2022] PUT /identity/v3/projects/c8d1b71ba4814b6da8dd056018684ce1/users/0ed48747fc084496ba252279614be4c2/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:15:57.109653 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca45d4-6ef6-4545-a3ca-b1eb496953e1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:57.110211 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca45d4-6ef6-4545-a3ca-b1eb496953e1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:57.110719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca45d4-6ef6-4545-a3ca-b1eb496953e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:57.126572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-5f690cfd-0bf7-456a-893c-f99291ed9dd4 None None] MFA Rules not processed for user `56e711e82d1542a4ba429f6d84c9681d`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:57.129340 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-5f690cfd-0bf7-456a-893c-f99291ed9dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:57.157317 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-71ca45d4-6ef6-4545-a3ca-b1eb496953e1 None None] MFA Rules not processed for user `52113f9d6e2045cca391ee6c7578eb4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:57.159438 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-71ca45d4-6ef6-4545-a3ca-b1eb496953e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:57.175856 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:15:57.242926 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 811/1608] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:57.244140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca45d4-6ef6-4545-a3ca-b1eb496953e1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:57.250907 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-71ca45d4-6ef6-4545-a3ca-b1eb496953e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:57.266768 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 798/1609] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:57 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:57.267973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f690cfd-0bf7-456a-893c-f99291ed9dd4 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:57.331876 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca45d4-6ef6-4545-a3ca-b1eb496953e1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:57.337286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55eff0-8d7e-4394-a0c2-b0d55e1b5085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:57.338801 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55eff0-8d7e-4394-a0c2-b0d55e1b5085 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:57.339121 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55eff0-8d7e-4394-a0c2-b0d55e1b5085 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:57.339416 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55eff0-8d7e-4394-a0c2-b0d55e1b5085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:57.399566 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f690cfd-0bf7-456a-893c-f99291ed9dd4 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:57.407449 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfda4e-f681-43c4-8686-8a912b8acf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:57.408516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfda4e-f681-43c4-8686-8a912b8acf79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:57.408965 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfda4e-f681-43c4-8686-8a912b8acf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:57.409421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfda4e-f681-43c4-8686-8a912b8acf79 admin admin] PATH_INFO: `/v3/projects/f499182cba594b28892d6e89ed000718/users/52e815a46df84b8497d7ce71d00ea8ff/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:57.431772 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbfda4e-f681-43c4-8686-8a912b8acf79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f499182cba594b28892d6e89ed000718, user_id=52e815a46df84b8497d7ce71d00ea8ff, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:57.435470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbfda4e-f681-43c4-8686-8a912b8acf79 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:57.467791 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 799/1610] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:15:57 2022] PUT /identity/v3/projects/f499182cba594b28892d6e89ed000718/users/52e815a46df84b8497d7ce71d00ea8ff/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:15:57.470238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec1f30-af04-4bb6-97d5-2dc07798169f None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:57.470965 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec1f30-af04-4bb6-97d5-2dc07798169f None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:57.471538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec1f30-af04-4bb6-97d5-2dc07798169f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:57.477580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55eff0-8d7e-4394-a0c2-b0d55e1b5085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:57.481665 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55eff0-8d7e-4394-a0c2-b0d55e1b5085 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:57.504851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 812/1611] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:15:57.507407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27569982-ca26-4b8e-a187-855217448b23 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:57.507973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27569982-ca26-4b8e-a187-855217448b23 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:57.508466 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27569982-ca26-4b8e-a187-855217448b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:57.517978 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-52ec1f30-af04-4bb6-97d5-2dc07798169f None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:57.519712 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-52ec1f30-af04-4bb6-97d5-2dc07798169f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:57.558295 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-27569982-ca26-4b8e-a187-855217448b23 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:57.561784 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-27569982-ca26-4b8e-a187-855217448b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:57.592833 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:15:57.622369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 800/1612] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:57.640968 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec1f30-af04-4bb6-97d5-2dc07798169f None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:57.657760 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec1f30-af04-4bb6-97d5-2dc07798169f None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:57.666700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789d9fb-5bc9-41d4-838e-a9bbc2539a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:57.668010 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789d9fb-5bc9-41d4-838e-a9bbc2539a55 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:57.668701 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789d9fb-5bc9-41d4-838e-a9bbc2539a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:57.669792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789d9fb-5bc9-41d4-838e-a9bbc2539a55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:57.671261 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789d9fb-5bc9-41d4-838e-a9bbc2539a55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:57.675554 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789d9fb-5bc9-41d4-838e-a9bbc2539a55 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:57.693151 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 813/1613] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:57.696074 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd72ccb-8d49-4462-b38f-f314270f3610 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:57.696838 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd72ccb-8d49-4462-b38f-f314270f3610 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:57.697527 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd72ccb-8d49-4462-b38f-f314270f3610 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:57.701432 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 814/1614] 10.222.0.46 () {54 vars in 962 bytes} [Wed Aug 10 13:15:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:15:57.704214 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447cc04-fe0c-4e3f-b7e9-4f4da5f7f617 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:57.704940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447cc04-fe0c-4e3f-b7e9-4f4da5f7f617 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:57.705668 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447cc04-fe0c-4e3f-b7e9-4f4da5f7f617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:57.753507 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 801/1615] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:15:57 2022] POST /identity/v3/projects => generated 405 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:15:57.755990 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789d9fb-5bc9-41d4-838e-a9bbc2539a55 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:57.770304 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e447cc04-fe0c-4e3f-b7e9-4f4da5f7f617 None None] MFA Rules not processed for user `52e815a46df84b8497d7ce71d00ea8ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:57.774995 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e447cc04-fe0c-4e3f-b7e9-4f4da5f7f617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:57.820196 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:15:57.880987 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789d9fb-5bc9-41d4-838e-a9bbc2539a55 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:57.889026 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05348400-c396-4dc5-b9ef-39e9588460d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:57.890201 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05348400-c396-4dc5-b9ef-39e9588460d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:57.891234 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05348400-c396-4dc5-b9ef-39e9588460d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:57.891716 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05348400-c396-4dc5-b9ef-39e9588460d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:57.949687 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 815/1616] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:57.949687 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7ae5b-e3a3-487b-ba73-d0ee1f514d66 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:57.949687 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7ae5b-e3a3-487b-ba73-d0ee1f514d66 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:57.949687 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7ae5b-e3a3-487b-ba73-d0ee1f514d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:58.028741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-88c7ae5b-e3a3-487b-ba73-d0ee1f514d66 None None] MFA Rules not processed for user `7fd0f76f24ea481191dfd65fff2376af`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:58.028741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-88c7ae5b-e3a3-487b-ba73-d0ee1f514d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:58.050250 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05348400-c396-4dc5-b9ef-39e9588460d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:58.052197 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05348400-c396-4dc5-b9ef-39e9588460d3 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:58.076616 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 802/1617] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:15:58.076616 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05348400-c396-4dc5-b9ef-39e9588460d3 service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:58.094081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05348400-c396-4dc5-b9ef-39e9588460d3 service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:58.102232 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c3be9-2fb2-46fe-8bac-a90d434e8283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:58.104766 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c3be9-2fb2-46fe-8bac-a90d434e8283 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:58.105157 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c3be9-2fb2-46fe-8bac-a90d434e8283 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:58.105306 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c3be9-2fb2-46fe-8bac-a90d434e8283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:58.134958 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c3be9-2fb2-46fe-8bac-a90d434e8283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:58.138579 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c3be9-2fb2-46fe-8bac-a90d434e8283 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:58.166132 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 803/1618] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:15:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:15:58.168903 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c3be9-2fb2-46fe-8bac-a90d434e8283 service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:58.185211 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 816/1619] 10.222.0.46 () {58 vars in 1059 bytes} [Wed Aug 10 13:15:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:58.186674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2495e1-3077-476a-91dd-cd7ab75d6d9e None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:58.187050 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2495e1-3077-476a-91dd-cd7ab75d6d9e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:58.187319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2495e1-3077-476a-91dd-cd7ab75d6d9e None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:58.194613 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 817/1620] 10.222.0.46 () {54 vars in 962 bytes} [Wed Aug 10 13:15:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:15:58.195746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2495e1-3077-476a-91dd-cd7ab75d6d9e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:58.201695 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c3be9-2fb2-46fe-8bac-a90d434e8283 service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:58.212712 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2495e1-3077-476a-91dd-cd7ab75d6d9e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:58.214251 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f29bc1-bc41-4576-bb14-06d19364b617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:58.215841 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f29bc1-bc41-4576-bb14-06d19364b617 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:58.216470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f29bc1-bc41-4576-bb14-06d19364b617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:58.217449 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f29bc1-bc41-4576-bb14-06d19364b617 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:58.219476 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f535d2-eb77-4670-98d8-b29469045e10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:58.219720 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f29bc1-bc41-4576-bb14-06d19364b617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:58.220106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f535d2-eb77-4670-98d8-b29469045e10 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:58.220391 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f535d2-eb77-4670-98d8-b29469045e10 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:58.220704 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f535d2-eb77-4670-98d8-b29469045e10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:58.224521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f29bc1-bc41-4576-bb14-06d19364b617 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:58.270669 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:15:58.281587 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 804/1621] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:15:58 2022] POST /identity/v3/users => generated 309 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:15:58.284996 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060bd83-e3e2-4304-bedc-f487fdbe37ee None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:58.286881 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060bd83-e3e2-4304-bedc-f487fdbe37ee None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:58.287332 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060bd83-e3e2-4304-bedc-f487fdbe37ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:58.314513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f535d2-eb77-4670-98d8-b29469045e10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:58.317159 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f535d2-eb77-4670-98d8-b29469045e10 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:58.331586 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 818/1622] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:15:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:15:58.332559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f535d2-eb77-4670-98d8-b29469045e10 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:58.345164 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f535d2-eb77-4670-98d8-b29469045e10 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:58.351819 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc019a-99d6-456c-803a-31c894cdd91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:58.352172 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-8060bd83-e3e2-4304-bedc-f487fdbe37ee None None] MFA Rules not processed for user `7fd0f76f24ea481191dfd65fff2376af`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:58.352470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc019a-99d6-456c-803a-31c894cdd91d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:58.352756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc019a-99d6-456c-803a-31c894cdd91d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:58.353034 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc019a-99d6-456c-803a-31c894cdd91d admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:58.353707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc019a-99d6-456c-803a-31c894cdd91d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:58.355568 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc019a-99d6-456c-803a-31c894cdd91d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:58.359766 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-8060bd83-e3e2-4304-bedc-f487fdbe37ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:58.372896 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 819/1623] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:15:58.375601 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc019a-99d6-456c-803a-31c894cdd91d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:58.389538 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc019a-99d6-456c-803a-31c894cdd91d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:58.395629 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 805/1624] 10.222.0.46 () {58 vars in 1059 bytes} [Wed Aug 10 13:15:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:58.403055 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0b426-35c9-498f-88b2-60a6848da593 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:58.403652 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0b426-35c9-498f-88b2-60a6848da593 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:58.403831 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0b426-35c9-498f-88b2-60a6848da593 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:58.404744 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580b574-94fb-4d72-8398-262aeefef2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:58.405868 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 806/1625] 10.222.0.46 () {54 vars in 912 bytes} [Wed Aug 10 13:15:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:15:58.407072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580b574-94fb-4d72-8398-262aeefef2ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:58.411400 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580b574-94fb-4d72-8398-262aeefef2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:58.411786 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b55043-77f6-40cf-8bf4-802ee340eac5 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:58.412122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b55043-77f6-40cf-8bf4-802ee340eac5 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:58.412498 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b55043-77f6-40cf-8bf4-802ee340eac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:58.418451 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580b574-94fb-4d72-8398-262aeefef2ec admin admin] PATH_INFO: `/v3/projects/506a52383f1642579f9dd5f167b163c2/users/81601d68cacb46c0acc42145a64395ac/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:58.462725 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-74b55043-77f6-40cf-8bf4-802ee340eac5 None None] MFA Rules not processed for user `7fd0f76f24ea481191dfd65fff2376af`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:58.466770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-74b55043-77f6-40cf-8bf4-802ee340eac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:58.491778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580b574-94fb-4d72-8398-262aeefef2ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=506a52383f1642579f9dd5f167b163c2, user_id=81601d68cacb46c0acc42145a64395ac, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:58.502861 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 807/1626] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 10 13:15:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:15:58.507263 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580b574-94fb-4d72-8398-262aeefef2ec admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:58.517831 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b55043-77f6-40cf-8bf4-802ee340eac5 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:58.566260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 820/1627] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:15:58 2022] PUT /identity/v3/projects/506a52383f1642579f9dd5f167b163c2/users/81601d68cacb46c0acc42145a64395ac/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:15:58.577151 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580b574-94fb-4d72-8398-262aeefef2ec admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:58.689115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b55043-77f6-40cf-8bf4-802ee340eac5 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:58.779340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580b574-94fb-4d72-8398-262aeefef2ec admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:58.788814 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2199a-5559-4e80-be82-b95807c18461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:58.790415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2199a-5559-4e80-be82-b95807c18461 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:58.791288 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2199a-5559-4e80-be82-b95807c18461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:58.792325 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2199a-5559-4e80-be82-b95807c18461 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:58.793862 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2199a-5559-4e80-be82-b95807c18461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:58.797529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:15:58.798797 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2199a-5559-4e80-be82-b95807c18461 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:58.809629 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe78de6-be04-4716-ab12-cb6ccd901166 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:58.811295 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe78de6-be04-4716-ab12-cb6ccd901166 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:58.811827 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe78de6-be04-4716-ab12-cb6ccd901166 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:58.812351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe78de6-be04-4716-ab12-cb6ccd901166 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:58.832510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 821/1628] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:15:58.841228 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2199a-5559-4e80-be82-b95807c18461 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:59.090155 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe78de6-be04-4716-ab12-cb6ccd901166 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:59.092891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe78de6-be04-4716-ab12-cb6ccd901166 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:59.111101 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2199a-5559-4e80-be82-b95807c18461 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:59.130207 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41d0cc-3560-4a34-a0c5-7a77f0fbd9fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:59.131321 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41d0cc-3560-4a34-a0c5-7a77f0fbd9fd service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:59.131814 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41d0cc-3560-4a34-a0c5-7a77f0fbd9fd service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:59.132295 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41d0cc-3560-4a34-a0c5-7a77f0fbd9fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:59.137893 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 808/1629] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:15:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:15:59.139250 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe78de6-be04-4716-ab12-cb6ccd901166 service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:59.201735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe78de6-be04-4716-ab12-cb6ccd901166 service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:59.226361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf683a25-7121-4ccd-be93-082734124a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:59.230031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf683a25-7121-4ccd-be93-082734124a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:59.230540 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf683a25-7121-4ccd-be93-082734124a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:59.231057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf683a25-7121-4ccd-be93-082734124a64 admin admin] PATH_INFO: `/v3/projects/506a52383f1642579f9dd5f167b163c2/users/81601d68cacb46c0acc42145a64395ac/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:59.251967 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:15:59.285971 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf683a25-7121-4ccd-be93-082734124a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=506a52383f1642579f9dd5f167b163c2, user_id=81601d68cacb46c0acc42145a64395ac, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:59.291867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf683a25-7121-4ccd-be93-082734124a64 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:59.342135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 809/1630] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:15:59 2022] PUT /identity/v3/projects/506a52383f1642579f9dd5f167b163c2/users/81601d68cacb46c0acc42145a64395ac/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:15:59.353437 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6629de-1dec-4c76-aa1e-7cacdac148d0 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:59.354106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6629de-1dec-4c76-aa1e-7cacdac148d0 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:59.354616 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6629de-1dec-4c76-aa1e-7cacdac148d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:59.373525 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41d0cc-3560-4a34-a0c5-7a77f0fbd9fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:59.376177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41d0cc-3560-4a34-a0c5-7a77f0fbd9fd service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:59.401165 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 822/1631] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:15:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:15:59.446741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-1a6629de-1dec-4c76-aa1e-7cacdac148d0 None None] MFA Rules not processed for user `81601d68cacb46c0acc42145a64395ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:59.449929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-1a6629de-1dec-4c76-aa1e-7cacdac148d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:59.492920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ae7fc-19ab-4c82-a645-23c2cbaf51ae None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:59.493204 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ae7fc-19ab-4c82-a645-23c2cbaf51ae None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:59.493569 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ae7fc-19ab-4c82-a645-23c2cbaf51ae None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:59.495447 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 823/1632] 10.222.0.46 () {54 vars in 912 bytes} [Wed Aug 10 13:15:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:15:59.502524 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a27569-999f-4a29-801f-dfc88e633fe1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:59.502814 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a27569-999f-4a29-801f-dfc88e633fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:59.503130 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a27569-999f-4a29-801f-dfc88e633fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:59.558756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-86a27569-999f-4a29-801f-dfc88e633fe1 None None] MFA Rules not processed for user `7fd0f76f24ea481191dfd65fff2376af`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:15:59.566312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-86a27569-999f-4a29-801f-dfc88e633fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:15:59.701516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 810/1633] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:15:59 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:15:59.711326 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6629de-1dec-4c76-aa1e-7cacdac148d0 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:59.851523 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6629de-1dec-4c76-aa1e-7cacdac148d0 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:15:59.868959 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756e22c-c55f-47c5-81bb-1ff3cbcd2581 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:15:59.868959 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756e22c-c55f-47c5-81bb-1ff3cbcd2581 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:15:59.868959 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756e22c-c55f-47c5-81bb-1ff3cbcd2581 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:15:59.869595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756e22c-c55f-47c5-81bb-1ff3cbcd2581 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:15:59.896951 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756e22c-c55f-47c5-81bb-1ff3cbcd2581 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:15:59.898493 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756e22c-c55f-47c5-81bb-1ff3cbcd2581 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:15:59.906909 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 824/1634] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 10 13:15:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:15:59.923687 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a27569-999f-4a29-801f-dfc88e633fe1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:15:59.935672 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 811/1635] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:15:59 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:00.056016 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756e22c-c55f-47c5-81bb-1ff3cbcd2581 service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:00.062114 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:00.068604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756e22c-c55f-47c5-81bb-1ff3cbcd2581 service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:00.088730 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42bd84-6826-42cd-826b-671fabaceaad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:00.091532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42bd84-6826-42cd-826b-671fabaceaad service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:00.101826 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42bd84-6826-42cd-826b-671fabaceaad service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:00.102303 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42bd84-6826-42cd-826b-671fabaceaad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:00.155622 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42bd84-6826-42cd-826b-671fabaceaad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:00.158576 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42bd84-6826-42cd-826b-671fabaceaad service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:00.166483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a27569-999f-4a29-801f-dfc88e633fe1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:00.174731 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316dbf2-abbe-4901-928b-f45af22709ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:00.175890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316dbf2-abbe-4901-928b-f45af22709ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:00.176450 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316dbf2-abbe-4901-928b-f45af22709ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:00.176920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316dbf2-abbe-4901-928b-f45af22709ab admin admin] PATH_INFO: `/v3/users/52113f9d6e2045cca391ee6c7578eb4e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:00.189264 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 812/1636] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:16:00.193707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316dbf2-abbe-4901-928b-f45af22709ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=52113f9d6e2045cca391ee6c7578eb4e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:00.194789 dv-cinder-836027-5-smb devstack@keystone.service[80296]: WARNING py.warnings [None req-e316dbf2-abbe-4901-928b-f45af22709ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:16:00.194789 dv-cinder-836027-5-smb devstack@keystone.service[80296]: warnings.warn(msg) Aug 10 13:16:00.194789 dv-cinder-836027-5-smb devstack@keystone.service[80296]: Aug 10 13:16:00.196186 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316dbf2-abbe-4901-928b-f45af22709ab admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:00.397728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e316dbf2-abbe-4901-928b-f45af22709ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52113f9d6e2045cca391ee6c7578eb4e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:00.398635 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e316dbf2-abbe-4901-928b-f45af22709ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52113f9d6e2045cca391ee6c7578eb4e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:00.432577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e316dbf2-abbe-4901-928b-f45af22709ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52113f9d6e2045cca391ee6c7578eb4e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:00.440973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:00.459895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e316dbf2-abbe-4901-928b-f45af22709ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52113f9d6e2045cca391ee6c7578eb4e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:00.483306 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42bd84-6826-42cd-826b-671fabaceaad service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:00.505609 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42bd84-6826-42cd-826b-671fabaceaad service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:00.534210 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d35d6-2e96-49d2-baf4-bc5feabea90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:00.540786 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d35d6-2e96-49d2-baf4-bc5feabea90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:00.541194 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d35d6-2e96-49d2-baf4-bc5feabea90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:00.541482 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d35d6-2e96-49d2-baf4-bc5feabea90e admin admin] PATH_INFO: `/v3/users/56e711e82d1542a4ba429f6d84c9681d` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:00.547237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d35d6-2e96-49d2-baf4-bc5feabea90e admin admin] RBAC: Authorizing `identity:delete_user(user_id=56e711e82d1542a4ba429f6d84c9681d)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:00.549268 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d35d6-2e96-49d2-baf4-bc5feabea90e admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:00.563925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e316dbf2-abbe-4901-928b-f45af22709ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52113f9d6e2045cca391ee6c7578eb4e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:00.592707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 825/1637] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:15:59 2022] DELETE /identity/v3/users/52113f9d6e2045cca391ee6c7578eb4e => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:00.597823 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd880d3-34e9-44d6-97cf-79a005af2b43 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:00.598112 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd880d3-34e9-44d6-97cf-79a005af2b43 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:00.602075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd880d3-34e9-44d6-97cf-79a005af2b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:00.684220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4cd880d3-34e9-44d6-97cf-79a005af2b43 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:00.688852 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4cd880d3-34e9-44d6-97cf-79a005af2b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:00.717294 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-fe1d35d6-2e96-49d2-baf4-bc5feabea90e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56e711e82d1542a4ba429f6d84c9681d'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:00.719905 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-fe1d35d6-2e96-49d2-baf4-bc5feabea90e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56e711e82d1542a4ba429f6d84c9681d'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:00.754866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-fe1d35d6-2e96-49d2-baf4-bc5feabea90e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56e711e82d1542a4ba429f6d84c9681d'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:00.788749 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-fe1d35d6-2e96-49d2-baf4-bc5feabea90e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56e711e82d1542a4ba429f6d84c9681d'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:00.844425 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-fe1d35d6-2e96-49d2-baf4-bc5feabea90e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56e711e82d1542a4ba429f6d84c9681d'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:00.870392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 813/1638] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:00 2022] DELETE /identity/v3/users/56e711e82d1542a4ba429f6d84c9681d => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:00.876402 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceef22b-fba3-4a6a-b5d9-a2437a600f26 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:00.876402 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceef22b-fba3-4a6a-b5d9-a2437a600f26 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:00.876697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceef22b-fba3-4a6a-b5d9-a2437a600f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:00.934465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 826/1639] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:00.950906 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-1ceef22b-fba3-4a6a-b5d9-a2437a600f26 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:00.954540 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-1ceef22b-fba3-4a6a-b5d9-a2437a600f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:00.981078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd880d3-34e9-44d6-97cf-79a005af2b43 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:00.985922 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4cd880d3-34e9-44d6-97cf-79a005af2b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:01.354311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd880d3-34e9-44d6-97cf-79a005af2b43 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:01.376291 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 814/1640] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:01.468832 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceef22b-fba3-4a6a-b5d9-a2437a600f26 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:01.470735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-1ceef22b-fba3-4a6a-b5d9-a2437a600f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:01.613738 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131adbfd-e459-4750-9ac5-f18f1c8f4d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:01.617438 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131adbfd-e459-4750-9ac5-f18f1c8f4d79 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:01.617747 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131adbfd-e459-4750-9ac5-f18f1c8f4d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:01.618028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131adbfd-e459-4750-9ac5-f18f1c8f4d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:01.644839 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131adbfd-e459-4750-9ac5-f18f1c8f4d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:01.650211 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131adbfd-e459-4750-9ac5-f18f1c8f4d79 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:01.681992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 827/1641] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 708 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:01.689070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceef22b-fba3-4a6a-b5d9-a2437a600f26 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:01.695818 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e0712-2ad7-4d90-96fe-48e1e24a20d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:01.696466 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e0712-2ad7-4d90-96fe-48e1e24a20d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:01.696750 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e0712-2ad7-4d90-96fe-48e1e24a20d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:01.697024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e0712-2ad7-4d90-96fe-48e1e24a20d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:01.710324 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e0712-2ad7-4d90-96fe-48e1e24a20d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:01.712361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e0712-2ad7-4d90-96fe-48e1e24a20d8 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:01.727547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 815/1642] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:03.633677 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131adbfd-e459-4750-9ac5-f18f1c8f4d79 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:03.635396 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-131adbfd-e459-4750-9ac5-f18f1c8f4d79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:03.686193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131adbfd-e459-4750-9ac5-f18f1c8f4d79 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:03.703482 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c0a94-6471-4342-a2f4-39e7c914e6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:03.704666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c0a94-6471-4342-a2f4-39e7c914e6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:03.705095 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c0a94-6471-4342-a2f4-39e7c914e6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:03.705562 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c0a94-6471-4342-a2f4-39e7c914e6bc admin admin] PATH_INFO: `/v3/projects/94b0beb705674032a3b7dc5f34c0b44c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:03.707389 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c0a94-6471-4342-a2f4-39e7c914e6bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b0beb705674032a3b7dc5f34c0b44c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:03.714337 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c0a94-6471-4342-a2f4-39e7c914e6bc admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:03.857138 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=5,keystone:SELECT=95 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:03.904832 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ae7c0a94-6471-4342-a2f4-39e7c914e6bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b0beb705674032a3b7dc5f34c0b44c', 'request_id': 'req-ae7c0a94-6471-4342-a2f4-39e7c914e6bc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:03.916427 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ae7c0a94-6471-4342-a2f4-39e7c914e6bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b0beb705674032a3b7dc5f34c0b44c', 'request_id': 'req-ae7c0a94-6471-4342-a2f4-39e7c914e6bc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:03.928152 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ae7c0a94-6471-4342-a2f4-39e7c914e6bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b0beb705674032a3b7dc5f34c0b44c', 'request_id': 'req-ae7c0a94-6471-4342-a2f4-39e7c914e6bc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:03.958720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ae7c0a94-6471-4342-a2f4-39e7c914e6bc admin admin] The token cache is being invalidate because project 94b0beb705674032a3b7dc5f34c0b44c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:03.961320 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ae7c0a94-6471-4342-a2f4-39e7c914e6bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:03.963654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ae7c0a94-6471-4342-a2f4-39e7c914e6bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:03.974886 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 828/1643] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:03 2022] DELETE /identity/v3/projects/94b0beb705674032a3b7dc5f34c0b44c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:03.975917 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e0712-2ad7-4d90-96fe-48e1e24a20d8 service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:03.995415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e0712-2ad7-4d90-96fe-48e1e24a20d8 service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:04.009780 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:04.243307 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873da2a4-edd8-4d48-a502-166bbb3e6709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:04.244200 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873da2a4-edd8-4d48-a502-166bbb3e6709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:04.244671 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873da2a4-edd8-4d48-a502-166bbb3e6709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:04.244952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873da2a4-edd8-4d48-a502-166bbb3e6709 admin admin] PATH_INFO: `/v3/users/81601d68cacb46c0acc42145a64395ac` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:04.248640 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873da2a4-edd8-4d48-a502-166bbb3e6709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81601d68cacb46c0acc42145a64395ac)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:04.250630 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873da2a4-edd8-4d48-a502-166bbb3e6709 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:04.385376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-873da2a4-edd8-4d48-a502-166bbb3e6709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81601d68cacb46c0acc42145a64395ac'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:04.387207 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-873da2a4-edd8-4d48-a502-166bbb3e6709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81601d68cacb46c0acc42145a64395ac'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:04.411768 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-873da2a4-edd8-4d48-a502-166bbb3e6709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81601d68cacb46c0acc42145a64395ac'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:04.436930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-873da2a4-edd8-4d48-a502-166bbb3e6709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81601d68cacb46c0acc42145a64395ac'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:04.455062 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c0a94-6471-4342-a2f4-39e7c914e6bc admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:04.456577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ae7c0a94-6471-4342-a2f4-39e7c914e6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:04.489921 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c0a94-6471-4342-a2f4-39e7c914e6bc admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:04.497795 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-873da2a4-edd8-4d48-a502-166bbb3e6709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81601d68cacb46c0acc42145a64395ac'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:04.499221 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df5c91-e9fb-4798-ad5a-0e0a31181d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:04.505377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df5c91-e9fb-4798-ad5a-0e0a31181d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:04.506297 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df5c91-e9fb-4798-ad5a-0e0a31181d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:04.508074 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df5c91-e9fb-4798-ad5a-0e0a31181d38 admin admin] PATH_INFO: `/v3/projects/5e671363e00546c38de2ea49386d02e7` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:04.514366 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df5c91-e9fb-4798-ad5a-0e0a31181d38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e671363e00546c38de2ea49386d02e7)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:04.523341 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 816/1644] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:03 2022] DELETE /identity/v3/users/81601d68cacb46c0acc42145a64395ac => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:16:04.544973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df5c91-e9fb-4798-ad5a-0e0a31181d38 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:04.753306 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-70df5c91-e9fb-4798-ad5a-0e0a31181d38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e671363e00546c38de2ea49386d02e7', 'request_id': 'req-70df5c91-e9fb-4798-ad5a-0e0a31181d38'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:04.774602 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-70df5c91-e9fb-4798-ad5a-0e0a31181d38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e671363e00546c38de2ea49386d02e7', 'request_id': 'req-70df5c91-e9fb-4798-ad5a-0e0a31181d38'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:04.800804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-70df5c91-e9fb-4798-ad5a-0e0a31181d38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e671363e00546c38de2ea49386d02e7', 'request_id': 'req-70df5c91-e9fb-4798-ad5a-0e0a31181d38'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:04.832425 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-70df5c91-e9fb-4798-ad5a-0e0a31181d38 admin admin] The token cache is being invalidate because project 5e671363e00546c38de2ea49386d02e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:04.834036 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-70df5c91-e9fb-4798-ad5a-0e0a31181d38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:04.835960 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-70df5c91-e9fb-4798-ad5a-0e0a31181d38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:04.843638 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 829/1645] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:04 2022] DELETE /identity/v3/projects/5e671363e00546c38de2ea49386d02e7 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:16:04.845851 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0967819-dcf3-454d-88e2-aec807723931 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:04.847963 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0967819-dcf3-454d-88e2-aec807723931 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:04.849158 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0967819-dcf3-454d-88e2-aec807723931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:04.913736 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-c0967819-dcf3-454d-88e2-aec807723931 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:04.916250 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c0967819-dcf3-454d-88e2-aec807723931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:05.112907 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 817/1646] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:05.113886 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08999992-c132-4126-9793-baaac0a96343 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:05.114824 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08999992-c132-4126-9793-baaac0a96343 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:05.115285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08999992-c132-4126-9793-baaac0a96343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:05.170662 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-08999992-c132-4126-9793-baaac0a96343 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:05.177754 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-08999992-c132-4126-9793-baaac0a96343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:05.219795 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 830/1647] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:05.224411 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0967819-dcf3-454d-88e2-aec807723931 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:05.241261 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0967819-dcf3-454d-88e2-aec807723931 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:05.254638 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670f3f0-723f-44b4-9489-9f2f8e070c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:05.257877 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670f3f0-723f-44b4-9489-9f2f8e070c4a admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:05.258199 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670f3f0-723f-44b4-9489-9f2f8e070c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:05.259517 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670f3f0-723f-44b4-9489-9f2f8e070c4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:05.261620 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670f3f0-723f-44b4-9489-9f2f8e070c4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:16:05.261938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670f3f0-723f-44b4-9489-9f2f8e070c4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:05.268723 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670f3f0-723f-44b4-9489-9f2f8e070c4a admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:05.315746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 818/1648] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:16:05.319297 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08999992-c132-4126-9793-baaac0a96343 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:05.345252 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08999992-c132-4126-9793-baaac0a96343 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:05.359851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0cc834-d8fd-40b8-9163-7a623c5b0133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:05.360794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cc834-d8fd-40b8-9163-7a623c5b0133 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:05.361229 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cc834-d8fd-40b8-9163-7a623c5b0133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:05.361596 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cc834-d8fd-40b8-9163-7a623c5b0133 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:05.362340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0cc834-d8fd-40b8-9163-7a623c5b0133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:05.364547 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0cc834-d8fd-40b8-9163-7a623c5b0133 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:05.456621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 831/1649] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:05 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:05.461921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670f3f0-723f-44b4-9489-9f2f8e070c4a admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:05.478169 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670f3f0-723f-44b4-9489-9f2f8e070c4a admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:05.508863 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:05.655091 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e6333-2176-4833-9694-4a9add7dd14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:05.655729 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e6333-2176-4833-9694-4a9add7dd14b admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:05.656007 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e6333-2176-4833-9694-4a9add7dd14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:05.656280 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e6333-2176-4833-9694-4a9add7dd14b admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:05.656999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e6333-2176-4833-9694-4a9add7dd14b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:05.660627 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e6333-2176-4833-9694-4a9add7dd14b admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:05.716939 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 819/1650] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:05 2022] POST /identity/v3/users => generated 283 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:05.722768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0cc834-d8fd-40b8-9163-7a623c5b0133 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:05.743351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0cc834-d8fd-40b8-9163-7a623c5b0133 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:05.764493 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e6ac2-1c96-43b9-b498-ebd09813a32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:05.765220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e6ac2-1c96-43b9-b498-ebd09813a32a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:05.766056 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e6ac2-1c96-43b9-b498-ebd09813a32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:05.766425 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e6ac2-1c96-43b9-b498-ebd09813a32a admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:05.769319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e6ac2-1c96-43b9-b498-ebd09813a32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:05.771848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e6ac2-1c96-43b9-b498-ebd09813a32a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:05.804611 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 832/1651] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:05.810691 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e6333-2176-4833-9694-4a9add7dd14b admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:05.828587 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e6333-2176-4833-9694-4a9add7dd14b admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:05.845183 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0a8f3-97aa-428f-a549-fbf2c4d2b6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:05.845823 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0a8f3-97aa-428f-a549-fbf2c4d2b6ee admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:05.846107 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0a8f3-97aa-428f-a549-fbf2c4d2b6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:05.846383 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0a8f3-97aa-428f-a549-fbf2c4d2b6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:05.847078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0a8f3-97aa-428f-a549-fbf2c4d2b6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:05.850403 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0a8f3-97aa-428f-a549-fbf2c4d2b6ee admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:05.889442 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e6ac2-1c96-43b9-b498-ebd09813a32a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:05.891295 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 820/1652] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:05.908778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e6ac2-1c96-43b9-b498-ebd09813a32a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:05.925993 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a36179-f275-4657-8223-8e845b08f8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:05.927893 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a36179-f275-4657-8223-8e845b08f8d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:05.931465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a36179-f275-4657-8223-8e845b08f8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:05.931990 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a36179-f275-4657-8223-8e845b08f8d7 admin admin] PATH_INFO: `/v3/projects/85c48c8807b0453a84f83259ae57e41b/users/78900ab85fd64cfba7c26ee515cf9df9/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:05.978298 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a36179-f275-4657-8223-8e845b08f8d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c48c8807b0453a84f83259ae57e41b, user_id=78900ab85fd64cfba7c26ee515cf9df9, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:05.981330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a36179-f275-4657-8223-8e845b08f8d7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:06.013699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 833/1653] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:05 2022] PUT /identity/v3/projects/85c48c8807b0453a84f83259ae57e41b/users/78900ab85fd64cfba7c26ee515cf9df9/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:06.030098 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5876f-723b-46b7-9166-608080f64ebb None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:06.030398 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5876f-723b-46b7-9166-608080f64ebb None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:06.031048 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5876f-723b-46b7-9166-608080f64ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:06.086637 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-71b5876f-723b-46b7-9166-608080f64ebb None None] MFA Rules not processed for user `78900ab85fd64cfba7c26ee515cf9df9`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:06.090232 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-71b5876f-723b-46b7-9166-608080f64ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:06.316063 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 821/1654] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:16:06.329834 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a36179-f275-4657-8223-8e845b08f8d7 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:06.418585 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:06.467503 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a36179-f275-4657-8223-8e845b08f8d7 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:06.481449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49ef29-85ef-4bb0-a8a4-50b40aa50f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:06.482954 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49ef29-85ef-4bb0-a8a4-50b40aa50f67 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:06.483484 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49ef29-85ef-4bb0-a8a4-50b40aa50f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:06.484150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49ef29-85ef-4bb0-a8a4-50b40aa50f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:06.485081 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49ef29-85ef-4bb0-a8a4-50b40aa50f67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:06.491039 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49ef29-85ef-4bb0-a8a4-50b40aa50f67 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:06.529364 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5876f-723b-46b7-9166-608080f64ebb None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:06.531177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-71b5876f-723b-46b7-9166-608080f64ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:06.541254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 834/1655] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:06 2022] POST /identity/v3/projects => generated 365 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:06.545911 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49ef29-85ef-4bb0-a8a4-50b40aa50f67 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:06.565184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5876f-723b-46b7-9166-608080f64ebb None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:06.746483 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e3e32-0e03-4bb9-972d-9db393bcb720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:06.747568 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e3e32-0e03-4bb9-972d-9db393bcb720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:06.749446 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e3e32-0e03-4bb9-972d-9db393bcb720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:06.751032 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e3e32-0e03-4bb9-972d-9db393bcb720 admin admin] PATH_INFO: `/v3/projects/506a52383f1642579f9dd5f167b163c2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:06.756147 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e3e32-0e03-4bb9-972d-9db393bcb720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=506a52383f1642579f9dd5f167b163c2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:06.757225 dv-cinder-836027-5-smb devstack@keystone.service[80297]: WARNING py.warnings [None req-977e3e32-0e03-4bb9-972d-9db393bcb720 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 13:16:06.757225 dv-cinder-836027-5-smb devstack@keystone.service[80297]: warnings.warn(msg) Aug 10 13:16:06.757225 dv-cinder-836027-5-smb devstack@keystone.service[80297]: Aug 10 13:16:06.761182 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49ef29-85ef-4bb0-a8a4-50b40aa50f67 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:06.761616 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e3e32-0e03-4bb9-972d-9db393bcb720 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:06.776376 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a30c19-7f91-43a6-b728-a3399c2f3c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:06.779192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a30c19-7f91-43a6-b728-a3399c2f3c51 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:06.779480 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a30c19-7f91-43a6-b728-a3399c2f3c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:06.780081 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a30c19-7f91-43a6-b728-a3399c2f3c51 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:06.782993 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a30c19-7f91-43a6-b728-a3399c2f3c51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:06.787923 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a30c19-7f91-43a6-b728-a3399c2f3c51 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:06.852463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 835/1656] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:06 2022] POST /identity/v3/users => generated 289 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:06.855117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:06.856103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a30c19-7f91-43a6-b728-a3399c2f3c51 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:06.913274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a30c19-7f91-43a6-b728-a3399c2f3c51 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:06.980968 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-977e3e32-0e03-4bb9-972d-9db393bcb720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '506a52383f1642579f9dd5f167b163c2', 'request_id': 'req-977e3e32-0e03-4bb9-972d-9db393bcb720'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:07.005654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-977e3e32-0e03-4bb9-972d-9db393bcb720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '506a52383f1642579f9dd5f167b163c2', 'request_id': 'req-977e3e32-0e03-4bb9-972d-9db393bcb720'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:07.027119 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-977e3e32-0e03-4bb9-972d-9db393bcb720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '506a52383f1642579f9dd5f167b163c2', 'request_id': 'req-977e3e32-0e03-4bb9-972d-9db393bcb720'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:07.072887 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-977e3e32-0e03-4bb9-972d-9db393bcb720 admin admin] The token cache is being invalidate because project 506a52383f1642579f9dd5f167b163c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:07.073521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-977e3e32-0e03-4bb9-972d-9db393bcb720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:07.076952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-977e3e32-0e03-4bb9-972d-9db393bcb720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:07.082150 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 822/1657] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:06 2022] DELETE /identity/v3/projects/506a52383f1642579f9dd5f167b163c2 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:07.089117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b732c-874b-4fc1-97df-1fd706d177be None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:07.089823 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b732c-874b-4fc1-97df-1fd706d177be None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:07.090480 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b732c-874b-4fc1-97df-1fd706d177be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:07.100584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c9f12-00e8-4295-a01e-6646db483b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:07.103923 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c9f12-00e8-4295-a01e-6646db483b1e admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:07.104471 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c9f12-00e8-4295-a01e-6646db483b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:07.105660 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c9f12-00e8-4295-a01e-6646db483b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:07.109349 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c9f12-00e8-4295-a01e-6646db483b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:07.112313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c9f12-00e8-4295-a01e-6646db483b1e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:07.148917 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-054b732c-874b-4fc1-97df-1fd706d177be None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:07.152509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 836/1658] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:07.152652 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-054b732c-874b-4fc1-97df-1fd706d177be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:07.153864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c9f12-00e8-4295-a01e-6646db483b1e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:07.158120 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4e4c9f12-00e8-4295-a01e-6646db483b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:07.169680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 823/1659] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:07.178727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edf2ff-3437-452f-8016-ccecdfa6decb None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:07.179329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edf2ff-3437-452f-8016-ccecdfa6decb None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:07.180362 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edf2ff-3437-452f-8016-ccecdfa6decb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:07.186917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c9f12-00e8-4295-a01e-6646db483b1e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:07.202486 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d1fbf-eaf3-45c1-a253-91c938aafb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:07.203218 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d1fbf-eaf3-45c1-a253-91c938aafb70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:07.203507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d1fbf-eaf3-45c1-a253-91c938aafb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:07.203784 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d1fbf-eaf3-45c1-a253-91c938aafb70 admin admin] PATH_INFO: `/v3/projects/dab58087a95a4a1684bb28f989f5dc26/users/7acbb45e2cc34544b8a0bfc71c715c14/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:07.226935 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-28edf2ff-3437-452f-8016-ccecdfa6decb None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:07.232596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-28edf2ff-3437-452f-8016-ccecdfa6decb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:07.248402 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d1fbf-eaf3-45c1-a253-91c938aafb70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab58087a95a4a1684bb28f989f5dc26, user_id=7acbb45e2cc34544b8a0bfc71c715c14, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:07.251167 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d1fbf-eaf3-45c1-a253-91c938aafb70 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:07.271821 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 824/1660] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:07.275677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edf2ff-3437-452f-8016-ccecdfa6decb None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:07.277926 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 837/1661] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:07 2022] PUT /identity/v3/projects/dab58087a95a4a1684bb28f989f5dc26/users/7acbb45e2cc34544b8a0bfc71c715c14/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:07.282319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d1fbf-eaf3-45c1-a253-91c938aafb70 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:07.307918 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edf2ff-3437-452f-8016-ccecdfa6decb None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:07.327884 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:07.411657 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d1fbf-eaf3-45c1-a253-91c938aafb70 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:07.424663 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bbd82-a959-4714-bdf7-7a543689b623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:07.427772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bbd82-a959-4714-bdf7-7a543689b623 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:07.428316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bbd82-a959-4714-bdf7-7a543689b623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:07.428882 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bbd82-a959-4714-bdf7-7a543689b623 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:07.431351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bbd82-a959-4714-bdf7-7a543689b623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:07.437240 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bbd82-a959-4714-bdf7-7a543689b623 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:07.465971 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 838/1662] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:07.474230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bbd82-a959-4714-bdf7-7a543689b623 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:07.484840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f845b6c-d32f-47dd-a5f6-3eb055916346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:07.498399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f845b6c-d32f-47dd-a5f6-3eb055916346 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:07.498399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f845b6c-d32f-47dd-a5f6-3eb055916346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:07.498673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f845b6c-d32f-47dd-a5f6-3eb055916346 admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:07.499576 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f845b6c-d32f-47dd-a5f6-3eb055916346 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:16:07.499712 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f845b6c-d32f-47dd-a5f6-3eb055916346 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:07.506330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bbd82-a959-4714-bdf7-7a543689b623 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:07.512621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640dd51-b486-41fb-9f87-65e880ed937d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:07.513502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640dd51-b486-41fb-9f87-65e880ed937d admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:07.514078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640dd51-b486-41fb-9f87-65e880ed937d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:07.514772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640dd51-b486-41fb-9f87-65e880ed937d admin admin] PATH_INFO: `/v3/projects/dab58087a95a4a1684bb28f989f5dc26/users/7acbb45e2cc34544b8a0bfc71c715c14/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:07.514899 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f845b6c-d32f-47dd-a5f6-3eb055916346 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:07.543534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640dd51-b486-41fb-9f87-65e880ed937d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab58087a95a4a1684bb28f989f5dc26, user_id=7acbb45e2cc34544b8a0bfc71c715c14, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:07.543748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 825/1663] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:16:07.547561 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f845b6c-d32f-47dd-a5f6-3eb055916346 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:07.552227 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640dd51-b486-41fb-9f87-65e880ed937d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:07.589505 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f845b6c-d32f-47dd-a5f6-3eb055916346 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:07.592819 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 839/1664] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:07 2022] PUT /identity/v3/projects/dab58087a95a4a1684bb28f989f5dc26/users/7acbb45e2cc34544b8a0bfc71c715c14/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:07.607467 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59233b2b-bd4b-4faa-99e3-8168c4e3145b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:07.607688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59233b2b-bd4b-4faa-99e3-8168c4e3145b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:07.608057 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59233b2b-bd4b-4faa-99e3-8168c4e3145b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:07.704852 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-59233b2b-bd4b-4faa-99e3-8168c4e3145b None None] MFA Rules not processed for user `7acbb45e2cc34544b8a0bfc71c715c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:07.706141 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-59233b2b-bd4b-4faa-99e3-8168c4e3145b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:07.778019 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2b6c9-7089-47bd-a35c-e2a037f4d78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:07.778967 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2b6c9-7089-47bd-a35c-e2a037f4d78f admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:07.781569 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2b6c9-7089-47bd-a35c-e2a037f4d78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:07.781569 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2b6c9-7089-47bd-a35c-e2a037f4d78f admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:07.781569 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2b6c9-7089-47bd-a35c-e2a037f4d78f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:07.784200 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2b6c9-7089-47bd-a35c-e2a037f4d78f admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:07.878754 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 826/1665] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:07 2022] POST /identity/v3/projects => generated 363 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:07.880406 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2b6c9-7089-47bd-a35c-e2a037f4d78f admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:07.884803 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-dcb2b6c9-7089-47bd-a35c-e2a037f4d78f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:07.909741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 840/1666] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:16:07.912328 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59233b2b-bd4b-4faa-99e3-8168c4e3145b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:07.933789 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59233b2b-bd4b-4faa-99e3-8168c4e3145b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:07.942583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:08.070938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2b6c9-7089-47bd-a35c-e2a037f4d78f admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:08.074326 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd849a-3e38-4953-9d2f-8924b0352785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:08.075854 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd849a-3e38-4953-9d2f-8924b0352785 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:08.076722 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd849a-3e38-4953-9d2f-8924b0352785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:08.076722 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd849a-3e38-4953-9d2f-8924b0352785 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:08.077603 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd849a-3e38-4953-9d2f-8924b0352785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:08.082088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd849a-3e38-4953-9d2f-8924b0352785 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:08.087214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a953d59-bfcf-409d-804a-f6d65ee26dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:08.088710 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a953d59-bfcf-409d-804a-f6d65ee26dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:08.089283 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a953d59-bfcf-409d-804a-f6d65ee26dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:08.089726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a953d59-bfcf-409d-804a-f6d65ee26dbf admin admin] PATH_INFO: `/v3/users/52e815a46df84b8497d7ce71d00ea8ff` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:08.091726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a953d59-bfcf-409d-804a-f6d65ee26dbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=52e815a46df84b8497d7ce71d00ea8ff)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:08.094799 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a953d59-bfcf-409d-804a-f6d65ee26dbf admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:08.125875 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 841/1667] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:07 2022] POST /identity/v3/users => generated 282 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:08.126387 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd849a-3e38-4953-9d2f-8924b0352785 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:08.129736 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-79cd849a-3e38-4953-9d2f-8924b0352785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:08.197435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:08.217052 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-9a953d59-bfcf-409d-804a-f6d65ee26dbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52e815a46df84b8497d7ce71d00ea8ff'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:08.223218 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-9a953d59-bfcf-409d-804a-f6d65ee26dbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52e815a46df84b8497d7ce71d00ea8ff'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:08.241194 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-9a953d59-bfcf-409d-804a-f6d65ee26dbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52e815a46df84b8497d7ce71d00ea8ff'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:08.267932 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-9a953d59-bfcf-409d-804a-f6d65ee26dbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52e815a46df84b8497d7ce71d00ea8ff'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:08.314597 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-9a953d59-bfcf-409d-804a-f6d65ee26dbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52e815a46df84b8497d7ce71d00ea8ff'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:08.340348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 827/1668] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:07 2022] DELETE /identity/v3/users/52e815a46df84b8497d7ce71d00ea8ff => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:08.341169 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a953d59-bfcf-409d-804a-f6d65ee26dbf admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:08.344001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd849a-3e38-4953-9d2f-8924b0352785 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:08.347411 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-9a953d59-bfcf-409d-804a-f6d65ee26dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:08.487867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b554a0-374b-4188-9114-dfc3c81323df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:08.488521 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b554a0-374b-4188-9114-dfc3c81323df service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:08.488804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b554a0-374b-4188-9114-dfc3c81323df service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:08.489081 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b554a0-374b-4188-9114-dfc3c81323df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:08.496813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-71b554a0-374b-4188-9114-dfc3c81323df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:08.564479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a953d59-bfcf-409d-804a-f6d65ee26dbf admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:08.577102 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ae079-1290-4d0e-b831-32b9f9575efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:08.577810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ae079-1290-4d0e-b831-32b9f9575efd admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:08.578761 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ae079-1290-4d0e-b831-32b9f9575efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:08.579100 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ae079-1290-4d0e-b831-32b9f9575efd admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:08.579798 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ae079-1290-4d0e-b831-32b9f9575efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:08.581570 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ae079-1290-4d0e-b831-32b9f9575efd admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:08.613911 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 828/1669] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:08.615481 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfaafb-61c8-499c-a0b7-8db6ed089cb9 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:08.615769 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfaafb-61c8-499c-a0b7-8db6ed089cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:08.616043 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfaafb-61c8-499c-a0b7-8db6ed089cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:08.668716 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-47dfaafb-61c8-499c-a0b7-8db6ed089cb9 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:08.679859 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-47dfaafb-61c8-499c-a0b7-8db6ed089cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:08.718367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 829/1670] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:08.719363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfaafb-61c8-499c-a0b7-8db6ed089cb9 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:08.741843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b554a0-374b-4188-9114-dfc3c81323df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:08.743982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b554a0-374b-4188-9114-dfc3c81323df service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:08.744496 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfaafb-61c8-499c-a0b7-8db6ed089cb9 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:08.762016 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10282a71-9b22-4c80-b718-94fb04b7515a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:08.763758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10282a71-9b22-4c80-b718-94fb04b7515a admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:08.763758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10282a71-9b22-4c80-b718-94fb04b7515a admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:08.763959 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10282a71-9b22-4c80-b718-94fb04b7515a admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:08.764569 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10282a71-9b22-4c80-b718-94fb04b7515a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:08.766214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10282a71-9b22-4c80-b718-94fb04b7515a admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:08.790686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 830/1671] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:08.797074 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10282a71-9b22-4c80-b718-94fb04b7515a admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:08.799525 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 842/1672] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:08.800721 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b554a0-374b-4188-9114-dfc3c81323df service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:08.810290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-71b554a0-374b-4188-9114-dfc3c81323df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:08.825003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10282a71-9b22-4c80-b718-94fb04b7515a admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:08.841591 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd1ab0-cae7-49a5-88df-456db04751f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:08.842361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd1ab0-cae7-49a5-88df-456db04751f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:08.842645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd1ab0-cae7-49a5-88df-456db04751f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:08.842927 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd1ab0-cae7-49a5-88df-456db04751f7 admin admin] PATH_INFO: `/v3/projects/782117d8be0a446f9632e1eed7f4db04/users/893d9545618f455b88ddaa0bd370932e/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:08.873664 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:08.889703 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd1ab0-cae7-49a5-88df-456db04751f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=782117d8be0a446f9632e1eed7f4db04, user_id=893d9545618f455b88ddaa0bd370932e, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:08.900721 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd1ab0-cae7-49a5-88df-456db04751f7 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:08.951570 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 831/1673] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:08 2022] PUT /identity/v3/projects/782117d8be0a446f9632e1eed7f4db04/users/893d9545618f455b88ddaa0bd370932e/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:08.965966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcd1a3-7a9d-4207-a560-f5c0a9ffda8c None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:08.966690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcd1a3-7a9d-4207-a560-f5c0a9ffda8c None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:08.966995 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcd1a3-7a9d-4207-a560-f5c0a9ffda8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:08.977361 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b554a0-374b-4188-9114-dfc3c81323df service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:09.115840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-fcdcd1a3-7a9d-4207-a560-f5c0a9ffda8c None None] MFA Rules not processed for user `893d9545618f455b88ddaa0bd370932e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:09.118331 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-fcdcd1a3-7a9d-4207-a560-f5c0a9ffda8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:09.197350 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:09.238250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927a0b4-3209-4355-af62-ddadfcf57509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:09.240230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927a0b4-3209-4355-af62-ddadfcf57509 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:09.240644 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927a0b4-3209-4355-af62-ddadfcf57509 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:09.241318 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927a0b4-3209-4355-af62-ddadfcf57509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:09.391040 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 832/1674] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:09.392273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcd1a3-7a9d-4207-a560-f5c0a9ffda8c None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:09.397908 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-fcdcd1a3-7a9d-4207-a560-f5c0a9ffda8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:09.452652 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927a0b4-3209-4355-af62-ddadfcf57509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:09.455967 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927a0b4-3209-4355-af62-ddadfcf57509 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:09.470809 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 843/1675] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:09.477623 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927a0b4-3209-4355-af62-ddadfcf57509 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:09.520879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927a0b4-3209-4355-af62-ddadfcf57509 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:09.536335 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f353eb7-c93f-4199-9a4e-7234b95a9aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:09.537324 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f353eb7-c93f-4199-9a4e-7234b95a9aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:09.538571 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f353eb7-c93f-4199-9a4e-7234b95a9aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:09.540588 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f353eb7-c93f-4199-9a4e-7234b95a9aa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:09.543976 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f353eb7-c93f-4199-9a4e-7234b95a9aa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:09.552124 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f353eb7-c93f-4199-9a4e-7234b95a9aa3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:09.560169 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcd1a3-7a9d-4207-a560-f5c0a9ffda8c None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:09.570541 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefc7b2-1765-4eb9-9678-84839283ea93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:09.571340 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefc7b2-1765-4eb9-9678-84839283ea93 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:09.571727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefc7b2-1765-4eb9-9678-84839283ea93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:09.572105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefc7b2-1765-4eb9-9678-84839283ea93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:09.575557 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-1cefc7b2-1765-4eb9-9678-84839283ea93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:09.644552 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 844/1676] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:09 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:09.646858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f353eb7-c93f-4199-9a4e-7234b95a9aa3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:09.756752 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f353eb7-c93f-4199-9a4e-7234b95a9aa3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:09.761781 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefc7b2-1765-4eb9-9678-84839283ea93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:09.763413 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefc7b2-1765-4eb9-9678-84839283ea93 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:09.766379 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec9013-a099-45b0-884c-854bc9c23720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:09.767247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec9013-a099-45b0-884c-854bc9c23720 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:09.767534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec9013-a099-45b0-884c-854bc9c23720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:09.768439 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec9013-a099-45b0-884c-854bc9c23720 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:09.769100 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec9013-a099-45b0-884c-854bc9c23720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:09.776267 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec9013-a099-45b0-884c-854bc9c23720 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:09.798550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 833/1677] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:09.825153 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 845/1678] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:09 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:09.829208 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefc7b2-1765-4eb9-9678-84839283ea93 service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:09.849775 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefc7b2-1765-4eb9-9678-84839283ea93 service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:09.877643 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18294125-ed4d-46ad-953f-304740dcc15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:09.878457 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18294125-ed4d-46ad-953f-304740dcc15c admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:09.878858 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18294125-ed4d-46ad-953f-304740dcc15c admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:09.879277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18294125-ed4d-46ad-953f-304740dcc15c admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:09.880083 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18294125-ed4d-46ad-953f-304740dcc15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:09.886563 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18294125-ed4d-46ad-953f-304740dcc15c admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:09.915776 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec9013-a099-45b0-884c-854bc9c23720 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:09.929358 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 834/1679] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:16:09.931785 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec9013-a099-45b0-884c-854bc9c23720 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:09.938658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c830215-c15f-4d5e-bd08-1a553c528bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:09.939579 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c830215-c15f-4d5e-bd08-1a553c528bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:09.940024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c830215-c15f-4d5e-bd08-1a553c528bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:09.940691 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c830215-c15f-4d5e-bd08-1a553c528bfb admin admin] PATH_INFO: `/v3/projects/aaed10a2284f49c3a48883e1d9364e94/users/344608c246154ea1bb6c7cdcfd1e841f/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:09.962743 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c830215-c15f-4d5e-bd08-1a553c528bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaed10a2284f49c3a48883e1d9364e94, user_id=344608c246154ea1bb6c7cdcfd1e841f, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:09.966490 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c830215-c15f-4d5e-bd08-1a553c528bfb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:10.002058 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 846/1680] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:09 2022] PUT /identity/v3/projects/aaed10a2284f49c3a48883e1d9364e94/users/344608c246154ea1bb6c7cdcfd1e841f/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:10.006709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18294125-ed4d-46ad-953f-304740dcc15c admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:10.018833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18294125-ed4d-46ad-953f-304740dcc15c admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:10.074279 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:10.128250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c830215-c15f-4d5e-bd08-1a553c528bfb admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:10.130065 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1c830215-c15f-4d5e-bd08-1a553c528bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:10.149740 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcede68-2c53-4c2a-a6c7-163c7c819e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:10.150473 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcede68-2c53-4c2a-a6c7-163c7c819e9f admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:10.150858 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcede68-2c53-4c2a-a6c7-163c7c819e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:10.152761 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcede68-2c53-4c2a-a6c7-163c7c819e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:10.154314 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcede68-2c53-4c2a-a6c7-163c7c819e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:10.156922 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcede68-2c53-4c2a-a6c7-163c7c819e9f admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:10.189116 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 835/1681] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:10.192744 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcede68-2c53-4c2a-a6c7-163c7c819e9f admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:10.219730 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcede68-2c53-4c2a-a6c7-163c7c819e9f admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:10.239306 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244151d-f246-42e0-a025-8069e5f41b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:10.243711 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244151d-f246-42e0-a025-8069e5f41b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:10.244142 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244151d-f246-42e0-a025-8069e5f41b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:10.244538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244151d-f246-42e0-a025-8069e5f41b52 admin admin] PATH_INFO: `/v3/projects/aaed10a2284f49c3a48883e1d9364e94/users/344608c246154ea1bb6c7cdcfd1e841f/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:10.247973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244151d-f246-42e0-a025-8069e5f41b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaed10a2284f49c3a48883e1d9364e94, user_id=344608c246154ea1bb6c7cdcfd1e841f, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:10.256906 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244151d-f246-42e0-a025-8069e5f41b52 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:10.281095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 836/1682] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:10 2022] PUT /identity/v3/projects/aaed10a2284f49c3a48883e1d9364e94/users/344608c246154ea1bb6c7cdcfd1e841f/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:10.292681 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9796a4-d5b3-49a4-9374-2e9679a384f6 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:10.293163 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9796a4-d5b3-49a4-9374-2e9679a384f6 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:10.293458 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9796a4-d5b3-49a4-9374-2e9679a384f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:10.312189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:10.398967 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-2a9796a4-d5b3-49a4-9374-2e9679a384f6 None None] MFA Rules not processed for user `344608c246154ea1bb6c7cdcfd1e841f`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:10.401600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c830215-c15f-4d5e-bd08-1a553c528bfb admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:10.403349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-2a9796a4-d5b3-49a4-9374-2e9679a384f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:10.545667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f27779-a40f-4539-b623-d9f5d3c9418c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:10.546234 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f27779-a40f-4539-b623-d9f5d3c9418c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:10.546515 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f27779-a40f-4539-b623-d9f5d3c9418c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:10.546785 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f27779-a40f-4539-b623-d9f5d3c9418c admin admin] PATH_INFO: `/v3/users/2d1789225c8e457d8d864f22213e7797` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:10.549683 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f27779-a40f-4539-b623-d9f5d3c9418c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d1789225c8e457d8d864f22213e7797)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:10.553201 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f27779-a40f-4539-b623-d9f5d3c9418c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:10.589932 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 837/1683] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:16:10.605373 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9796a4-d5b3-49a4-9374-2e9679a384f6 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:10.662115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c5f27779-a40f-4539-b623-d9f5d3c9418c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d1789225c8e457d8d864f22213e7797'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:10.663113 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c5f27779-a40f-4539-b623-d9f5d3c9418c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d1789225c8e457d8d864f22213e7797'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:10.681959 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c5f27779-a40f-4539-b623-d9f5d3c9418c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d1789225c8e457d8d864f22213e7797'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:10.695432 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c5f27779-a40f-4539-b623-d9f5d3c9418c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d1789225c8e457d8d864f22213e7797'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:10.746825 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c5f27779-a40f-4539-b623-d9f5d3c9418c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d1789225c8e457d8d864f22213e7797'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:10.747505 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9796a4-d5b3-49a4-9374-2e9679a384f6 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:10.762018 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212904fb-d747-4e03-b0c1-f839b44c9c51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:10.763478 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212904fb-d747-4e03-b0c1-f839b44c9c51 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:10.764194 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212904fb-d747-4e03-b0c1-f839b44c9c51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:10.767413 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212904fb-d747-4e03-b0c1-f839b44c9c51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:10.773093 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-212904fb-d747-4e03-b0c1-f839b44c9c51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:10.773372 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 847/1684] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:10 2022] DELETE /identity/v3/users/2d1789225c8e457d8d864f22213e7797 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:10.779143 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48291eef-1643-4065-a800-6395c962b565 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:10.779664 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48291eef-1643-4065-a800-6395c962b565 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:10.782350 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48291eef-1643-4065-a800-6395c962b565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:10.806513 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212904fb-d747-4e03-b0c1-f839b44c9c51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:10.811447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212904fb-d747-4e03-b0c1-f839b44c9c51 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:10.813564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-48291eef-1643-4065-a800-6395c962b565 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:10.815467 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-48291eef-1643-4065-a800-6395c962b565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:10.838937 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 838/1685] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:10.944458 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 848/1686] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:16:10.967470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212904fb-d747-4e03-b0c1-f839b44c9c51 service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:10.970308 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-212904fb-d747-4e03-b0c1-f839b44c9c51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:11.000570 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48291eef-1643-4065-a800-6395c962b565 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:11.002344 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-48291eef-1643-4065-a800-6395c962b565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:11.026738 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:11.039138 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48291eef-1643-4065-a800-6395c962b565 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:11.057546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48710d9f-24c1-48cd-94b1-e5787ef7ac0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:11.058331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48710d9f-24c1-48cd-94b1-e5787ef7ac0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:11.058620 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48710d9f-24c1-48cd-94b1-e5787ef7ac0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:11.058890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48710d9f-24c1-48cd-94b1-e5787ef7ac0a admin admin] PATH_INFO: `/v3/projects/f499182cba594b28892d6e89ed000718` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:11.065265 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48710d9f-24c1-48cd-94b1-e5787ef7ac0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f499182cba594b28892d6e89ed000718)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:11.069651 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48710d9f-24c1-48cd-94b1-e5787ef7ac0a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:11.123565 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:11.187739 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212904fb-d747-4e03-b0c1-f839b44c9c51 service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:11.215031 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-48710d9f-24c1-48cd-94b1-e5787ef7ac0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f499182cba594b28892d6e89ed000718', 'request_id': 'req-48710d9f-24c1-48cd-94b1-e5787ef7ac0a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:11.227734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-48710d9f-24c1-48cd-94b1-e5787ef7ac0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f499182cba594b28892d6e89ed000718', 'request_id': 'req-48710d9f-24c1-48cd-94b1-e5787ef7ac0a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:11.256887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-48710d9f-24c1-48cd-94b1-e5787ef7ac0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f499182cba594b28892d6e89ed000718', 'request_id': 'req-48710d9f-24c1-48cd-94b1-e5787ef7ac0a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:11.330087 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-48710d9f-24c1-48cd-94b1-e5787ef7ac0a admin admin] The token cache is being invalidate because project f499182cba594b28892d6e89ed000718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:11.330388 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-48710d9f-24c1-48cd-94b1-e5787ef7ac0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:11.333788 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-48710d9f-24c1-48cd-94b1-e5787ef7ac0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:11.339054 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 849/1687] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:10 2022] DELETE /identity/v3/projects/f499182cba594b28892d6e89ed000718 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:11.340085 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48710d9f-24c1-48cd-94b1-e5787ef7ac0a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:11.346720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-48710d9f-24c1-48cd-94b1-e5787ef7ac0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:11.357551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa280df1-b055-46a0-8349-8314a8c3b7a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:11.358203 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa280df1-b055-46a0-8349-8314a8c3b7a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:11.358622 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa280df1-b055-46a0-8349-8314a8c3b7a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:11.358771 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa280df1-b055-46a0-8349-8314a8c3b7a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:11.367934 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-aa280df1-b055-46a0-8349-8314a8c3b7a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:11.460712 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa280df1-b055-46a0-8349-8314a8c3b7a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:11.471546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa280df1-b055-46a0-8349-8314a8c3b7a1 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:11.555404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 839/1688] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:11.562816 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567bca6-de0e-4757-bac4-e55c67b69915 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:11.563317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567bca6-de0e-4757-bac4-e55c67b69915 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:11.563823 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567bca6-de0e-4757-bac4-e55c67b69915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:11.655292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-e567bca6-de0e-4757-bac4-e55c67b69915 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:11.657272 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-e567bca6-de0e-4757-bac4-e55c67b69915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:11.702213 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48710d9f-24c1-48cd-94b1-e5787ef7ac0a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:11.730511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446fe55-0fa6-419b-b385-d5d527590b84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:11.731457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446fe55-0fa6-419b-b385-d5d527590b84 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:11.731598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446fe55-0fa6-419b-b385-d5d527590b84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:11.732163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446fe55-0fa6-419b-b385-d5d527590b84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:11.742347 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5446fe55-0fa6-419b-b385-d5d527590b84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:11.959479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 840/1689] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:11.968079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591baa91-714d-4285-995f-69660d3ea47d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:11.968893 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591baa91-714d-4285-995f-69660d3ea47d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:11.969351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591baa91-714d-4285-995f-69660d3ea47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:11.969644 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446fe55-0fa6-419b-b385-d5d527590b84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:11.971506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446fe55-0fa6-419b-b385-d5d527590b84 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:12.006881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 850/1690] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:12.046604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-591baa91-714d-4285-995f-69660d3ea47d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:12.048824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-591baa91-714d-4285-995f-69660d3ea47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:12.073177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 841/1691] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:12.077114 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446fe55-0fa6-419b-b385-d5d527590b84 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:12.116862 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446fe55-0fa6-419b-b385-d5d527590b84 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:12.142680 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9c766-6b50-40be-8404-9f116b498b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:12.145534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9c766-6b50-40be-8404-9f116b498b30 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:12.146467 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9c766-6b50-40be-8404-9f116b498b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:12.149110 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9c766-6b50-40be-8404-9f116b498b30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:12.150005 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9c766-6b50-40be-8404-9f116b498b30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:16:12.150470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9c766-6b50-40be-8404-9f116b498b30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:12.152651 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9c766-6b50-40be-8404-9f116b498b30 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:12.188030 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 851/1692] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:16:12.191946 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591baa91-714d-4285-995f-69660d3ea47d None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:12.217418 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591baa91-714d-4285-995f-69660d3ea47d None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:12.238509 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c1787-b3d5-4700-ba40-818d4d2bef3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:12.239216 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c1787-b3d5-4700-ba40-818d4d2bef3a admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:12.239499 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c1787-b3d5-4700-ba40-818d4d2bef3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:12.239770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c1787-b3d5-4700-ba40-818d4d2bef3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:12.240397 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c1787-b3d5-4700-ba40-818d4d2bef3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:12.242490 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c1787-b3d5-4700-ba40-818d4d2bef3a admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:12.359929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 842/1693] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:12 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:12.361597 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9c766-6b50-40be-8404-9f116b498b30 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:12.382933 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9c766-6b50-40be-8404-9f116b498b30 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:12.473079 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:12.562873 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77056e87-dbc3-4396-b364-e0cb9407c075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:12.567308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77056e87-dbc3-4396-b364-e0cb9407c075 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:12.568164 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77056e87-dbc3-4396-b364-e0cb9407c075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:12.570521 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77056e87-dbc3-4396-b364-e0cb9407c075 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:12.571438 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77056e87-dbc3-4396-b364-e0cb9407c075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:12.574070 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77056e87-dbc3-4396-b364-e0cb9407c075 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:12.615728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 852/1694] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:12 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:12.616403 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c1787-b3d5-4700-ba40-818d4d2bef3a admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:12.645863 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c1787-b3d5-4700-ba40-818d4d2bef3a admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:12.654323 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f1506-36bf-464e-87bc-43451528865b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:12.655657 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f1506-36bf-464e-87bc-43451528865b admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:12.656948 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f1506-36bf-464e-87bc-43451528865b admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:12.657719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f1506-36bf-464e-87bc-43451528865b admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:12.658762 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f1506-36bf-464e-87bc-43451528865b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:12.661118 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f1506-36bf-464e-87bc-43451528865b admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:12.678160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77056e87-dbc3-4396-b364-e0cb9407c075 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:12.684086 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-77056e87-dbc3-4396-b364-e0cb9407c075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:12.698038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 843/1695] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:12.702941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f1506-36bf-464e-87bc-43451528865b admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:12.715107 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77056e87-dbc3-4396-b364-e0cb9407c075 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:12.736259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a92eb-8957-4ebf-8b22-e8e248e33394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:12.738451 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a92eb-8957-4ebf-8b22-e8e248e33394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:12.740918 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f1506-36bf-464e-87bc-43451528865b admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:12.742268 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a92eb-8957-4ebf-8b22-e8e248e33394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:12.742268 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a92eb-8957-4ebf-8b22-e8e248e33394 admin admin] PATH_INFO: `/v3/projects/9183b93af21c49148f141da49d7d74c1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:12.744522 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a92eb-8957-4ebf-8b22-e8e248e33394 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9183b93af21c49148f141da49d7d74c1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:12.747533 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a92eb-8957-4ebf-8b22-e8e248e33394 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:12.757174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbc1b1-07c2-4b44-94c1-0c1bfbbd57e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:12.757993 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbc1b1-07c2-4b44-94c1-0c1bfbbd57e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:12.758422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbc1b1-07c2-4b44-94c1-0c1bfbbd57e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:12.758927 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbc1b1-07c2-4b44-94c1-0c1bfbbd57e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:12.759880 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbc1b1-07c2-4b44-94c1-0c1bfbbd57e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:12.761688 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbc1b1-07c2-4b44-94c1-0c1bfbbd57e8 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:12.775963 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 844/1696] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:12.781614 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbc1b1-07c2-4b44-94c1-0c1bfbbd57e8 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:12.806861 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbc1b1-07c2-4b44-94c1-0c1bfbbd57e8 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:12.824358 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e2823-0e86-4655-bacd-bd4638afb41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:12.825091 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e2823-0e86-4655-bacd-bd4638afb41b admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:12.825482 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e2823-0e86-4655-bacd-bd4638afb41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:12.827094 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e2823-0e86-4655-bacd-bd4638afb41b admin admin] PATH_INFO: `/v3/projects/d9b162bf9add4684834b019011b01d55/users/f9a15cf58d3c458c80c2bb4e0ac7de37/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:12.885209 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e2823-0e86-4655-bacd-bd4638afb41b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b162bf9add4684834b019011b01d55, user_id=f9a15cf58d3c458c80c2bb4e0ac7de37, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:12.888781 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e2823-0e86-4655-bacd-bd4638afb41b admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:12.896765 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a94a92eb-8957-4ebf-8b22-e8e248e33394 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9183b93af21c49148f141da49d7d74c1', 'request_id': 'req-a94a92eb-8957-4ebf-8b22-e8e248e33394'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:12.916122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 845/1697] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:12 2022] PUT /identity/v3/projects/d9b162bf9add4684834b019011b01d55/users/f9a15cf58d3c458c80c2bb4e0ac7de37/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:12.919100 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ced17b-d09d-4dd6-8190-d38048a9c4a2 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:12.922180 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ced17b-d09d-4dd6-8190-d38048a9c4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:12.924023 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ced17b-d09d-4dd6-8190-d38048a9c4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:12.931042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a94a92eb-8957-4ebf-8b22-e8e248e33394 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9183b93af21c49148f141da49d7d74c1', 'request_id': 'req-a94a92eb-8957-4ebf-8b22-e8e248e33394'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:12.943807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a94a92eb-8957-4ebf-8b22-e8e248e33394 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9183b93af21c49148f141da49d7d74c1', 'request_id': 'req-a94a92eb-8957-4ebf-8b22-e8e248e33394'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:12.961602 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a94a92eb-8957-4ebf-8b22-e8e248e33394 admin admin] The token cache is being invalidate because project 9183b93af21c49148f141da49d7d74c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:12.962586 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a94a92eb-8957-4ebf-8b22-e8e248e33394 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:12.964038 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a94a92eb-8957-4ebf-8b22-e8e248e33394 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:12.966914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 853/1698] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:12 2022] DELETE /identity/v3/projects/9183b93af21c49148f141da49d7d74c1 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:12.968517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b5f9c-c574-4659-9ca3-1da8603d3abf None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:12.968868 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b5f9c-c574-4659-9ca3-1da8603d3abf None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:12.969230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b5f9c-c574-4659-9ca3-1da8603d3abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:12.985977 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-75ced17b-d09d-4dd6-8190-d38048a9c4a2 None None] MFA Rules not processed for user `9c02f3fe4aa64e97b8172369816a9584`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:12.987727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-75ced17b-d09d-4dd6-8190-d38048a9c4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:12.998187 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:13.017006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a03b5f9c-c574-4659-9ca3-1da8603d3abf None None] MFA Rules not processed for user `f9a15cf58d3c458c80c2bb4e0ac7de37`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:13.018991 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a03b5f9c-c574-4659-9ca3-1da8603d3abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:13.091478 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 846/1699] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:13.093250 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cee6a-948f-487f-97e0-2a687755d5c4 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:13.093706 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cee6a-948f-487f-97e0-2a687755d5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:13.096086 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cee6a-948f-487f-97e0-2a687755d5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:13.166010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 854/1700] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:13.167241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b5f9c-c574-4659-9ca3-1da8603d3abf None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:13.169409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-109cee6a-948f-487f-97e0-2a687755d5c4 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:13.171952 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a03b5f9c-c574-4659-9ca3-1da8603d3abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:13.173774 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-109cee6a-948f-487f-97e0-2a687755d5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:13.271428 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:13.312767 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 847/1701] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:13.316661 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cee6a-948f-487f-97e0-2a687755d5c4 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:13.322384 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-109cee6a-948f-487f-97e0-2a687755d5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:13.384074 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cee6a-948f-487f-97e0-2a687755d5c4 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:13.398368 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e773b4-f152-4543-b7b0-bdcedd9678a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:13.400006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e773b4-f152-4543-b7b0-bdcedd9678a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:13.400292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e773b4-f152-4543-b7b0-bdcedd9678a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:13.400566 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e773b4-f152-4543-b7b0-bdcedd9678a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:13.401432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e773b4-f152-4543-b7b0-bdcedd9678a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:13.408639 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e773b4-f152-4543-b7b0-bdcedd9678a6 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:13.413756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b5f9c-c574-4659-9ca3-1da8603d3abf None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:13.442783 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a156d-e37c-4f0a-8290-77002ee23229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:13.445868 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a156d-e37c-4f0a-8290-77002ee23229 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:13.446163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a156d-e37c-4f0a-8290-77002ee23229 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:13.446445 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a156d-e37c-4f0a-8290-77002ee23229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:13.469152 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a156d-e37c-4f0a-8290-77002ee23229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:13.472942 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a156d-e37c-4f0a-8290-77002ee23229 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:13.508663 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 848/1702] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:13 2022] POST /identity/v3/projects => generated 387 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:13.516844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939117d2-a351-4595-a22d-5f192eecc2a5 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:13.517138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939117d2-a351-4595-a22d-5f192eecc2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:13.521334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 855/1703] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:13.522286 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939117d2-a351-4595-a22d-5f192eecc2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:13.531691 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a156d-e37c-4f0a-8290-77002ee23229 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:13.564694 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a156d-e37c-4f0a-8290-77002ee23229 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:13.608680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-939117d2-a351-4595-a22d-5f192eecc2a5 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:13.610014 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-939117d2-a351-4595-a22d-5f192eecc2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:13.864709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5f7cd-8163-44ee-9fa1-a170a0df6bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:13.865387 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5f7cd-8163-44ee-9fa1-a170a0df6bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:13.867151 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5f7cd-8163-44ee-9fa1-a170a0df6bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:13.867306 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5f7cd-8163-44ee-9fa1-a170a0df6bf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:13.871066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5f7cd-8163-44ee-9fa1-a170a0df6bf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:13.874474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5f7cd-8163-44ee-9fa1-a170a0df6bf9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:13.910223 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 849/1704] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:13.911192 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939117d2-a351-4595-a22d-5f192eecc2a5 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:13.971463 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939117d2-a351-4595-a22d-5f192eecc2a5 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:13.999264 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07782c2d-dd29-4077-a327-690bb4790165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:14.003405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07782c2d-dd29-4077-a327-690bb4790165 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:14.004914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07782c2d-dd29-4077-a327-690bb4790165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:14.006916 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07782c2d-dd29-4077-a327-690bb4790165 admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:14.009773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 856/1705] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:13 2022] POST /identity/v3/users => generated 300 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:14.010835 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07782c2d-dd29-4077-a327-690bb4790165 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:16:14.014772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5f7cd-8163-44ee-9fa1-a170a0df6bf9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:14.016287 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07782c2d-dd29-4077-a327-690bb4790165 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:14.018126 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07782c2d-dd29-4077-a327-690bb4790165 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:14.041503 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5f7cd-8163-44ee-9fa1-a170a0df6bf9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:14.047319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26e61c-c298-4d76-a1bf-b619ee6a72e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:14.047979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26e61c-c298-4d76-a1bf-b619ee6a72e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:14.048321 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26e61c-c298-4d76-a1bf-b619ee6a72e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:14.048604 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26e61c-c298-4d76-a1bf-b619ee6a72e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:14.049318 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26e61c-c298-4d76-a1bf-b619ee6a72e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:14.051146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26e61c-c298-4d76-a1bf-b619ee6a72e1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:14.078084 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 850/1706] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:16:14.079329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07782c2d-dd29-4077-a327-690bb4790165 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:14.084212 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 857/1707] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:16:14.088530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26e61c-c298-4d76-a1bf-b619ee6a72e1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:14.101278 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26e61c-c298-4d76-a1bf-b619ee6a72e1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:14.107268 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25322758-d64a-490c-a324-9b1418dae2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:14.108207 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25322758-d64a-490c-a324-9b1418dae2b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:14.108750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25322758-d64a-490c-a324-9b1418dae2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:14.109223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25322758-d64a-490c-a324-9b1418dae2b0 admin admin] PATH_INFO: `/v3/projects/5867a5c8301f4288abaf1a44edf9603a/users/3b03e8cacc684716a8397918fb5e0676/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:14.124771 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07782c2d-dd29-4077-a327-690bb4790165 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:14.148942 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25322758-d64a-490c-a324-9b1418dae2b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5867a5c8301f4288abaf1a44edf9603a, user_id=3b03e8cacc684716a8397918fb5e0676, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:14.152403 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96631e4e-6be4-4194-8c3e-499d5140bb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:14.153159 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96631e4e-6be4-4194-8c3e-499d5140bb3b admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:14.153517 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96631e4e-6be4-4194-8c3e-499d5140bb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:14.153858 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96631e4e-6be4-4194-8c3e-499d5140bb3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:14.154577 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96631e4e-6be4-4194-8c3e-499d5140bb3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:14.156639 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96631e4e-6be4-4194-8c3e-499d5140bb3b admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:14.157105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25322758-d64a-490c-a324-9b1418dae2b0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:14.207109 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 858/1708] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:14 2022] PUT /identity/v3/projects/5867a5c8301f4288abaf1a44edf9603a/users/3b03e8cacc684716a8397918fb5e0676/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:14.210828 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25322758-d64a-490c-a324-9b1418dae2b0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:14.252044 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:14.298386 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 851/1709] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:14 2022] POST /identity/v3/projects => generated 381 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:14.299818 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96631e4e-6be4-4194-8c3e-499d5140bb3b admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:14.305543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-96631e4e-6be4-4194-8c3e-499d5140bb3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:14.457252 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25322758-d64a-490c-a324-9b1418dae2b0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:14.505455 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:14.525037 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96631e4e-6be4-4194-8c3e-499d5140bb3b admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:14.550607 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf85367-4381-4455-a18f-f3bed4f6d302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:14.553326 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf85367-4381-4455-a18f-f3bed4f6d302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:14.555032 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf85367-4381-4455-a18f-f3bed4f6d302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:14.555455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf85367-4381-4455-a18f-f3bed4f6d302 admin admin] PATH_INFO: `/v3/users/78900ab85fd64cfba7c26ee515cf9df9` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:14.558140 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf85367-4381-4455-a18f-f3bed4f6d302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78900ab85fd64cfba7c26ee515cf9df9)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:14.565865 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf85367-4381-4455-a18f-f3bed4f6d302 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:14.671111 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11621889-4950-4882-a497-0a82701df572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:14.671111 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11621889-4950-4882-a497-0a82701df572 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:14.671111 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11621889-4950-4882-a497-0a82701df572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:14.672099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11621889-4950-4882-a497-0a82701df572 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:14.672704 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11621889-4950-4882-a497-0a82701df572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:14.678358 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11621889-4950-4882-a497-0a82701df572 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:14.692027 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-edf85367-4381-4455-a18f-f3bed4f6d302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78900ab85fd64cfba7c26ee515cf9df9'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:14.693117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-edf85367-4381-4455-a18f-f3bed4f6d302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78900ab85fd64cfba7c26ee515cf9df9'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:14.705501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 859/1710] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:14.705501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11621889-4950-4882-a497-0a82701df572 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:14.707435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-11621889-4950-4882-a497-0a82701df572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:14.716213 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-edf85367-4381-4455-a18f-f3bed4f6d302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78900ab85fd64cfba7c26ee515cf9df9'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:14.728615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-edf85367-4381-4455-a18f-f3bed4f6d302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78900ab85fd64cfba7c26ee515cf9df9'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:14.745932 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11621889-4950-4882-a497-0a82701df572 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:14.761696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7442349-85c5-4933-a5e1-f94e81147a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:14.762673 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7442349-85c5-4933-a5e1-f94e81147a89 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:14.763428 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-edf85367-4381-4455-a18f-f3bed4f6d302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78900ab85fd64cfba7c26ee515cf9df9'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:14.765124 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7442349-85c5-4933-a5e1-f94e81147a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:14.765434 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7442349-85c5-4933-a5e1-f94e81147a89 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:14.766116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7442349-85c5-4933-a5e1-f94e81147a89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:14.771424 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7442349-85c5-4933-a5e1-f94e81147a89 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:14.781010 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 852/1711] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:14 2022] DELETE /identity/v3/users/78900ab85fd64cfba7c26ee515cf9df9 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:14.782084 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf85367-4381-4455-a18f-f3bed4f6d302 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:14.789496 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-edf85367-4381-4455-a18f-f3bed4f6d302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:14.828142 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 860/1712] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:14 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:14.829734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b30df-9953-4084-a13b-9e42f08adedc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:14.830121 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b30df-9953-4084-a13b-9e42f08adedc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:14.830878 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b30df-9953-4084-a13b-9e42f08adedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:14.877257 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-003b30df-9953-4084-a13b-9e42f08adedc None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:14.883837 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-003b30df-9953-4084-a13b-9e42f08adedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:15.016290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf85367-4381-4455-a18f-f3bed4f6d302 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:15.027133 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d417aa-4e02-4f05-8057-c265898a181f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:15.029191 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d417aa-4e02-4f05-8057-c265898a181f admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:15.029515 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d417aa-4e02-4f05-8057-c265898a181f admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:15.029877 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d417aa-4e02-4f05-8057-c265898a181f admin admin] PATH_INFO: `/v3/projects/5867a5c8301f4288abaf1a44edf9603a/users/3b03e8cacc684716a8397918fb5e0676/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:15.038979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d417aa-4e02-4f05-8057-c265898a181f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5867a5c8301f4288abaf1a44edf9603a, user_id=3b03e8cacc684716a8397918fb5e0676, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:15.045060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d417aa-4e02-4f05-8057-c265898a181f admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:15.074398 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 853/1713] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:14 2022] PUT /identity/v3/projects/5867a5c8301f4288abaf1a44edf9603a/users/3b03e8cacc684716a8397918fb5e0676/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:15.076407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d417aa-4e02-4f05-8057-c265898a181f admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:15.112548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:15.124096 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 861/1714] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:15.124096 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f6e2f-ab62-49b3-bd8c-a00da2c4a248 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:15.124096 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f6e2f-ab62-49b3-bd8c-a00da2c4a248 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:15.124096 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f6e2f-ab62-49b3-bd8c-a00da2c4a248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:15.237868 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-283f6e2f-ab62-49b3-bd8c-a00da2c4a248 None None] MFA Rules not processed for user `3b03e8cacc684716a8397918fb5e0676`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:15.239102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-283f6e2f-ab62-49b3-bd8c-a00da2c4a248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:15.295395 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d417aa-4e02-4f05-8057-c265898a181f admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:15.322386 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae04ba3-3fdb-481f-a27e-1dfb9424e451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:15.323239 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae04ba3-3fdb-481f-a27e-1dfb9424e451 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:15.323525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae04ba3-3fdb-481f-a27e-1dfb9424e451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:15.323802 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae04ba3-3fdb-481f-a27e-1dfb9424e451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:15.324471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae04ba3-3fdb-481f-a27e-1dfb9424e451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:15.331676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae04ba3-3fdb-481f-a27e-1dfb9424e451 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:15.361185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 854/1715] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:15.362964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b41fa8-52fb-4b21-9da9-428e6aedb47a None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:15.367084 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b41fa8-52fb-4b21-9da9-428e6aedb47a None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:15.367490 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b41fa8-52fb-4b21-9da9-428e6aedb47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:15.443685 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-82b41fa8-52fb-4b21-9da9-428e6aedb47a None None] MFA Rules not processed for user `92795f97c5e04b32a74aab762332cbea`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:15.445450 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-82b41fa8-52fb-4b21-9da9-428e6aedb47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:15.514313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 862/1716] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:15.514726 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f6e2f-ab62-49b3-bd8c-a00da2c4a248 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:15.522327 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-283f6e2f-ab62-49b3-bd8c-a00da2c4a248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:15.598151 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:15.672110 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 855/1717] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:15.688809 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b41fa8-52fb-4b21-9da9-428e6aedb47a None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:15.721594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b41fa8-52fb-4b21-9da9-428e6aedb47a None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:15.727977 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fea95-41a0-4c31-9995-b3ca2cf2be1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:15.728853 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f6e2f-ab62-49b3-bd8c-a00da2c4a248 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:15.729800 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fea95-41a0-4c31-9995-b3ca2cf2be1c admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:15.730049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fea95-41a0-4c31-9995-b3ca2cf2be1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:15.730436 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fea95-41a0-4c31-9995-b3ca2cf2be1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:15.731077 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fea95-41a0-4c31-9995-b3ca2cf2be1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:15.732847 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fea95-41a0-4c31-9995-b3ca2cf2be1c admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:15.755428 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd29ec8-5ed2-4530-8fc2-1457f534cb07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:15.756163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd29ec8-5ed2-4530-8fc2-1457f534cb07 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:15.756559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd29ec8-5ed2-4530-8fc2-1457f534cb07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:15.761746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd29ec8-5ed2-4530-8fc2-1457f534cb07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:15.777131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 856/1718] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:15.778429 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fea95-41a0-4c31-9995-b3ca2cf2be1c admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:15.780789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-bc7fea95-41a0-4c31-9995-b3ca2cf2be1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:15.785648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd29ec8-5ed2-4530-8fc2-1457f534cb07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:15.792241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd29ec8-5ed2-4530-8fc2-1457f534cb07 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:15.827994 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 863/1719] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:15.831856 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc228ee-4d4a-47d4-850a-66bf80505e02 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:15.836404 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc228ee-4d4a-47d4-850a-66bf80505e02 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:15.836998 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc228ee-4d4a-47d4-850a-66bf80505e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:15.889878 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-bfc228ee-4d4a-47d4-850a-66bf80505e02 None None] MFA Rules not processed for user `92795f97c5e04b32a74aab762332cbea`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:15.892375 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bfc228ee-4d4a-47d4-850a-66bf80505e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:15.908686 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 864/1720] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:15.909731 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc228ee-4d4a-47d4-850a-66bf80505e02 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:15.958212 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc228ee-4d4a-47d4-850a-66bf80505e02 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:15.975383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29802bf9-7913-42f0-add3-3a84dbb87ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:15.977937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29802bf9-7913-42f0-add3-3a84dbb87ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:15.978372 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29802bf9-7913-42f0-add3-3a84dbb87ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:15.978759 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29802bf9-7913-42f0-add3-3a84dbb87ae5 admin admin] PATH_INFO: `/v3/projects/fe45239343d04525bffe9aa4162e0cce/users/dfe03917ee7f40f8a14cbc738f9aa223/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:16.021556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fea95-41a0-4c31-9995-b3ca2cf2be1c admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:16.034565 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35575e-7786-4f8f-b48b-a54b22f4b533 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:16.035171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35575e-7786-4f8f-b48b-a54b22f4b533 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:16.035457 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35575e-7786-4f8f-b48b-a54b22f4b533 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:16.038266 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35575e-7786-4f8f-b48b-a54b22f4b533 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:16.043357 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29802bf9-7913-42f0-add3-3a84dbb87ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe45239343d04525bffe9aa4162e0cce, user_id=dfe03917ee7f40f8a14cbc738f9aa223, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:16.049136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29802bf9-7913-42f0-add3-3a84dbb87ae5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:16.066269 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35575e-7786-4f8f-b48b-a54b22f4b533 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:16.071613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35575e-7786-4f8f-b48b-a54b22f4b533 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:16.084826 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 865/1721] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:15 2022] PUT /identity/v3/projects/fe45239343d04525bffe9aa4162e0cce/users/dfe03917ee7f40f8a14cbc738f9aa223/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:16.085935 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29802bf9-7913-42f0-add3-3a84dbb87ae5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:16.092579 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-29802bf9-7913-42f0-add3-3a84dbb87ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:16.158702 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 857/1722] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:16.165376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ee556-8879-4a03-b1ee-94b407de3812 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:16.166950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ee556-8879-4a03-b1ee-94b407de3812 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:16.168130 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ee556-8879-4a03-b1ee-94b407de3812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:16.282096 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-811ee556-8879-4a03-b1ee-94b407de3812 None None] MFA Rules not processed for user `dfe03917ee7f40f8a14cbc738f9aa223`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:16.288433 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-811ee556-8879-4a03-b1ee-94b407de3812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:16.314864 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:16.350428 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29802bf9-7913-42f0-add3-3a84dbb87ae5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:16.370222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792fb0c-dbe9-48a7-9b1a-893a47446879 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:16.372699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792fb0c-dbe9-48a7-9b1a-893a47446879 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:16.373588 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792fb0c-dbe9-48a7-9b1a-893a47446879 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:16.375799 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792fb0c-dbe9-48a7-9b1a-893a47446879 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:16.479497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 858/1723] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:16.482154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ee556-8879-4a03-b1ee-94b407de3812 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:16.544649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792fb0c-dbe9-48a7-9b1a-893a47446879 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:16.546495 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792fb0c-dbe9-48a7-9b1a-893a47446879 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:16.591368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 866/1724] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:16.592595 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792fb0c-dbe9-48a7-9b1a-893a47446879 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:16.743924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:16.763486 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ee556-8879-4a03-b1ee-94b407de3812 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:16.789519 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4614a-034e-4759-bf8a-fcb24ee7182b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:16.790226 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4614a-034e-4759-bf8a-fcb24ee7182b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:16.790508 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4614a-034e-4759-bf8a-fcb24ee7182b admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:16.790780 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4614a-034e-4759-bf8a-fcb24ee7182b admin admin] PATH_INFO: `/v3/users/f9a15cf58d3c458c80c2bb4e0ac7de37` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:16.815837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4614a-034e-4759-bf8a-fcb24ee7182b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a15cf58d3c458c80c2bb4e0ac7de37)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:16.831625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4614a-034e-4759-bf8a-fcb24ee7182b admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:16.846907 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792fb0c-dbe9-48a7-9b1a-893a47446879 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:16.872752 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6300d-4cbf-49b2-8f68-12a811e9bf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:16.873754 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6300d-4cbf-49b2-8f68-12a811e9bf5c admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:16.874041 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6300d-4cbf-49b2-8f68-12a811e9bf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:16.874317 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6300d-4cbf-49b2-8f68-12a811e9bf5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:16.875481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6300d-4cbf-49b2-8f68-12a811e9bf5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:16.878216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6300d-4cbf-49b2-8f68-12a811e9bf5c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:16.918497 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 867/1725] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:16 2022] POST /identity/v3/projects => generated 381 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:16.920423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544abc9-93b2-4dda-9396-d20c642fff59 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:16.920852 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544abc9-93b2-4dda-9396-d20c642fff59 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:16.921292 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544abc9-93b2-4dda-9396-d20c642fff59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:16.972905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e544abc9-93b2-4dda-9396-d20c642fff59 None None] MFA Rules not processed for user `c851345eb1c8444e957b1dae85776695`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:16.975134 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e544abc9-93b2-4dda-9396-d20c642fff59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:16.992205 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-91b4614a-034e-4759-bf8a-fcb24ee7182b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a15cf58d3c458c80c2bb4e0ac7de37'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:16.997310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-91b4614a-034e-4759-bf8a-fcb24ee7182b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a15cf58d3c458c80c2bb4e0ac7de37'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:17.016030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-91b4614a-034e-4759-bf8a-fcb24ee7182b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a15cf58d3c458c80c2bb4e0ac7de37'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:17.032457 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-91b4614a-034e-4759-bf8a-fcb24ee7182b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a15cf58d3c458c80c2bb4e0ac7de37'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:17.078182 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-91b4614a-034e-4759-bf8a-fcb24ee7182b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a15cf58d3c458c80c2bb4e0ac7de37'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:17.093087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 859/1726] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:16 2022] DELETE /identity/v3/users/f9a15cf58d3c458c80c2bb4e0ac7de37 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:17.093974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4614a-034e-4759-bf8a-fcb24ee7182b admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:17.103691 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-91b4614a-034e-4759-bf8a-fcb24ee7182b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:17.152781 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 868/1727] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:17.152781 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7c751-119a-423f-9ed0-e3590fc20365 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:17.152781 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7c751-119a-423f-9ed0-e3590fc20365 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:17.152781 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7c751-119a-423f-9ed0-e3590fc20365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:17.199650 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-dff7c751-119a-423f-9ed0-e3590fc20365 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:17.204513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dff7c751-119a-423f-9ed0-e3590fc20365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:17.205657 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:17.327072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4614a-034e-4759-bf8a-fcb24ee7182b admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:17.340427 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dca40e-1479-499c-aab0-fda85d2167fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:17.340981 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dca40e-1479-499c-aab0-fda85d2167fa admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:17.342184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dca40e-1479-499c-aab0-fda85d2167fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:17.342482 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dca40e-1479-499c-aab0-fda85d2167fa admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:17.344860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dca40e-1479-499c-aab0-fda85d2167fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:17.353389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dca40e-1479-499c-aab0-fda85d2167fa admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:17.408320 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 860/1728] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:17 2022] POST /identity/v3/users => generated 297 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:17.408419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 869/1729] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:17.408868 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf669ab-b496-44f1-9ff9-80fd58535337 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:17.408868 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf669ab-b496-44f1-9ff9-80fd58535337 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:17.408868 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf669ab-b496-44f1-9ff9-80fd58535337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:17.414827 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7c751-119a-423f-9ed0-e3590fc20365 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:17.450731 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7c751-119a-423f-9ed0-e3590fc20365 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:17.458582 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-dcf669ab-b496-44f1-9ff9-80fd58535337 None None] MFA Rules not processed for user `c851345eb1c8444e957b1dae85776695`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:17.468111 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a5a33-fdc7-4815-a861-94061977b28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:17.468400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-dcf669ab-b496-44f1-9ff9-80fd58535337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:17.470057 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a5a33-fdc7-4815-a861-94061977b28d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:17.472124 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a5a33-fdc7-4815-a861-94061977b28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:17.472419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a5a33-fdc7-4815-a861-94061977b28d admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:17.473651 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a5a33-fdc7-4815-a861-94061977b28d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:17.477798 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a5a33-fdc7-4815-a861-94061977b28d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:17.521047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 870/1730] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:17.522066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a5a33-fdc7-4815-a861-94061977b28d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:17.531904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9f0a5a33-fdc7-4815-a861-94061977b28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:17.639623 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 861/1731] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:17.640588 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf669ab-b496-44f1-9ff9-80fd58535337 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:17.663399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf669ab-b496-44f1-9ff9-80fd58535337 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:17.675754 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:17.685142 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943f706-22b6-44c2-bba8-8a3cc0f1f384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:17.688708 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943f706-22b6-44c2-bba8-8a3cc0f1f384 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:17.690629 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943f706-22b6-44c2-bba8-8a3cc0f1f384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:17.691141 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943f706-22b6-44c2-bba8-8a3cc0f1f384 admin admin] PATH_INFO: `/v3/projects/1ad907617df942b9bd33f9dbc30aca65/users/91aa913c5a2148ad955d00c498fb4020/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:17.729526 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a5a33-fdc7-4815-a861-94061977b28d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:17.734957 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04311e-65c2-46c0-8909-c99401b04f19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:17.735656 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04311e-65c2-46c0-8909-c99401b04f19 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:17.735983 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04311e-65c2-46c0-8909-c99401b04f19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:17.736477 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04311e-65c2-46c0-8909-c99401b04f19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:17.749046 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04311e-65c2-46c0-8909-c99401b04f19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:17.750836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943f706-22b6-44c2-bba8-8a3cc0f1f384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ad907617df942b9bd33f9dbc30aca65, user_id=91aa913c5a2148ad955d00c498fb4020, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:17.751197 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04311e-65c2-46c0-8909-c99401b04f19 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:17.767142 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943f706-22b6-44c2-bba8-8a3cc0f1f384 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:17.781882 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 871/1732] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:17.782554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04311e-65c2-46c0-8909-c99401b04f19 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:17.785875 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3b04311e-65c2-46c0-8909-c99401b04f19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:17.817692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 862/1733] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:17 2022] PUT /identity/v3/projects/1ad907617df942b9bd33f9dbc30aca65/users/91aa913c5a2148ad955d00c498fb4020/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:17.818685 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943f706-22b6-44c2-bba8-8a3cc0f1f384 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:17.824539 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-f943f706-22b6-44c2-bba8-8a3cc0f1f384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:18.011254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04311e-65c2-46c0-8909-c99401b04f19 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:18.044459 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943f706-22b6-44c2-bba8-8a3cc0f1f384 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:18.063832 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14dcc7-17da-4914-8194-90f785f4e8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:18.064511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14dcc7-17da-4914-8194-90f785f4e8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:18.064792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14dcc7-17da-4914-8194-90f785f4e8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:18.065066 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14dcc7-17da-4914-8194-90f785f4e8bc admin admin] PATH_INFO: `/v3/projects/85c48c8807b0453a84f83259ae57e41b` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:18.068238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14dcc7-17da-4914-8194-90f785f4e8bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=85c48c8807b0453a84f83259ae57e41b)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:18.069574 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14dcc7-17da-4914-8194-90f785f4e8bc admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:18.165135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:18.177428 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f4427-0b0a-47d9-94aa-336da2e8a1b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:18.178133 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f4427-0b0a-47d9-94aa-336da2e8a1b9 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:18.178442 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f4427-0b0a-47d9-94aa-336da2e8a1b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:18.179265 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f4427-0b0a-47d9-94aa-336da2e8a1b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:18.179425 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-0b14dcc7-17da-4914-8194-90f785f4e8bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85c48c8807b0453a84f83259ae57e41b', 'request_id': 'req-0b14dcc7-17da-4914-8194-90f785f4e8bc'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:18.186052 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-0b14dcc7-17da-4914-8194-90f785f4e8bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85c48c8807b0453a84f83259ae57e41b', 'request_id': 'req-0b14dcc7-17da-4914-8194-90f785f4e8bc'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:18.210531 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-0b14dcc7-17da-4914-8194-90f785f4e8bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85c48c8807b0453a84f83259ae57e41b', 'request_id': 'req-0b14dcc7-17da-4914-8194-90f785f4e8bc'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:18.234959 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-0b14dcc7-17da-4914-8194-90f785f4e8bc admin admin] The token cache is being invalidate because project 85c48c8807b0453a84f83259ae57e41b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:18.235941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-0b14dcc7-17da-4914-8194-90f785f4e8bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:18.236120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-0b14dcc7-17da-4914-8194-90f785f4e8bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:18.237983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 863/1734] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:17 2022] DELETE /identity/v3/projects/85c48c8807b0453a84f83259ae57e41b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:18.239498 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14dcc7-17da-4914-8194-90f785f4e8bc admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:18.240877 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-0b14dcc7-17da-4914-8194-90f785f4e8bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:18.327369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f4427-0b0a-47d9-94aa-336da2e8a1b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:18.330030 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f4427-0b0a-47d9-94aa-336da2e8a1b9 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:18.341886 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 872/1735] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:17 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:18.344080 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf7a1a-e41b-496c-b56d-33e2e945208c None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:18.344522 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf7a1a-e41b-496c-b56d-33e2e945208c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:18.344807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf7a1a-e41b-496c-b56d-33e2e945208c None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:18.346735 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 873/1736] 10.222.0.46 () {54 vars in 912 bytes} [Wed Aug 10 13:16:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:16:18.347739 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf7a1a-e41b-496c-b56d-33e2e945208c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:18.350042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cbaf7a1a-e41b-496c-b56d-33e2e945208c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:18.377094 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:18.398200 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14dcc7-17da-4914-8194-90f785f4e8bc admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:18.412957 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9c339-e73f-4125-9877-8cb9320ff6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:18.413844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9c339-e73f-4125-9877-8cb9320ff6fb admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:18.414291 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9c339-e73f-4125-9877-8cb9320ff6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:18.414708 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9c339-e73f-4125-9877-8cb9320ff6fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:18.415572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9c339-e73f-4125-9877-8cb9320ff6fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:18.417388 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9c339-e73f-4125-9877-8cb9320ff6fb admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:18.442395 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 864/1737] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:18.443979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a138c4-ccb6-48e0-bdf9-dfb456793b3e None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:18.444441 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a138c4-ccb6-48e0-bdf9-dfb456793b3e None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:18.444946 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a138c4-ccb6-48e0-bdf9-dfb456793b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:18.473403 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf7a1a-e41b-496c-b56d-33e2e945208c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:18.490819 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ed2b5-7b3e-4b63-874f-fb0864e43993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:18.492796 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ed2b5-7b3e-4b63-874f-fb0864e43993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:18.493769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ed2b5-7b3e-4b63-874f-fb0864e43993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:18.495217 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ed2b5-7b3e-4b63-874f-fb0864e43993 admin admin] PATH_INFO: `/v3/users/7acbb45e2cc34544b8a0bfc71c715c14` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:18.499244 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ed2b5-7b3e-4b63-874f-fb0864e43993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7acbb45e2cc34544b8a0bfc71c715c14)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:18.505430 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ed2b5-7b3e-4b63-874f-fb0864e43993 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:18.539255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-c4a138c4-ccb6-48e0-bdf9-dfb456793b3e None None] MFA Rules not processed for user `49b69dad00934ce78cbede99f976439f`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:18.540337 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c4a138c4-ccb6-48e0-bdf9-dfb456793b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:18.637879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-425ed2b5-7b3e-4b63-874f-fb0864e43993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7acbb45e2cc34544b8a0bfc71c715c14'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:18.639973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-425ed2b5-7b3e-4b63-874f-fb0864e43993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7acbb45e2cc34544b8a0bfc71c715c14'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:18.657040 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-425ed2b5-7b3e-4b63-874f-fb0864e43993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7acbb45e2cc34544b8a0bfc71c715c14'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:18.668095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 865/1738] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 10 13:16:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:18.673221 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-425ed2b5-7b3e-4b63-874f-fb0864e43993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7acbb45e2cc34544b8a0bfc71c715c14'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:18.675667 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a138c4-ccb6-48e0-bdf9-dfb456793b3e None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:18.679904 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c4a138c4-ccb6-48e0-bdf9-dfb456793b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:18.697040 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-425ed2b5-7b3e-4b63-874f-fb0864e43993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7acbb45e2cc34544b8a0bfc71c715c14'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:18.708664 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a138c4-ccb6-48e0-bdf9-dfb456793b3e None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:18.708892 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 874/1739] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:18 2022] DELETE /identity/v3/users/7acbb45e2cc34544b8a0bfc71c715c14 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:18.717775 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ed2b5-7b3e-4b63-874f-fb0864e43993 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:18.719470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-425ed2b5-7b3e-4b63-874f-fb0864e43993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:18.829783 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52a0da-26ee-42c0-80c5-3eb42c9233dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:18.830460 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52a0da-26ee-42c0-80c5-3eb42c9233dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:18.830912 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52a0da-26ee-42c0-80c5-3eb42c9233dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:18.831483 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52a0da-26ee-42c0-80c5-3eb42c9233dd admin admin] PATH_INFO: `/v3/projects/1ad907617df942b9bd33f9dbc30aca65/users/91aa913c5a2148ad955d00c498fb4020/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:18.835833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52a0da-26ee-42c0-80c5-3eb42c9233dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ad907617df942b9bd33f9dbc30aca65, user_id=91aa913c5a2148ad955d00c498fb4020, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:18.842509 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52a0da-26ee-42c0-80c5-3eb42c9233dd admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:18.858599 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:18.866526 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ed2b5-7b3e-4b63-874f-fb0864e43993 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:18.885201 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 866/1740] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:18 2022] PUT /identity/v3/projects/1ad907617df942b9bd33f9dbc30aca65/users/91aa913c5a2148ad955d00c498fb4020/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:18.888016 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fa68f-68de-4cf2-8ba8-c90437108a6b None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:18.888377 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fa68f-68de-4cf2-8ba8-c90437108a6b None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:18.888675 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fa68f-68de-4cf2-8ba8-c90437108a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:18.946225 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-1b0fa68f-68de-4cf2-8ba8-c90437108a6b None None] MFA Rules not processed for user `91aa913c5a2148ad955d00c498fb4020`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:18.949157 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-1b0fa68f-68de-4cf2-8ba8-c90437108a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:18.987333 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:18.997401 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78faa1b-5105-4a69-8c7b-f59a5572220b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:18.998500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78faa1b-5105-4a69-8c7b-f59a5572220b service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:18.998500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78faa1b-5105-4a69-8c7b-f59a5572220b service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:18.998680 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78faa1b-5105-4a69-8c7b-f59a5572220b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:19.019435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78faa1b-5105-4a69-8c7b-f59a5572220b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:19.023938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78faa1b-5105-4a69-8c7b-f59a5572220b service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:19.052895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 875/1741] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:16:19.130141 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa04ab-0d07-4912-9e14-5d73dd354fa6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:19.130759 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa04ab-0d07-4912-9e14-5d73dd354fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:19.131591 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa04ab-0d07-4912-9e14-5d73dd354fa6 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:19.134883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 876/1742] 10.222.0.46 () {54 vars in 912 bytes} [Wed Aug 10 13:16:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:16:19.145562 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 867/1743] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:19.147987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a36f8-aca8-4f50-bf23-154b6d8012e2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:19.148270 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a36f8-aca8-4f50-bf23-154b6d8012e2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:19.148543 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a36f8-aca8-4f50-bf23-154b6d8012e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:19.160928 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fa68f-68de-4cf2-8ba8-c90437108a6b None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:19.163775 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-1b0fa68f-68de-4cf2-8ba8-c90437108a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:19.209100 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-789a36f8-aca8-4f50-bf23-154b6d8012e2 None None] MFA Rules not processed for user `49b69dad00934ce78cbede99f976439f`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:19.210362 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-789a36f8-aca8-4f50-bf23-154b6d8012e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:19.228424 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 877/1744] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 10 13:16:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 10 13:16:19.255933 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a36f8-aca8-4f50-bf23-154b6d8012e2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:19.257367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-789a36f8-aca8-4f50-bf23-154b6d8012e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:19.276051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a36f8-aca8-4f50-bf23-154b6d8012e2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:19.288319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e7773-6e8b-4841-8904-9341408c4440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:19.288947 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e7773-6e8b-4841-8904-9341408c4440 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:19.289229 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e7773-6e8b-4841-8904-9341408c4440 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:19.289503 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e7773-6e8b-4841-8904-9341408c4440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:19.305005 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e7773-6e8b-4841-8904-9341408c4440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:19.305893 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e7773-6e8b-4841-8904-9341408c4440 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:19.324246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fa68f-68de-4cf2-8ba8-c90437108a6b None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:19.325146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 878/1745] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:19.328886 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb0b4b-162e-4127-841a-ac677ec8f6f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:19.329547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb0b4b-162e-4127-841a-ac677ec8f6f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:19.329882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb0b4b-162e-4127-841a-ac677ec8f6f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:19.330219 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb0b4b-162e-4127-841a-ac677ec8f6f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:19.342551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb0b4b-162e-4127-841a-ac677ec8f6f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:19.344375 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb0b4b-162e-4127-841a-ac677ec8f6f2 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:19.364021 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 868/1746] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:19.563827 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e7773-6e8b-4841-8904-9341408c4440 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:19.565039 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7e6e7773-6e8b-4841-8904-9341408c4440 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:19.605199 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e7773-6e8b-4841-8904-9341408c4440 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:19.620155 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3010eb-e3c4-4aab-ac52-77ee30e73ff2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:19.621769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3010eb-e3c4-4aab-ac52-77ee30e73ff2 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:19.622857 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3010eb-e3c4-4aab-ac52-77ee30e73ff2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:19.623438 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3010eb-e3c4-4aab-ac52-77ee30e73ff2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:19.625786 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ad3010eb-e3c4-4aab-ac52-77ee30e73ff2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:19.668426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb0b4b-162e-4127-841a-ac677ec8f6f2 service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:19.670877 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-0cbb0b4b-162e-4127-841a-ac677ec8f6f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:19.737021 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3010eb-e3c4-4aab-ac52-77ee30e73ff2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:19.742514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3010eb-e3c4-4aab-ac52-77ee30e73ff2 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:19.786517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 879/1747] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:19.788096 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3010eb-e3c4-4aab-ac52-77ee30e73ff2 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:19.791122 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ad3010eb-e3c4-4aab-ac52-77ee30e73ff2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:19.882339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb0b4b-162e-4127-841a-ac677ec8f6f2 service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:19.899677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1edff6-a1c2-4bc6-b3c4-0bb2879bb1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:19.901035 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1edff6-a1c2-4bc6-b3c4-0bb2879bb1bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:19.901744 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1edff6-a1c2-4bc6-b3c4-0bb2879bb1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:19.902219 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1edff6-a1c2-4bc6-b3c4-0bb2879bb1bb admin admin] PATH_INFO: `/v3/projects/d9b162bf9add4684834b019011b01d55` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:19.905070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1edff6-a1c2-4bc6-b3c4-0bb2879bb1bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9b162bf9add4684834b019011b01d55)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:19.916107 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1edff6-a1c2-4bc6-b3c4-0bb2879bb1bb admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:20.070115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:20.081592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3010eb-e3c4-4aab-ac52-77ee30e73ff2 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:20.131930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7b1edff6-a1c2-4bc6-b3c4-0bb2879bb1bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9b162bf9add4684834b019011b01d55', 'request_id': 'req-7b1edff6-a1c2-4bc6-b3c4-0bb2879bb1bb'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:20.152757 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7b1edff6-a1c2-4bc6-b3c4-0bb2879bb1bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9b162bf9add4684834b019011b01d55', 'request_id': 'req-7b1edff6-a1c2-4bc6-b3c4-0bb2879bb1bb'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:20.167738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7b1edff6-a1c2-4bc6-b3c4-0bb2879bb1bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9b162bf9add4684834b019011b01d55', 'request_id': 'req-7b1edff6-a1c2-4bc6-b3c4-0bb2879bb1bb'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:20.207873 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7b1edff6-a1c2-4bc6-b3c4-0bb2879bb1bb admin admin] The token cache is being invalidate because project d9b162bf9add4684834b019011b01d55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:20.208256 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7b1edff6-a1c2-4bc6-b3c4-0bb2879bb1bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:20.215095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7b1edff6-a1c2-4bc6-b3c4-0bb2879bb1bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:20.220787 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 869/1748] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:19 2022] DELETE /identity/v3/projects/d9b162bf9add4684834b019011b01d55 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:20.224959 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1edff6-a1c2-4bc6-b3c4-0bb2879bb1bb admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:20.226480 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7b1edff6-a1c2-4bc6-b3c4-0bb2879bb1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:20.273528 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986d15f-1823-4b03-961e-16587b2a530c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:20.274517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986d15f-1823-4b03-961e-16587b2a530c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:20.274517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986d15f-1823-4b03-961e-16587b2a530c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:20.274824 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986d15f-1823-4b03-961e-16587b2a530c admin admin] PATH_INFO: `/v3/projects/dab58087a95a4a1684bb28f989f5dc26` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:20.289160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986d15f-1823-4b03-961e-16587b2a530c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab58087a95a4a1684bb28f989f5dc26)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:20.291349 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986d15f-1823-4b03-961e-16587b2a530c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:20.374279 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:20.445825 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f986d15f-1823-4b03-961e-16587b2a530c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab58087a95a4a1684bb28f989f5dc26', 'request_id': 'req-f986d15f-1823-4b03-961e-16587b2a530c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:20.447308 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1edff6-a1c2-4bc6-b3c4-0bb2879bb1bb admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:20.464331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f986d15f-1823-4b03-961e-16587b2a530c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab58087a95a4a1684bb28f989f5dc26', 'request_id': 'req-f986d15f-1823-4b03-961e-16587b2a530c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:20.483060 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f986d15f-1823-4b03-961e-16587b2a530c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab58087a95a4a1684bb28f989f5dc26', 'request_id': 'req-f986d15f-1823-4b03-961e-16587b2a530c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:20.536398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f986d15f-1823-4b03-961e-16587b2a530c admin admin] The token cache is being invalidate because project dab58087a95a4a1684bb28f989f5dc26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:20.537917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f986d15f-1823-4b03-961e-16587b2a530c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:20.540796 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f986d15f-1823-4b03-961e-16587b2a530c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:20.545978 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 880/1749] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:19 2022] DELETE /identity/v3/projects/dab58087a95a4a1684bb28f989f5dc26 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:20.556095 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc60c27-bb2d-411f-ad75-4617350fb078 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:20.556413 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc60c27-bb2d-411f-ad75-4617350fb078 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:20.556536 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc60c27-bb2d-411f-ad75-4617350fb078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:20.631262 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4cc60c27-bb2d-411f-ad75-4617350fb078 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:20.633272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4cc60c27-bb2d-411f-ad75-4617350fb078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:20.694063 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f518d5-e5ce-4323-9ff7-2b138a88c768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:20.694915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f518d5-e5ce-4323-9ff7-2b138a88c768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:20.695322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f518d5-e5ce-4323-9ff7-2b138a88c768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:20.695707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f518d5-e5ce-4323-9ff7-2b138a88c768 admin admin] PATH_INFO: `/v3/users/3b03e8cacc684716a8397918fb5e0676` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:20.697416 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f518d5-e5ce-4323-9ff7-2b138a88c768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b03e8cacc684716a8397918fb5e0676)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:20.700345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f518d5-e5ce-4323-9ff7-2b138a88c768 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:20.810846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f8f518d5-e5ce-4323-9ff7-2b138a88c768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b03e8cacc684716a8397918fb5e0676'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:20.815791 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f8f518d5-e5ce-4323-9ff7-2b138a88c768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b03e8cacc684716a8397918fb5e0676'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:20.848495 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f8f518d5-e5ce-4323-9ff7-2b138a88c768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b03e8cacc684716a8397918fb5e0676'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:20.877965 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f8f518d5-e5ce-4323-9ff7-2b138a88c768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b03e8cacc684716a8397918fb5e0676'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:20.889805 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 881/1750] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:20.891315 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53028f7-4551-433c-b682-38b3433efb35 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:20.891607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53028f7-4551-433c-b682-38b3433efb35 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:20.892497 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53028f7-4551-433c-b682-38b3433efb35 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:20.894171 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 882/1751] 10.222.0.46 () {54 vars in 961 bytes} [Wed Aug 10 13:16:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:16:20.900204 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3bb3d-0acd-4a6a-b2cb-5d346bf10654 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:20.900422 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3bb3d-0acd-4a6a-b2cb-5d346bf10654 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:20.900798 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3bb3d-0acd-4a6a-b2cb-5d346bf10654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:20.916840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:20.947570 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-19d3bb3d-0acd-4a6a-b2cb-5d346bf10654 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:20.949971 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-19d3bb3d-0acd-4a6a-b2cb-5d346bf10654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:20.967836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f8f518d5-e5ce-4323-9ff7-2b138a88c768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b03e8cacc684716a8397918fb5e0676'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:20.991118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 883/1752] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:20.991118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd7654-8bc2-48d7-b961-3d81bf23abe6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:20.991118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd7654-8bc2-48d7-b961-3d81bf23abe6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:20.991118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd7654-8bc2-48d7-b961-3d81bf23abe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:20.991412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 870/1753] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:20 2022] DELETE /identity/v3/users/3b03e8cacc684716a8397918fb5e0676 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:20.993102 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f518d5-e5ce-4323-9ff7-2b138a88c768 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:21.063359 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2bbd7654-8bc2-48d7-b961-3d81bf23abe6 None None] MFA Rules not processed for user `15780b69faa745e9b99f1fffb6abe231`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:21.068418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2bbd7654-8bc2-48d7-b961-3d81bf23abe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:21.188594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f518d5-e5ce-4323-9ff7-2b138a88c768 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:21.206010 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfff74-b24e-4617-94fc-be2e3086c9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:21.206643 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfff74-b24e-4617-94fc-be2e3086c9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:21.207778 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfff74-b24e-4617-94fc-be2e3086c9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:21.208278 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfff74-b24e-4617-94fc-be2e3086c9c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:21.209169 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfff74-b24e-4617-94fc-be2e3086c9c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:16:21.209634 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfff74-b24e-4617-94fc-be2e3086c9c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:21.211466 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfff74-b24e-4617-94fc-be2e3086c9c4 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:21.260993 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 871/1754] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:16:21.262649 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a0bcc-03c8-4d8a-b492-ee72e07c92e2 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:21.269237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a0bcc-03c8-4d8a-b492-ee72e07c92e2 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:21.269769 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a0bcc-03c8-4d8a-b492-ee72e07c92e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:21.325041 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 884/1755] 10.222.0.46 () {58 vars in 1058 bytes} [Wed Aug 10 13:16:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:21.337442 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd7654-8bc2-48d7-b961-3d81bf23abe6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:21.371060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-5b8a0bcc-03c8-4d8a-b492-ee72e07c92e2 None None] MFA Rules not processed for user `c851345eb1c8444e957b1dae85776695`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:21.374461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd7654-8bc2-48d7-b961-3d81bf23abe6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:21.381063 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-5b8a0bcc-03c8-4d8a-b492-ee72e07c92e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:21.400737 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d669df-79cc-4c74-b716-07384f2ac0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:21.401482 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d669df-79cc-4c74-b716-07384f2ac0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:21.401775 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d669df-79cc-4c74-b716-07384f2ac0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:21.402129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d669df-79cc-4c74-b716-07384f2ac0a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:21.402851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d669df-79cc-4c74-b716-07384f2ac0a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:21.409043 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d669df-79cc-4c74-b716-07384f2ac0a5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:21.501524 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 885/1756] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:21 2022] POST /identity/v3/projects => generated 369 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:21.512618 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d669df-79cc-4c74-b716-07384f2ac0a5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:21.589839 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:21.789452 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d669df-79cc-4c74-b716-07384f2ac0a5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:21.816571 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 872/1757] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 555 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:21.818025 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67eb2d4-9dc4-4c62-880d-f61e9a62b722 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15780b69faa745e9b99f1fffb6abe231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:21.818841 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67eb2d4-9dc4-4c62-880d-f61e9a62b722 service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:21.819464 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67eb2d4-9dc4-4c62-880d-f61e9a62b722 service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:21.820053 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67eb2d4-9dc4-4c62-880d-f61e9a62b722 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:21.827372 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b67eb2d4-9dc4-4c62-880d-f61e9a62b722 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:21.847392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a0bcc-03c8-4d8a-b492-ee72e07c92e2 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:21.887545 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67eb2d4-9dc4-4c62-880d-f61e9a62b722 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:21.890659 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67eb2d4-9dc4-4c62-880d-f61e9a62b722 service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:21.905266 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a0bcc-03c8-4d8a-b492-ee72e07c92e2 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:21.942757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 886/1758] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:21.986496 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67eb2d4-9dc4-4c62-880d-f61e9a62b722 service placement] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:21.989471 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b67eb2d4-9dc4-4c62-880d-f61e9a62b722 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:22.181834 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67eb2d4-9dc4-4c62-880d-f61e9a62b722 service placement] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:22.188416 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422eb2af-5549-42ec-af82-8d7175dd3681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:22.189392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422eb2af-5549-42ec-af82-8d7175dd3681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:22.189721 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422eb2af-5549-42ec-af82-8d7175dd3681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:22.190297 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422eb2af-5549-42ec-af82-8d7175dd3681 admin admin] PATH_INFO: `/v3/users/893d9545618f455b88ddaa0bd370932e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:22.193819 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422eb2af-5549-42ec-af82-8d7175dd3681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=893d9545618f455b88ddaa0bd370932e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:22.199094 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141d00c-99e3-4b9b-bb1c-09fcfe15b2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:22.200739 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422eb2af-5549-42ec-af82-8d7175dd3681 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:22.201109 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141d00c-99e3-4b9b-bb1c-09fcfe15b2aa admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:22.201528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141d00c-99e3-4b9b-bb1c-09fcfe15b2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:22.206572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141d00c-99e3-4b9b-bb1c-09fcfe15b2aa admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:22.208871 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141d00c-99e3-4b9b-bb1c-09fcfe15b2aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:22.211034 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141d00c-99e3-4b9b-bb1c-09fcfe15b2aa admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:22.286369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 873/1759] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:21 2022] POST /identity/v3/users => generated 285 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:22.293139 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141d00c-99e3-4b9b-bb1c-09fcfe15b2aa admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:22.320965 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141d00c-99e3-4b9b-bb1c-09fcfe15b2aa admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:22.378960 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ada1c7-079b-451a-9c3f-a2cf01f37b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:22.383972 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ada1c7-079b-451a-9c3f-a2cf01f37b13 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:22.384476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ada1c7-079b-451a-9c3f-a2cf01f37b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:22.384957 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ada1c7-079b-451a-9c3f-a2cf01f37b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:22.388165 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ada1c7-079b-451a-9c3f-a2cf01f37b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:22.390141 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ada1c7-079b-451a-9c3f-a2cf01f37b13 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:22.411356 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-422eb2af-5549-42ec-af82-8d7175dd3681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '893d9545618f455b88ddaa0bd370932e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:22.412333 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-422eb2af-5549-42ec-af82-8d7175dd3681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '893d9545618f455b88ddaa0bd370932e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:22.445452 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 874/1760] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:22.448011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ada1c7-079b-451a-9c3f-a2cf01f37b13 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:22.449943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-422eb2af-5549-42ec-af82-8d7175dd3681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '893d9545618f455b88ddaa0bd370932e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:22.459720 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-26ada1c7-079b-451a-9c3f-a2cf01f37b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:22.471859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-422eb2af-5549-42ec-af82-8d7175dd3681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '893d9545618f455b88ddaa0bd370932e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:22.496079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:22.509293 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ada1c7-079b-451a-9c3f-a2cf01f37b13 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:22.522436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-422eb2af-5549-42ec-af82-8d7175dd3681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '893d9545618f455b88ddaa0bd370932e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:22.530719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61fc6f7-d4aa-40ee-ade2-ffd769e58806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:22.531502 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fc6f7-d4aa-40ee-ade2-ffd769e58806 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:22.531892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fc6f7-d4aa-40ee-ade2-ffd769e58806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:22.532267 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fc6f7-d4aa-40ee-ade2-ffd769e58806 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:22.533038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61fc6f7-d4aa-40ee-ade2-ffd769e58806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:22.534866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61fc6f7-d4aa-40ee-ade2-ffd769e58806 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:22.549544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 887/1761] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:21 2022] DELETE /identity/v3/users/893d9545618f455b88ddaa0bd370932e => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:22.555273 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c568f0-b68b-441b-a4e1-e32494bd2407 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:22.555562 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c568f0-b68b-441b-a4e1-e32494bd2407 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:22.555832 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c568f0-b68b-441b-a4e1-e32494bd2407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:22.570108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 875/1762] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:22.571267 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61fc6f7-d4aa-40ee-ade2-ffd769e58806 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:22.595984 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61fc6f7-d4aa-40ee-ade2-ffd769e58806 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:22.640415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-18c568f0-b68b-441b-a4e1-e32494bd2407 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:22.642019 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-18c568f0-b68b-441b-a4e1-e32494bd2407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:22.782734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:22.839889 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfacbd-5434-4f61-b4f3-8050e47d19e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:22.840772 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfacbd-5434-4f61-b4f3-8050e47d19e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:22.842250 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfacbd-5434-4f61-b4f3-8050e47d19e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:22.842632 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfacbd-5434-4f61-b4f3-8050e47d19e3 admin admin] PATH_INFO: `/v3/projects/98bb64b8627f450caecf6e1bcfa40adf/users/873fdc0011c44fcf9fc496827ea762fb/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:22.891334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 888/1763] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:16:22.893868 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfacbd-5434-4f61-b4f3-8050e47d19e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98bb64b8627f450caecf6e1bcfa40adf, user_id=873fdc0011c44fcf9fc496827ea762fb, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:22.906049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfacbd-5434-4f61-b4f3-8050e47d19e3 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:22.946227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 876/1764] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:22 2022] PUT /identity/v3/projects/98bb64b8627f450caecf6e1bcfa40adf/users/873fdc0011c44fcf9fc496827ea762fb/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:22.959303 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bfab5-3ef0-4979-bc1f-af0898a4025f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:22.960290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bfab5-3ef0-4979-bc1f-af0898a4025f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:22.961226 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bfab5-3ef0-4979-bc1f-af0898a4025f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:23.029323 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfacbd-5434-4f61-b4f3-8050e47d19e3 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:23.034508 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-14bfacbd-5434-4f61-b4f3-8050e47d19e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:23.127509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-472bfab5-3ef0-4979-bc1f-af0898a4025f None None] MFA Rules not processed for user `873fdc0011c44fcf9fc496827ea762fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:23.130936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-472bfab5-3ef0-4979-bc1f-af0898a4025f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:23.320628 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfacbd-5434-4f61-b4f3-8050e47d19e3 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:23.332530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465b04b-7e60-44db-8ea7-a7d3af071f50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:23.336353 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465b04b-7e60-44db-8ea7-a7d3af071f50 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:23.343069 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465b04b-7e60-44db-8ea7-a7d3af071f50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:23.343069 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465b04b-7e60-44db-8ea7-a7d3af071f50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:23.344655 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 889/1765] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:23.347629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bfab5-3ef0-4979-bc1f-af0898a4025f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:23.492463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bfab5-3ef0-4979-bc1f-af0898a4025f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:23.498332 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89195cec-31c2-4845-ac16-ff7e4f9d580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:23.499110 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89195cec-31c2-4845-ac16-ff7e4f9d580d admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:23.499438 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89195cec-31c2-4845-ac16-ff7e4f9d580d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:23.499726 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89195cec-31c2-4845-ac16-ff7e4f9d580d admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:23.500359 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89195cec-31c2-4845-ac16-ff7e4f9d580d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:23.502318 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89195cec-31c2-4845-ac16-ff7e4f9d580d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:23.591384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 890/1766] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:23 2022] POST /identity/v3/projects => generated 369 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:23.592613 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89195cec-31c2-4845-ac16-ff7e4f9d580d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:23.594423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c465b04b-7e60-44db-8ea7-a7d3af071f50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:23.598312 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c465b04b-7e60-44db-8ea7-a7d3af071f50 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:23.600410 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-89195cec-31c2-4845-ac16-ff7e4f9d580d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:23.640743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 877/1767] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:23.641738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465b04b-7e60-44db-8ea7-a7d3af071f50 service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:23.674339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465b04b-7e60-44db-8ea7-a7d3af071f50 service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:23.714922 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:23.917816 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae84bc-d3cd-4d9b-8e27-7ac0c5facc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:23.918579 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae84bc-d3cd-4d9b-8e27-7ac0c5facc62 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:23.918774 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae84bc-d3cd-4d9b-8e27-7ac0c5facc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:23.919062 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae84bc-d3cd-4d9b-8e27-7ac0c5facc62 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:23.936198 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae84bc-d3cd-4d9b-8e27-7ac0c5facc62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:23.939359 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:23.944318 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae84bc-d3cd-4d9b-8e27-7ac0c5facc62 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:24.044865 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89195cec-31c2-4845-ac16-ff7e4f9d580d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:24.086894 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480ebee-a6fc-45ff-86f2-31707f734b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:24.087559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480ebee-a6fc-45ff-86f2-31707f734b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:24.088094 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480ebee-a6fc-45ff-86f2-31707f734b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:24.094646 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480ebee-a6fc-45ff-86f2-31707f734b64 admin admin] PATH_INFO: `/v3/projects/5867a5c8301f4288abaf1a44edf9603a` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:24.101010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480ebee-a6fc-45ff-86f2-31707f734b64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5867a5c8301f4288abaf1a44edf9603a)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:24.102973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480ebee-a6fc-45ff-86f2-31707f734b64 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:24.129082 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 878/1768] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:23 2022] POST /identity/v3/users => generated 291 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:24.139430 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358560ba-91c3-4187-8039-6ce675a5284d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:24.149836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358560ba-91c3-4187-8039-6ce675a5284d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:24.153648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358560ba-91c3-4187-8039-6ce675a5284d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:24.263568 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-358560ba-91c3-4187-8039-6ce675a5284d None None] MFA Rules not processed for user `9c02f3fe4aa64e97b8172369816a9584`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:24.265847 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-358560ba-91c3-4187-8039-6ce675a5284d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:24.336433 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5480ebee-a6fc-45ff-86f2-31707f734b64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5867a5c8301f4288abaf1a44edf9603a', 'request_id': 'req-5480ebee-a6fc-45ff-86f2-31707f734b64'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:24.358539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5480ebee-a6fc-45ff-86f2-31707f734b64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5867a5c8301f4288abaf1a44edf9603a', 'request_id': 'req-5480ebee-a6fc-45ff-86f2-31707f734b64'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:24.393389 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5480ebee-a6fc-45ff-86f2-31707f734b64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5867a5c8301f4288abaf1a44edf9603a', 'request_id': 'req-5480ebee-a6fc-45ff-86f2-31707f734b64'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:24.425029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5480ebee-a6fc-45ff-86f2-31707f734b64 admin admin] The token cache is being invalidate because project 5867a5c8301f4288abaf1a44edf9603a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:24.425552 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5480ebee-a6fc-45ff-86f2-31707f734b64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:24.427206 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5480ebee-a6fc-45ff-86f2-31707f734b64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:24.434469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 891/1769] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:23 2022] DELETE /identity/v3/projects/5867a5c8301f4288abaf1a44edf9603a => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:24.435657 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480ebee-a6fc-45ff-86f2-31707f734b64 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:24.437244 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5480ebee-a6fc-45ff-86f2-31707f734b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:24.551460 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 879/1770] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:24.552923 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7dd28-d399-4b38-9429-b406d88b51df None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:24.553210 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7dd28-d399-4b38-9429-b406d88b51df None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:24.553485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7dd28-d399-4b38-9429-b406d88b51df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:24.630698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-f7a7dd28-d399-4b38-9429-b406d88b51df None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:24.635808 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-f7a7dd28-d399-4b38-9429-b406d88b51df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:24.697656 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480ebee-a6fc-45ff-86f2-31707f734b64 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:24.718932 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d534a5-0e98-431e-8ad4-aa19feddbf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:24.719655 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d534a5-0e98-431e-8ad4-aa19feddbf62 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:24.719929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d534a5-0e98-431e-8ad4-aa19feddbf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:24.720249 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d534a5-0e98-431e-8ad4-aa19feddbf62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:24.720919 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d534a5-0e98-431e-8ad4-aa19feddbf62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:24.722575 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d534a5-0e98-431e-8ad4-aa19feddbf62 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:24.770200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 892/1771] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:24.774701 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d534a5-0e98-431e-8ad4-aa19feddbf62 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:24.814416 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d534a5-0e98-431e-8ad4-aa19feddbf62 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:24.831506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d631710-b666-4511-a221-8e1ad50493ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:24.836012 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d631710-b666-4511-a221-8e1ad50493ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:24.836819 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d631710-b666-4511-a221-8e1ad50493ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:24.837276 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d631710-b666-4511-a221-8e1ad50493ff admin admin] PATH_INFO: `/v3/projects/4b5e5ca9cf21445cb2776610564a706a/users/51084a47aac9475d857fd664a6546a2c/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:24.912075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 880/1772] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:24.922626 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485941a5-2eec-4e20-a966-af3cd1a78fe0 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:24.923291 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485941a5-2eec-4e20-a966-af3cd1a78fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:24.923775 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485941a5-2eec-4e20-a966-af3cd1a78fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:24.925581 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d631710-b666-4511-a221-8e1ad50493ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5e5ca9cf21445cb2776610564a706a, user_id=51084a47aac9475d857fd664a6546a2c, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:24.939469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d631710-b666-4511-a221-8e1ad50493ff admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:24.983973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 893/1773] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:24 2022] PUT /identity/v3/projects/4b5e5ca9cf21445cb2776610564a706a/users/51084a47aac9475d857fd664a6546a2c/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:24.990554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d631710-b666-4511-a221-8e1ad50493ff admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:25.030382 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-485941a5-2eec-4e20-a966-af3cd1a78fe0 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:25.032452 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-485941a5-2eec-4e20-a966-af3cd1a78fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:25.150531 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:25.164288 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:25.187790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 881/1774] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:25.189768 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485941a5-2eec-4e20-a966-af3cd1a78fe0 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:25.218975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d631710-b666-4511-a221-8e1ad50493ff admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:25.227993 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485941a5-2eec-4e20-a966-af3cd1a78fe0 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:25.252690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef2dff-c532-4adf-a7e0-1c6c88c3de76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:25.257356 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef2dff-c532-4adf-a7e0-1c6c88c3de76 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:25.257528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e91ac0-de8a-4efc-966a-9cd7df5a8fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:25.258033 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e91ac0-de8a-4efc-966a-9cd7df5a8fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:25.258505 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e91ac0-de8a-4efc-966a-9cd7df5a8fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:25.258662 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef2dff-c532-4adf-a7e0-1c6c88c3de76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:25.259106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef2dff-c532-4adf-a7e0-1c6c88c3de76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:25.259799 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e91ac0-de8a-4efc-966a-9cd7df5a8fe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:25.260171 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef2dff-c532-4adf-a7e0-1c6c88c3de76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:25.260503 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e91ac0-de8a-4efc-966a-9cd7df5a8fe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:16:25.260813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e91ac0-de8a-4efc-966a-9cd7df5a8fe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:25.262457 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e91ac0-de8a-4efc-966a-9cd7df5a8fe8 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:25.264786 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef2dff-c532-4adf-a7e0-1c6c88c3de76 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:25.298723 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 894/1775] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:25.303409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef2dff-c532-4adf-a7e0-1c6c88c3de76 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:25.314730 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 882/1776] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:16:25.315741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e91ac0-de8a-4efc-966a-9cd7df5a8fe8 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:25.334115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef2dff-c532-4adf-a7e0-1c6c88c3de76 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:25.346051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c006eb6-c854-4955-b35a-9eb5f76f6c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:25.346739 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c006eb6-c854-4955-b35a-9eb5f76f6c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:25.347102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c006eb6-c854-4955-b35a-9eb5f76f6c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:25.347318 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c006eb6-c854-4955-b35a-9eb5f76f6c6b admin admin] PATH_INFO: `/v3/projects/4b5e5ca9cf21445cb2776610564a706a/users/51084a47aac9475d857fd664a6546a2c/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:25.348067 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e91ac0-de8a-4efc-966a-9cd7df5a8fe8 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:25.352836 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c006eb6-c854-4955-b35a-9eb5f76f6c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5e5ca9cf21445cb2776610564a706a, user_id=51084a47aac9475d857fd664a6546a2c, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:25.367954 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c006eb6-c854-4955-b35a-9eb5f76f6c6b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:25.390255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336377d-a3c4-4cdc-b631-08bd0cebeee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:25.390918 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336377d-a3c4-4cdc-b631-08bd0cebeee7 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:25.391404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336377d-a3c4-4cdc-b631-08bd0cebeee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:25.391692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336377d-a3c4-4cdc-b631-08bd0cebeee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:25.392340 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336377d-a3c4-4cdc-b631-08bd0cebeee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:25.394307 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336377d-a3c4-4cdc-b631-08bd0cebeee7 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:25.426149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 895/1777] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:25 2022] PUT /identity/v3/projects/4b5e5ca9cf21445cb2776610564a706a/users/51084a47aac9475d857fd664a6546a2c/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:25.436412 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e21d51-012e-411e-ac1b-f186bc21eafb None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:25.436718 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e21d51-012e-411e-ac1b-f186bc21eafb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:25.436970 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e21d51-012e-411e-ac1b-f186bc21eafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:25.477226 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 883/1778] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:25 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:25.482945 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336377d-a3c4-4cdc-b631-08bd0cebeee7 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:25.559409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-87e21d51-012e-411e-ac1b-f186bc21eafb None None] MFA Rules not processed for user `51084a47aac9475d857fd664a6546a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:25.562596 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-87e21d51-012e-411e-ac1b-f186bc21eafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:25.722611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336377d-a3c4-4cdc-b631-08bd0cebeee7 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:25.739778 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567d8cf-8378-43c1-85c4-f8f65c61c6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:25.740646 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567d8cf-8378-43c1-85c4-f8f65c61c6fa admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:25.741055 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567d8cf-8378-43c1-85c4-f8f65c61c6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:25.741488 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567d8cf-8378-43c1-85c4-f8f65c61c6fa admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:25.742270 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567d8cf-8378-43c1-85c4-f8f65c61c6fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:25.744488 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567d8cf-8378-43c1-85c4-f8f65c61c6fa admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:25.763853 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 896/1779] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:16:25.766144 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8c216-481b-4ad3-933c-4ca525cf51cf None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:25.766409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8c216-481b-4ad3-933c-4ca525cf51cf None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:25.766798 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8c216-481b-4ad3-933c-4ca525cf51cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:25.800341 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 884/1780] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:25 2022] POST /identity/v3/users => generated 292 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:16:25.800341 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567d8cf-8378-43c1-85c4-f8f65c61c6fa admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:25.811184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3567d8cf-8378-43c1-85c4-f8f65c61c6fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:25.812824 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-cfd8c216-481b-4ad3-933c-4ca525cf51cf None None] MFA Rules not processed for user `0ed48747fc084496ba252279614be4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:25.814144 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cfd8c216-481b-4ad3-933c-4ca525cf51cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:25.919398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 897/1781] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:25.920446 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8c216-481b-4ad3-933c-4ca525cf51cf None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:25.949534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8c216-481b-4ad3-933c-4ca525cf51cf None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:25.964651 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3125c-8dec-42d2-bf60-10e0dea28b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:25.965391 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3125c-8dec-42d2-bf60-10e0dea28b11 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:25.965802 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3125c-8dec-42d2-bf60-10e0dea28b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:25.966184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3125c-8dec-42d2-bf60-10e0dea28b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:25.967461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3125c-8dec-42d2-bf60-10e0dea28b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:25.969564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3125c-8dec-42d2-bf60-10e0dea28b11 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:25.996866 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 898/1782] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:26.000118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3125c-8dec-42d2-bf60-10e0dea28b11 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:26.002343 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5bd3125c-8dec-42d2-bf60-10e0dea28b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:26.041514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3125c-8dec-42d2-bf60-10e0dea28b11 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:26.049865 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567d8cf-8378-43c1-85c4-f8f65c61c6fa admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:26.062709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2928d-b5e9-4008-beee-907f5d0e72ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:26.064311 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2928d-b5e9-4008-beee-907f5d0e72ef service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:26.064593 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2928d-b5e9-4008-beee-907f5d0e72ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:26.064867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2928d-b5e9-4008-beee-907f5d0e72ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:26.070245 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0650c1-087d-454d-a4a3-2052f24c3b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:26.071059 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0650c1-087d-454d-a4a3-2052f24c3b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:26.073180 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0650c1-087d-454d-a4a3-2052f24c3b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:26.073509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0650c1-087d-454d-a4a3-2052f24c3b7e admin admin] PATH_INFO: `/v3/projects/782117d8be0a446f9632e1eed7f4db04` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:26.075967 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0650c1-087d-454d-a4a3-2052f24c3b7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=782117d8be0a446f9632e1eed7f4db04)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:26.085057 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0650c1-087d-454d-a4a3-2052f24c3b7e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:26.099165 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2928d-b5e9-4008-beee-907f5d0e72ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:26.100512 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2928d-b5e9-4008-beee-907f5d0e72ef service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:26.128557 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 885/1783] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:26.132331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:26.145665 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2928d-b5e9-4008-beee-907f5d0e72ef service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:26.153509 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-16e2928d-b5e9-4008-beee-907f5d0e72ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:26.186410 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7c0650c1-087d-454d-a4a3-2052f24c3b7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '782117d8be0a446f9632e1eed7f4db04', 'request_id': 'req-7c0650c1-087d-454d-a4a3-2052f24c3b7e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:26.198223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7c0650c1-087d-454d-a4a3-2052f24c3b7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '782117d8be0a446f9632e1eed7f4db04', 'request_id': 'req-7c0650c1-087d-454d-a4a3-2052f24c3b7e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:26.213780 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7c0650c1-087d-454d-a4a3-2052f24c3b7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '782117d8be0a446f9632e1eed7f4db04', 'request_id': 'req-7c0650c1-087d-454d-a4a3-2052f24c3b7e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:26.240426 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7c0650c1-087d-454d-a4a3-2052f24c3b7e admin admin] The token cache is being invalidate because project 782117d8be0a446f9632e1eed7f4db04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:26.240853 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7c0650c1-087d-454d-a4a3-2052f24c3b7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:26.243217 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7c0650c1-087d-454d-a4a3-2052f24c3b7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:26.248857 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 899/1784] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:25 2022] DELETE /identity/v3/projects/782117d8be0a446f9632e1eed7f4db04 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:26.249687 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0650c1-087d-454d-a4a3-2052f24c3b7e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:26.251376 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7c0650c1-087d-454d-a4a3-2052f24c3b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:26.293898 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:26.339091 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2928d-b5e9-4008-beee-907f5d0e72ef service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:26.418091 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0650c1-087d-454d-a4a3-2052f24c3b7e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:26.434237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4e23d-9edb-4fbf-998c-44840685716d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:26.434876 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4e23d-9edb-4fbf-998c-44840685716d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:26.435199 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4e23d-9edb-4fbf-998c-44840685716d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:26.435479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4e23d-9edb-4fbf-998c-44840685716d admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:26.437324 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a4e23d-9edb-4fbf-998c-44840685716d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:26.443267 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a4e23d-9edb-4fbf-998c-44840685716d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:26.465308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 900/1785] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:26.470732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4e23d-9edb-4fbf-998c-44840685716d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:26.472936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-04a4e23d-9edb-4fbf-998c-44840685716d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:26.503335 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75ffad-aba3-4f76-a1ac-17fe17c25254 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:26.506601 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75ffad-aba3-4f76-a1ac-17fe17c25254 service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:26.507177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75ffad-aba3-4f76-a1ac-17fe17c25254 service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:26.507734 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75ffad-aba3-4f76-a1ac-17fe17c25254 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:26.511600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-5c75ffad-aba3-4f76-a1ac-17fe17c25254 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:26.651729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4e23d-9edb-4fbf-998c-44840685716d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:26.700432 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ec256-3261-4aff-b3ac-c635930c7c38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:26.710100 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ec256-3261-4aff-b3ac-c635930c7c38 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:26.710768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ec256-3261-4aff-b3ac-c635930c7c38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:26.711289 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ec256-3261-4aff-b3ac-c635930c7c38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:26.722889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-148ec256-3261-4aff-b3ac-c635930c7c38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:26.730247 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75ffad-aba3-4f76-a1ac-17fe17c25254 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:26.731821 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75ffad-aba3-4f76-a1ac-17fe17c25254 service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:26.771529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 886/1786] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:26.772434 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75ffad-aba3-4f76-a1ac-17fe17c25254 service nova] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:26.777104 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-5c75ffad-aba3-4f76-a1ac-17fe17c25254 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:26.828758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75ffad-aba3-4f76-a1ac-17fe17c25254 service nova] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:26.844866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c01890-ba96-4744-8725-2f1f91bdbda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:26.845408 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c01890-ba96-4744-8725-2f1f91bdbda6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:26.845690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c01890-ba96-4744-8725-2f1f91bdbda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:26.845966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c01890-ba96-4744-8725-2f1f91bdbda6 admin admin] PATH_INFO: `/v3/users/344608c246154ea1bb6c7cdcfd1e841f` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:26.854802 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c01890-ba96-4744-8725-2f1f91bdbda6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=344608c246154ea1bb6c7cdcfd1e841f)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:26.856800 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c01890-ba96-4744-8725-2f1f91bdbda6 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:26.910849 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ec256-3261-4aff-b3ac-c635930c7c38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:26.913030 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ec256-3261-4aff-b3ac-c635930c7c38 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:26.942955 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 901/1787] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:26.958108 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ec256-3261-4aff-b3ac-c635930c7c38 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:26.986132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:27.010157 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ec256-3261-4aff-b3ac-c635930c7c38 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:27.011730 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f4c01890-ba96-4744-8725-2f1f91bdbda6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '344608c246154ea1bb6c7cdcfd1e841f'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:27.014686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f4c01890-ba96-4744-8725-2f1f91bdbda6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '344608c246154ea1bb6c7cdcfd1e841f'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:27.024145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4f859-48c2-4426-98d6-c53b653b59ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:27.026169 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4f859-48c2-4426-98d6-c53b653b59ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:27.029900 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4f859-48c2-4426-98d6-c53b653b59ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:27.031173 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4f859-48c2-4426-98d6-c53b653b59ab admin admin] PATH_INFO: `/v3/projects/1586c9da911949d98678fe7fc0516c18/users/d895566411594765bb4265b46503b594/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:27.045637 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f4c01890-ba96-4744-8725-2f1f91bdbda6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '344608c246154ea1bb6c7cdcfd1e841f'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:27.060079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f4c01890-ba96-4744-8725-2f1f91bdbda6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '344608c246154ea1bb6c7cdcfd1e841f'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:27.104806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f4c01890-ba96-4744-8725-2f1f91bdbda6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '344608c246154ea1bb6c7cdcfd1e841f'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:27.130630 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4f859-48c2-4426-98d6-c53b653b59ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=1586c9da911949d98678fe7fc0516c18, user_id=d895566411594765bb4265b46503b594, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:27.138073 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4f859-48c2-4426-98d6-c53b653b59ab admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:27.139352 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 887/1788] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:26 2022] DELETE /identity/v3/users/344608c246154ea1bb6c7cdcfd1e841f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:27.189476 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 902/1789] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:26 2022] PUT /identity/v3/projects/1586c9da911949d98678fe7fc0516c18/users/d895566411594765bb4265b46503b594/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:27.205361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32111c-3b82-45ea-82bb-cbb88737b876 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:27.205834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32111c-3b82-45ea-82bb-cbb88737b876 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:27.206257 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32111c-3b82-45ea-82bb-cbb88737b876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:27.224285 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:27.337383 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-cd32111c-3b82-45ea-82bb-cbb88737b876 None None] MFA Rules not processed for user `d895566411594765bb4265b46503b594`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:27.338945 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-cd32111c-3b82-45ea-82bb-cbb88737b876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:27.602825 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4f859-48c2-4426-98d6-c53b653b59ab admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:27.605253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-37f4f859-48c2-4426-98d6-c53b653b59ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:27.615101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 888/1790] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:27.791081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef53769-7c70-49a2-94bf-eb7355b3092a None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:27.791954 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef53769-7c70-49a2-94bf-eb7355b3092a None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:27.792349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef53769-7c70-49a2-94bf-eb7355b3092a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:27.899151 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4f859-48c2-4426-98d6-c53b653b59ab admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:27.924073 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83968a24-7445-4256-a297-da2731a88a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:27.925048 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83968a24-7445-4256-a297-da2731a88a61 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:27.925480 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83968a24-7445-4256-a297-da2731a88a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:27.925937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83968a24-7445-4256-a297-da2731a88a61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:27.926845 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83968a24-7445-4256-a297-da2731a88a61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:27.929105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83968a24-7445-4256-a297-da2731a88a61 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:27.976330 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-7ef53769-7c70-49a2-94bf-eb7355b3092a None None] MFA Rules not processed for user `182eec86daa44cd48d6ef1c38f58e89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:27.980349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7ef53769-7c70-49a2-94bf-eb7355b3092a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:28.003695 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 903/1791] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:27 2022] POST /identity/v3/projects => generated 383 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:28.015440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83968a24-7445-4256-a297-da2731a88a61 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:28.166561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83968a24-7445-4256-a297-da2731a88a61 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:28.185067 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec52de2-8907-461b-89a4-672d24804f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:28.185955 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec52de2-8907-461b-89a4-672d24804f1f admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:28.186343 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec52de2-8907-461b-89a4-672d24804f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:28.186746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec52de2-8907-461b-89a4-672d24804f1f admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:28.188259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec52de2-8907-461b-89a4-672d24804f1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:28.194121 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec52de2-8907-461b-89a4-672d24804f1f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:28.249354 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 889/1792] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 10 13:16:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:28.300143 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 904/1793] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:28 2022] POST /identity/v3/users => generated 298 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:28.301555 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef53769-7c70-49a2-94bf-eb7355b3092a None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:28.323322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef53769-7c70-49a2-94bf-eb7355b3092a None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:28.340809 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a981b54-fa6d-463e-b58e-ddc14c2dfd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:28.341865 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a981b54-fa6d-463e-b58e-ddc14c2dfd76 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:28.342433 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a981b54-fa6d-463e-b58e-ddc14c2dfd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:28.343191 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a981b54-fa6d-463e-b58e-ddc14c2dfd76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:28.344287 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a981b54-fa6d-463e-b58e-ddc14c2dfd76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:28.350044 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a981b54-fa6d-463e-b58e-ddc14c2dfd76 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:28.381749 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 890/1794] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:28.386149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec52de2-8907-461b-89a4-672d24804f1f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:28.397626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec52de2-8907-461b-89a4-672d24804f1f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:28.403310 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b4318-0424-4f44-9ba1-d24dae998461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:28.404253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b4318-0424-4f44-9ba1-d24dae998461 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:28.404389 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b4318-0424-4f44-9ba1-d24dae998461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:28.404626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b4318-0424-4f44-9ba1-d24dae998461 admin admin] PATH_INFO: `/v3/projects/6ce9e874b7564a96a258534980eee1c9/users/1b54800713a64b6184bbb0c1b44680f3/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:28.446484 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b4318-0424-4f44-9ba1-d24dae998461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce9e874b7564a96a258534980eee1c9, user_id=1b54800713a64b6184bbb0c1b44680f3, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:28.449261 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b4318-0424-4f44-9ba1-d24dae998461 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:28.482314 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 905/1795] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:28 2022] PUT /identity/v3/projects/6ce9e874b7564a96a258534980eee1c9/users/1b54800713a64b6184bbb0c1b44680f3/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:28.486714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a981b54-fa6d-463e-b58e-ddc14c2dfd76 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:28.517810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a981b54-fa6d-463e-b58e-ddc14c2dfd76 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:28.567520 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b4318-0424-4f44-9ba1-d24dae998461 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:28.569491 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ff3b4318-0424-4f44-9ba1-d24dae998461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:28.686352 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:28.690250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:28.705695 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b649484-8dde-4ee3-a09f-e516f24d7b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:28.706303 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b649484-8dde-4ee3-a09f-e516f24d7b0e admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:28.706585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b649484-8dde-4ee3-a09f-e516f24d7b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:28.706926 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b649484-8dde-4ee3-a09f-e516f24d7b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:28.707644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b649484-8dde-4ee3-a09f-e516f24d7b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:28.709654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b649484-8dde-4ee3-a09f-e516f24d7b0e admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:28.745530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 891/1796] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:28.746509 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b649484-8dde-4ee3-a09f-e516f24d7b0e admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:28.771647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b649484-8dde-4ee3-a09f-e516f24d7b0e admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:28.797113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c4ab1-1947-4bdf-8d72-dd0e6e0c1c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:28.797806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c4ab1-1947-4bdf-8d72-dd0e6e0c1c65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:28.798087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c4ab1-1947-4bdf-8d72-dd0e6e0c1c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:28.798759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c4ab1-1947-4bdf-8d72-dd0e6e0c1c65 admin admin] PATH_INFO: `/v3/projects/6ce9e874b7564a96a258534980eee1c9/users/1b54800713a64b6184bbb0c1b44680f3/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:28.807637 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c4ab1-1947-4bdf-8d72-dd0e6e0c1c65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce9e874b7564a96a258534980eee1c9, user_id=1b54800713a64b6184bbb0c1b44680f3, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:28.810627 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c4ab1-1947-4bdf-8d72-dd0e6e0c1c65 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:28.854668 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 892/1797] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:28 2022] PUT /identity/v3/projects/6ce9e874b7564a96a258534980eee1c9/users/1b54800713a64b6184bbb0c1b44680f3/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:28.856222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f38a83-3d78-49b3-b5a8-26141d42aa47 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:28.856509 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f38a83-3d78-49b3-b5a8-26141d42aa47 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:28.856782 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f38a83-3d78-49b3-b5a8-26141d42aa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:28.866319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b4318-0424-4f44-9ba1-d24dae998461 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:28.934727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-05f38a83-3d78-49b3-b5a8-26141d42aa47 None None] MFA Rules not processed for user `1b54800713a64b6184bbb0c1b44680f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:28.936489 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-05f38a83-3d78-49b3-b5a8-26141d42aa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:28.967645 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38123c-8e59-4d2d-911a-de627b7329cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c86ef66c9564e0395c325a84ca9c4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:28.968951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38123c-8e59-4d2d-911a-de627b7329cb service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:28.969534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38123c-8e59-4d2d-911a-de627b7329cb service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:28.969983 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38123c-8e59-4d2d-911a-de627b7329cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:29.158573 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 893/1798] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:29.173475 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38123c-8e59-4d2d-911a-de627b7329cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:29.180444 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38123c-8e59-4d2d-911a-de627b7329cb service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:29.204700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f38a83-3d78-49b3-b5a8-26141d42aa47 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:29.206518 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-05f38a83-3d78-49b3-b5a8-26141d42aa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:29.231444 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 906/1799] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 10 13:16:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 13:16:29.362726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f38a83-3d78-49b3-b5a8-26141d42aa47 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:29.377091 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac504a34-7313-443e-89c1-79cc016f7508 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:29.377742 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac504a34-7313-443e-89c1-79cc016f7508 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:29.378026 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac504a34-7313-443e-89c1-79cc016f7508 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:29.378303 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac504a34-7313-443e-89c1-79cc016f7508 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:29.428698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac504a34-7313-443e-89c1-79cc016f7508 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:29.430780 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac504a34-7313-443e-89c1-79cc016f7508 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:29.484619 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 894/1800] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:30.006343 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38123c-8e59-4d2d-911a-de627b7329cb service swift] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:30.008010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6c38123c-8e59-4d2d-911a-de627b7329cb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:30.018434 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac504a34-7313-443e-89c1-79cc016f7508 service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:30.021520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-ac504a34-7313-443e-89c1-79cc016f7508 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:30.036563 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38123c-8e59-4d2d-911a-de627b7329cb service swift] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:30.047398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ca980-0fb2-4845-8497-45c3aa474fd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:30.049500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ca980-0fb2-4845-8497-45c3aa474fd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:30.049805 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ca980-0fb2-4845-8497-45c3aa474fd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:30.050118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ca980-0fb2-4845-8497-45c3aa474fd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:30.193926 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac504a34-7313-443e-89c1-79cc016f7508 service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:30.218199 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1139679-df6f-42a6-86f8-074174c646ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:30.220707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1139679-df6f-42a6-86f8-074174c646ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:30.223194 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1139679-df6f-42a6-86f8-074174c646ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:30.225137 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1139679-df6f-42a6-86f8-074174c646ff admin admin] PATH_INFO: `/v3/users/dfe03917ee7f40f8a14cbc738f9aa223` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:30.229110 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1139679-df6f-42a6-86f8-074174c646ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfe03917ee7f40f8a14cbc738f9aa223)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:30.233952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1139679-df6f-42a6-86f8-074174c646ff admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:30.251121 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:30.266781 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:30.291557 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ca980-0fb2-4845-8497-45c3aa474fd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:30.295480 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ca980-0fb2-4845-8497-45c3aa474fd3 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:30.346879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 907/1801] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:30.353512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ca980-0fb2-4845-8497-45c3aa474fd3 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:30.374096 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-684ca980-0fb2-4845-8497-45c3aa474fd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:30.440499 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ca980-0fb2-4845-8497-45c3aa474fd3 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:30.448138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a1139679-df6f-42a6-86f8-074174c646ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfe03917ee7f40f8a14cbc738f9aa223'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:30.450121 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a1139679-df6f-42a6-86f8-074174c646ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfe03917ee7f40f8a14cbc738f9aa223'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:30.452907 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203683ee-2b78-49ea-b7fb-e17f6582239b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:30.455350 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203683ee-2b78-49ea-b7fb-e17f6582239b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:30.455684 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203683ee-2b78-49ea-b7fb-e17f6582239b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:30.457535 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203683ee-2b78-49ea-b7fb-e17f6582239b admin admin] PATH_INFO: `/v3/projects/aaed10a2284f49c3a48883e1d9364e94` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:30.474778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203683ee-2b78-49ea-b7fb-e17f6582239b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaed10a2284f49c3a48883e1d9364e94)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:30.480837 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203683ee-2b78-49ea-b7fb-e17f6582239b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:30.483920 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a1139679-df6f-42a6-86f8-074174c646ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfe03917ee7f40f8a14cbc738f9aa223'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:30.502406 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a1139679-df6f-42a6-86f8-074174c646ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfe03917ee7f40f8a14cbc738f9aa223'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:30.554172 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a1139679-df6f-42a6-86f8-074174c646ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfe03917ee7f40f8a14cbc738f9aa223'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:30.576958 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 895/1802] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:30 2022] DELETE /identity/v3/users/dfe03917ee7f40f8a14cbc738f9aa223 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:16:30.582785 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ad378-d1d9-4ac2-b33f-0381226fd85d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:30.583872 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ad378-d1d9-4ac2-b33f-0381226fd85d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:30.588098 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ad378-d1d9-4ac2-b33f-0381226fd85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:30.643552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-e82ad378-d1d9-4ac2-b33f-0381226fd85d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:30.645570 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-e82ad378-d1d9-4ac2-b33f-0381226fd85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:30.666273 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-203683ee-2b78-49ea-b7fb-e17f6582239b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaed10a2284f49c3a48883e1d9364e94', 'request_id': 'req-203683ee-2b78-49ea-b7fb-e17f6582239b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:30.694653 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-203683ee-2b78-49ea-b7fb-e17f6582239b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaed10a2284f49c3a48883e1d9364e94', 'request_id': 'req-203683ee-2b78-49ea-b7fb-e17f6582239b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:30.723813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-203683ee-2b78-49ea-b7fb-e17f6582239b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaed10a2284f49c3a48883e1d9364e94', 'request_id': 'req-203683ee-2b78-49ea-b7fb-e17f6582239b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:30.739721 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 896/1803] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:30.801681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-203683ee-2b78-49ea-b7fb-e17f6582239b admin admin] The token cache is being invalidate because project aaed10a2284f49c3a48883e1d9364e94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:30.801899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-203683ee-2b78-49ea-b7fb-e17f6582239b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:30.810734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-203683ee-2b78-49ea-b7fb-e17f6582239b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:30.823109 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 908/1804] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:30 2022] DELETE /identity/v3/projects/aaed10a2284f49c3a48883e1d9364e94 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:30.828401 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2633bf-4f98-46c7-b252-4872b2567545 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:30.828743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2633bf-4f98-46c7-b252-4872b2567545 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:30.829166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2633bf-4f98-46c7-b252-4872b2567545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:30.860088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203683ee-2b78-49ea-b7fb-e17f6582239b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:30.864651 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-203683ee-2b78-49ea-b7fb-e17f6582239b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:30.906716 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-4e2633bf-4f98-46c7-b252-4872b2567545 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:30.917095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-4e2633bf-4f98-46c7-b252-4872b2567545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:30.956472 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 897/1805] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:30.967478 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fc8ca-2b4b-477f-80a4-1aec8ee94519 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:30.968528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fc8ca-2b4b-477f-80a4-1aec8ee94519 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:30.969968 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fc8ca-2b4b-477f-80a4-1aec8ee94519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:31.104185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-af5fc8ca-2b4b-477f-80a4-1aec8ee94519 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:31.116143 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-af5fc8ca-2b4b-477f-80a4-1aec8ee94519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:31.165760 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 898/1806] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:31.169198 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fc8ca-2b4b-477f-80a4-1aec8ee94519 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:31.178858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203683ee-2b78-49ea-b7fb-e17f6582239b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:31.205061 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efa061-ca6e-4649-9ae4-cc05f0bbdde8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:31.209594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efa061-ca6e-4649-9ae4-cc05f0bbdde8 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:31.209920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efa061-ca6e-4649-9ae4-cc05f0bbdde8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:31.212492 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efa061-ca6e-4649-9ae4-cc05f0bbdde8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:31.216123 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fc8ca-2b4b-477f-80a4-1aec8ee94519 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:31.220422 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c0efa061-ca6e-4649-9ae4-cc05f0bbdde8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:31.242620 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256358c-e610-4315-9197-44098040ae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:31.248474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256358c-e610-4315-9197-44098040ae7a admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:31.250675 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256358c-e610-4315-9197-44098040ae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:31.252738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256358c-e610-4315-9197-44098040ae7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:31.254929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256358c-e610-4315-9197-44098040ae7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:16:31.259336 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256358c-e610-4315-9197-44098040ae7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:31.274960 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256358c-e610-4315-9197-44098040ae7a admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:31.292778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efa061-ca6e-4649-9ae4-cc05f0bbdde8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:31.300815 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efa061-ca6e-4649-9ae4-cc05f0bbdde8 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:31.331386 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 899/1807] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:16:31.344193 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f02736-ec8a-4fc5-9193-92dded9db505 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:31.345588 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f02736-ec8a-4fc5-9193-92dded9db505 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:31.348721 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f02736-ec8a-4fc5-9193-92dded9db505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:31.353189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 909/1808] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:31.357979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efa061-ca6e-4649-9ae4-cc05f0bbdde8 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:31.396485 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efa061-ca6e-4649-9ae4-cc05f0bbdde8 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:31.416439 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2f6b8-6000-4855-8738-674afa80ea75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:31.417088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2f6b8-6000-4855-8738-674afa80ea75 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:31.422246 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2f6b8-6000-4855-8738-674afa80ea75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:31.422532 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2f6b8-6000-4855-8738-674afa80ea75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:31.423258 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2f6b8-6000-4855-8738-674afa80ea75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:31.427653 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-17f02736-ec8a-4fc5-9193-92dded9db505 None None] MFA Rules not processed for user `49b69dad00934ce78cbede99f976439f`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:31.429031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-17f02736-ec8a-4fc5-9193-92dded9db505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:31.433699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2f6b8-6000-4855-8738-674afa80ea75 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:31.459773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 900/1809] 10.222.0.15 () {58 vars in 1015 bytes} [Wed Aug 10 13:16:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:31.530895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 910/1810] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:31 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:31.535961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f02736-ec8a-4fc5-9193-92dded9db505 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:31.545632 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2f6b8-6000-4855-8738-674afa80ea75 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:31.592380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f02736-ec8a-4fc5-9193-92dded9db505 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:31.754687 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2f6b8-6000-4855-8738-674afa80ea75 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:31.764174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc75c6-09be-44b5-a217-a4163052a3aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:31.765029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc75c6-09be-44b5-a217-a4163052a3aa service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:31.765494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc75c6-09be-44b5-a217-a4163052a3aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:31.765782 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc75c6-09be-44b5-a217-a4163052a3aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:31.777613 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc75c6-09be-44b5-a217-a4163052a3aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:31.779432 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc75c6-09be-44b5-a217-a4163052a3aa service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:31.784054 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:31.796195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 911/1811] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:31.812185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:31.838380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836ffab-1e7d-470a-a469-22c34d4978f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:31.839248 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836ffab-1e7d-470a-a469-22c34d4978f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:31.840520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836ffab-1e7d-470a-a469-22c34d4978f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:31.840978 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836ffab-1e7d-470a-a469-22c34d4978f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:31.847196 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836ffab-1e7d-470a-a469-22c34d4978f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:31.854519 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836ffab-1e7d-470a-a469-22c34d4978f9 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:31.939415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 901/1812] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:31 2022] POST /identity/v3/users => generated 293 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:31.941481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc75c6-09be-44b5-a217-a4163052a3aa service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:31.964447 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc75c6-09be-44b5-a217-a4163052a3aa service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:31.975357 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844774eb-140c-4ea0-a985-d14d1361e13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:31.976274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844774eb-140c-4ea0-a985-d14d1361e13d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:31.976744 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844774eb-140c-4ea0-a985-d14d1361e13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:31.977248 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844774eb-140c-4ea0-a985-d14d1361e13d admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:31.980975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844774eb-140c-4ea0-a985-d14d1361e13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:31.983822 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844774eb-140c-4ea0-a985-d14d1361e13d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:32.020353 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836ffab-1e7d-470a-a469-22c34d4978f9 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:32.022537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 912/1813] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:32.067492 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836ffab-1e7d-470a-a469-22c34d4978f9 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:32.080850 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1534fc-04a9-4d2b-9dd6-dd2c83079fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:32.089087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1534fc-04a9-4d2b-9dd6-dd2c83079fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:32.089464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1534fc-04a9-4d2b-9dd6-dd2c83079fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:32.089846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1534fc-04a9-4d2b-9dd6-dd2c83079fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:32.094174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1534fc-04a9-4d2b-9dd6-dd2c83079fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:32.100689 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1534fc-04a9-4d2b-9dd6-dd2c83079fb8 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:32.173666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844774eb-140c-4ea0-a985-d14d1361e13d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:32.182888 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 902/1814] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:32.192572 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844774eb-140c-4ea0-a985-d14d1361e13d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:32.264119 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d02fb-9c7a-4b44-b4ec-8f997b4f8f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:32.275651 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d02fb-9c7a-4b44-b4ec-8f997b4f8f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:32.276058 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d02fb-9c7a-4b44-b4ec-8f997b4f8f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:32.284740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d02fb-9c7a-4b44-b4ec-8f997b4f8f67 admin admin] PATH_INFO: `/v3/projects/b9fcff0c1d0c4d41982fc149c97a5b01/users/bf64515931db49a0889bc4919d9cebcb/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:32.396098 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d02fb-9c7a-4b44-b4ec-8f997b4f8f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9fcff0c1d0c4d41982fc149c97a5b01, user_id=bf64515931db49a0889bc4919d9cebcb, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:32.398907 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d02fb-9c7a-4b44-b4ec-8f997b4f8f67 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:32.522409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 913/1815] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:32 2022] PUT /identity/v3/projects/b9fcff0c1d0c4d41982fc149c97a5b01/users/bf64515931db49a0889bc4919d9cebcb/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:32.534719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380786e-c04d-41b9-aee4-4e6c3277325c None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:32.535063 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380786e-c04d-41b9-aee4-4e6c3277325c None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:32.535346 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380786e-c04d-41b9-aee4-4e6c3277325c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:32.581548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-a380786e-c04d-41b9-aee4-4e6c3277325c None None] MFA Rules not processed for user `bf64515931db49a0889bc4919d9cebcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:32.583658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-a380786e-c04d-41b9-aee4-4e6c3277325c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:32.760083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d02fb-9c7a-4b44-b4ec-8f997b4f8f67 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:32.764958 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 903/1816] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:33.096166 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d02fb-9c7a-4b44-b4ec-8f997b4f8f67 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:33.142287 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d0eb1-5e2d-4661-9215-072fbbf23b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:33.142958 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d0eb1-5e2d-4661-9215-072fbbf23b24 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:33.143261 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d0eb1-5e2d-4661-9215-072fbbf23b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:33.143538 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d0eb1-5e2d-4661-9215-072fbbf23b24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:33.149256 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d0eb1-5e2d-4661-9215-072fbbf23b24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:33.158336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d0eb1-5e2d-4661-9215-072fbbf23b24 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:33.228313 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380786e-c04d-41b9-aee4-4e6c3277325c None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:33.232111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-a380786e-c04d-41b9-aee4-4e6c3277325c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:33.260584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 914/1817] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:32 2022] POST /identity/v3/projects => generated 387 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:33.264993 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d0eb1-5e2d-4661-9215-072fbbf23b24 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:33.288260 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380786e-c04d-41b9-aee4-4e6c3277325c None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:33.503611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04d7f3-0e25-45f0-a14e-cc54d4dffa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:33.508281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04d7f3-0e25-45f0-a14e-cc54d4dffa5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:33.508726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04d7f3-0e25-45f0-a14e-cc54d4dffa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:33.509072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04d7f3-0e25-45f0-a14e-cc54d4dffa5e admin admin] PATH_INFO: `/v3/users/873fdc0011c44fcf9fc496827ea762fb` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:33.512251 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04d7f3-0e25-45f0-a14e-cc54d4dffa5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=873fdc0011c44fcf9fc496827ea762fb)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:33.521727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04d7f3-0e25-45f0-a14e-cc54d4dffa5e admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:33.571877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d0eb1-5e2d-4661-9215-072fbbf23b24 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:33.606365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8031959-c6bf-4ff0-b025-f0a8a9a619ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:33.607674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8031959-c6bf-4ff0-b025-f0a8a9a619ca admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:33.612861 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8031959-c6bf-4ff0-b025-f0a8a9a619ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:33.614575 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8031959-c6bf-4ff0-b025-f0a8a9a619ca admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:33.622748 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8031959-c6bf-4ff0-b025-f0a8a9a619ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:33.634870 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8031959-c6bf-4ff0-b025-f0a8a9a619ca admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:33.686033 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-cc04d7f3-0e25-45f0-a14e-cc54d4dffa5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '873fdc0011c44fcf9fc496827ea762fb'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:33.688184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-cc04d7f3-0e25-45f0-a14e-cc54d4dffa5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '873fdc0011c44fcf9fc496827ea762fb'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:33.710444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-cc04d7f3-0e25-45f0-a14e-cc54d4dffa5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '873fdc0011c44fcf9fc496827ea762fb'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:33.728634 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 915/1818] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:33 2022] POST /identity/v3/users => generated 300 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:33.734042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-cc04d7f3-0e25-45f0-a14e-cc54d4dffa5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '873fdc0011c44fcf9fc496827ea762fb'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:33.736294 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8031959-c6bf-4ff0-b025-f0a8a9a619ca admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:33.739171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:33.742509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c8031959-c6bf-4ff0-b025-f0a8a9a619ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:33.772057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-cc04d7f3-0e25-45f0-a14e-cc54d4dffa5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '873fdc0011c44fcf9fc496827ea762fb'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:33.792909 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8031959-c6bf-4ff0-b025-f0a8a9a619ca admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:33.800840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 904/1819] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:33 2022] DELETE /identity/v3/users/873fdc0011c44fcf9fc496827ea762fb => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:33.802654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f29b1-a6c5-4151-8d31-f37bf53120c9 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:33.804504 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f29b1-a6c5-4151-8d31-f37bf53120c9 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:33.805027 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f29b1-a6c5-4151-8d31-f37bf53120c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:33.854565 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-f98f29b1-a6c5-4151-8d31-f37bf53120c9 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:33.856140 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-f98f29b1-a6c5-4151-8d31-f37bf53120c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:33.930431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:33.953044 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 905/1820] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:33.999425 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc721f-5694-43f1-8e2e-edbb39cbe1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:34.000423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc721f-5694-43f1-8e2e-edbb39cbe1cd admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:34.000423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc721f-5694-43f1-8e2e-edbb39cbe1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:34.000674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc721f-5694-43f1-8e2e-edbb39cbe1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:34.001622 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc721f-5694-43f1-8e2e-edbb39cbe1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:34.002995 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc721f-5694-43f1-8e2e-edbb39cbe1cd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:34.027565 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 916/1821] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:34.037109 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f29b1-a6c5-4151-8d31-f37bf53120c9 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:34.076900 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc721f-5694-43f1-8e2e-edbb39cbe1cd admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:34.094565 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fabc721f-5694-43f1-8e2e-edbb39cbe1cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:34.111065 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f29b1-a6c5-4151-8d31-f37bf53120c9 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:34.135856 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d415fa-6aac-4562-af45-9b6af82ba48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:34.138523 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d415fa-6aac-4562-af45-9b6af82ba48f admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:34.139145 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d415fa-6aac-4562-af45-9b6af82ba48f admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:34.140484 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d415fa-6aac-4562-af45-9b6af82ba48f admin admin] PATH_INFO: `/v3/projects/82342ebc56a84e37bc960f504775b285/users/8a666e4a85fb4d11a1cec556e44bce36/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:34.214554 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d415fa-6aac-4562-af45-9b6af82ba48f admin admin] RBAC: Authorizing `identity:create_grant(project_id=82342ebc56a84e37bc960f504775b285, user_id=8a666e4a85fb4d11a1cec556e44bce36, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:34.222240 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d415fa-6aac-4562-af45-9b6af82ba48f admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:34.286213 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 906/1822] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:34 2022] PUT /identity/v3/projects/82342ebc56a84e37bc960f504775b285/users/8a666e4a85fb4d11a1cec556e44bce36/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:34.288787 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d415fa-6aac-4562-af45-9b6af82ba48f admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:34.296285 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-58d415fa-6aac-4562-af45-9b6af82ba48f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:34.426135 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc721f-5694-43f1-8e2e-edbb39cbe1cd admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:34.571855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d415fa-6aac-4562-af45-9b6af82ba48f admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:34.594570 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74866b88-67ba-430e-9c23-ba7f57266aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:34.595636 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74866b88-67ba-430e-9c23-ba7f57266aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:34.596157 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74866b88-67ba-430e-9c23-ba7f57266aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:34.596709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74866b88-67ba-430e-9c23-ba7f57266aec admin admin] PATH_INFO: `/v3/projects/fe45239343d04525bffe9aa4162e0cce` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:34.598145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034fa48-c30b-4cc3-87b9-5184ed56c615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:34.601704 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034fa48-c30b-4cc3-87b9-5184ed56c615 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:34.602195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034fa48-c30b-4cc3-87b9-5184ed56c615 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:34.602676 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034fa48-c30b-4cc3-87b9-5184ed56c615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:34.617524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74866b88-67ba-430e-9c23-ba7f57266aec admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe45239343d04525bffe9aa4162e0cce)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:34.621393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74866b88-67ba-430e-9c23-ba7f57266aec admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:34.638175 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034fa48-c30b-4cc3-87b9-5184ed56c615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:34.643977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034fa48-c30b-4cc3-87b9-5184ed56c615 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:34.710787 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 917/1823] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:34.712204 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034fa48-c30b-4cc3-87b9-5184ed56c615 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:34.730859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034fa48-c30b-4cc3-87b9-5184ed56c615 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:34.772388 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc3563-b696-43f8-98c3-4edafe16e8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:34.773029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc3563-b696-43f8-98c3-4edafe16e8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:34.773310 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc3563-b696-43f8-98c3-4edafe16e8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:34.773583 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc3563-b696-43f8-98c3-4edafe16e8d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:34.774240 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc3563-b696-43f8-98c3-4edafe16e8d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:34.775893 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc3563-b696-43f8-98c3-4edafe16e8d8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:34.802555 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-74866b88-67ba-430e-9c23-ba7f57266aec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe45239343d04525bffe9aa4162e0cce', 'request_id': 'req-74866b88-67ba-430e-9c23-ba7f57266aec'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:34.825536 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-74866b88-67ba-430e-9c23-ba7f57266aec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe45239343d04525bffe9aa4162e0cce', 'request_id': 'req-74866b88-67ba-430e-9c23-ba7f57266aec'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:34.826868 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 918/1824] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:34.830630 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc3563-b696-43f8-98c3-4edafe16e8d8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:34.830992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:34.848056 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-93cc3563-b696-43f8-98c3-4edafe16e8d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:34.853260 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-74866b88-67ba-430e-9c23-ba7f57266aec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe45239343d04525bffe9aa4162e0cce', 'request_id': 'req-74866b88-67ba-430e-9c23-ba7f57266aec'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:34.881692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-74866b88-67ba-430e-9c23-ba7f57266aec admin admin] The token cache is being invalidate because project fe45239343d04525bffe9aa4162e0cce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:34.881993 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-74866b88-67ba-430e-9c23-ba7f57266aec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:34.882699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-74866b88-67ba-430e-9c23-ba7f57266aec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:34.887780 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 907/1825] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:34 2022] DELETE /identity/v3/projects/fe45239343d04525bffe9aa4162e0cce => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:34.888509 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74866b88-67ba-430e-9c23-ba7f57266aec admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:34.895386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc3563-b696-43f8-98c3-4edafe16e8d8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:34.897459 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-74866b88-67ba-430e-9c23-ba7f57266aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:35.069360 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bf328-925c-45f9-b3c5-53c010d320ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:35.070008 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bf328-925c-45f9-b3c5-53c010d320ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:35.070289 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bf328-925c-45f9-b3c5-53c010d320ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:35.070560 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bf328-925c-45f9-b3c5-53c010d320ea admin admin] PATH_INFO: `/v3/users/d895566411594765bb4265b46503b594` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:35.071753 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bf328-925c-45f9-b3c5-53c010d320ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=d895566411594765bb4265b46503b594)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:35.073712 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bf328-925c-45f9-b3c5-53c010d320ea admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:35.081397 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74866b88-67ba-430e-9c23-ba7f57266aec admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:35.106612 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a9f8d-49a2-4578-bbef-dbd44f361ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:35.108712 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a9f8d-49a2-4578-bbef-dbd44f361ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:35.109004 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a9f8d-49a2-4578-bbef-dbd44f361ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:35.110473 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a9f8d-49a2-4578-bbef-dbd44f361ffb admin admin] PATH_INFO: `/v3/projects/82342ebc56a84e37bc960f504775b285/users/8a666e4a85fb4d11a1cec556e44bce36/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:35.116758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a9f8d-49a2-4578-bbef-dbd44f361ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=82342ebc56a84e37bc960f504775b285, user_id=8a666e4a85fb4d11a1cec556e44bce36, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:35.129605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a9f8d-49a2-4578-bbef-dbd44f361ffb admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:35.158485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 908/1826] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:34 2022] PUT /identity/v3/projects/82342ebc56a84e37bc960f504775b285/users/8a666e4a85fb4d11a1cec556e44bce36/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:35.175547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a9f8d-49a2-4578-bbef-dbd44f361ffb admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:35.179942 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-697a9f8d-49a2-4578-bbef-dbd44f361ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:35.181115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:35.222520 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-842bf328-925c-45f9-b3c5-53c010d320ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd895566411594765bb4265b46503b594'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:35.223968 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-842bf328-925c-45f9-b3c5-53c010d320ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd895566411594765bb4265b46503b594'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:35.233066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-842bf328-925c-45f9-b3c5-53c010d320ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd895566411594765bb4265b46503b594'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:35.248725 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-842bf328-925c-45f9-b3c5-53c010d320ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd895566411594765bb4265b46503b594'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:35.312854 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-842bf328-925c-45f9-b3c5-53c010d320ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd895566411594765bb4265b46503b594'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:35.330216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 919/1827] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:34 2022] DELETE /identity/v3/users/d895566411594765bb4265b46503b594 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:35.332930 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826df1a-4136-478c-af33-0df8c6b07288 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:35.333291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826df1a-4136-478c-af33-0df8c6b07288 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:35.333575 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826df1a-4136-478c-af33-0df8c6b07288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:35.357383 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a9f8d-49a2-4578-bbef-dbd44f361ffb admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:35.440284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e826df1a-4136-478c-af33-0df8c6b07288 None None] MFA Rules not processed for user `8a666e4a85fb4d11a1cec556e44bce36`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:35.451613 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e826df1a-4136-478c-af33-0df8c6b07288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:35.568911 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc8a6d-a35b-4a21-b802-85ee4d8be621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:35.569963 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc8a6d-a35b-4a21-b802-85ee4d8be621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:35.570306 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc8a6d-a35b-4a21-b802-85ee4d8be621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:35.570676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc8a6d-a35b-4a21-b802-85ee4d8be621 admin admin] PATH_INFO: `/v3/users/91aa913c5a2148ad955d00c498fb4020` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:35.572124 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc8a6d-a35b-4a21-b802-85ee4d8be621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91aa913c5a2148ad955d00c498fb4020)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:35.574480 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc8a6d-a35b-4a21-b802-85ee4d8be621 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:35.639096 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:INSERT=2,keystone:DELETE=6,keystone:SELECT=92 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:35.669040 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 920/1828] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:35.670576 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70cf35-25ce-48f2-b668-a14ed49b97cc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:35.670839 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70cf35-25ce-48f2-b668-a14ed49b97cc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:35.671140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70cf35-25ce-48f2-b668-a14ed49b97cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:35.690196 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-81bc8a6d-a35b-4a21-b802-85ee4d8be621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91aa913c5a2148ad955d00c498fb4020'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:35.691367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-81bc8a6d-a35b-4a21-b802-85ee4d8be621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91aa913c5a2148ad955d00c498fb4020'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:35.709773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-81bc8a6d-a35b-4a21-b802-85ee4d8be621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91aa913c5a2148ad955d00c498fb4020'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:35.717325 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-cb70cf35-25ce-48f2-b668-a14ed49b97cc None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:35.719091 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cb70cf35-25ce-48f2-b668-a14ed49b97cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:35.724956 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-81bc8a6d-a35b-4a21-b802-85ee4d8be621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91aa913c5a2148ad955d00c498fb4020'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:35.733601 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 921/1829] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:35.734918 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70cf35-25ce-48f2-b668-a14ed49b97cc None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:35.739189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cb70cf35-25ce-48f2-b668-a14ed49b97cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:35.782290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-81bc8a6d-a35b-4a21-b802-85ee4d8be621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91aa913c5a2148ad955d00c498fb4020'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:35.792144 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 909/1830] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:35 2022] DELETE /identity/v3/users/91aa913c5a2148ad955d00c498fb4020 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:35.826090 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc8a6d-a35b-4a21-b802-85ee4d8be621 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:35.828527 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-81bc8a6d-a35b-4a21-b802-85ee4d8be621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:35.874187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70cf35-25ce-48f2-b668-a14ed49b97cc None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:35.933526 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:35.987143 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14e35a-b590-40d8-b584-5c6ce93aeb00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:35.988490 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14e35a-b590-40d8-b584-5c6ce93aeb00 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:35.989647 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14e35a-b590-40d8-b584-5c6ce93aeb00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:35.990140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14e35a-b590-40d8-b584-5c6ce93aeb00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:36.002644 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6a14e35a-b590-40d8-b584-5c6ce93aeb00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:36.005260 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc8a6d-a35b-4a21-b802-85ee4d8be621 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:36.012197 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbb44f-b0b3-48dc-800c-bd27f49b9135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:36.013355 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbb44f-b0b3-48dc-800c-bd27f49b9135 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:36.014087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbb44f-b0b3-48dc-800c-bd27f49b9135 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:36.014489 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbb44f-b0b3-48dc-800c-bd27f49b9135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:36.218483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14e35a-b590-40d8-b584-5c6ce93aeb00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:36.221011 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14e35a-b590-40d8-b584-5c6ce93aeb00 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:36.231796 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbb44f-b0b3-48dc-800c-bd27f49b9135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:36.237283 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbb44f-b0b3-48dc-800c-bd27f49b9135 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:36.252307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 922/1831] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:35 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:36.256490 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 910/1832] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:16:38.012805 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14e35a-b590-40d8-b584-5c6ce93aeb00 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:38.016953 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6a14e35a-b590-40d8-b584-5c6ce93aeb00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:38.078322 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14e35a-b590-40d8-b584-5c6ce93aeb00 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:38.086040 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f87be-4654-4a17-96c4-6620fa854baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:38.086814 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f87be-4654-4a17-96c4-6620fa854baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:38.087129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f87be-4654-4a17-96c4-6620fa854baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:38.089686 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f87be-4654-4a17-96c4-6620fa854baa admin admin] PATH_INFO: `/v3/users/bf64515931db49a0889bc4919d9cebcb` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:38.093769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f87be-4654-4a17-96c4-6620fa854baa admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf64515931db49a0889bc4919d9cebcb)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:38.098660 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f87be-4654-4a17-96c4-6620fa854baa admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:38.292048 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ca5f87be-4654-4a17-96c4-6620fa854baa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf64515931db49a0889bc4919d9cebcb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:38.294687 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ca5f87be-4654-4a17-96c4-6620fa854baa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf64515931db49a0889bc4919d9cebcb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:38.314543 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ca5f87be-4654-4a17-96c4-6620fa854baa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf64515931db49a0889bc4919d9cebcb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:38.356415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ca5f87be-4654-4a17-96c4-6620fa854baa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf64515931db49a0889bc4919d9cebcb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:38.391842 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ca5f87be-4654-4a17-96c4-6620fa854baa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf64515931db49a0889bc4919d9cebcb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:38.426965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 923/1833] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:38 2022] DELETE /identity/v3/users/bf64515931db49a0889bc4919d9cebcb => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:38.432205 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415797fe-6e7b-4d63-b2f3-91370bd7a667 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:38.433134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415797fe-6e7b-4d63-b2f3-91370bd7a667 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:38.433134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415797fe-6e7b-4d63-b2f3-91370bd7a667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:38.484399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-415797fe-6e7b-4d63-b2f3-91370bd7a667 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:38.498103 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-415797fe-6e7b-4d63-b2f3-91370bd7a667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:38.553940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5ef58-4266-4756-a7e1-f3b6cabbd073 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:38.554740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5ef58-4266-4756-a7e1-f3b6cabbd073 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:38.557501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5ef58-4266-4756-a7e1-f3b6cabbd073 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:38.564321 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 924/1834] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 10 13:16:38 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:16:38.601443 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b658040-d9fc-4277-815f-0fe9217dc4b4 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:38.601894 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b658040-d9fc-4277-815f-0fe9217dc4b4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:38.602262 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b658040-d9fc-4277-815f-0fe9217dc4b4 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:38.605711 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 925/1835] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 10 13:16:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:16:38.616281 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8112c0d-561a-4b32-a166-2828afc971c3 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:38.616920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8112c0d-561a-4b32-a166-2828afc971c3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:38.617333 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8112c0d-561a-4b32-a166-2828afc971c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:38.693205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d8112c0d-561a-4b32-a166-2828afc971c3 None None] MFA Rules not processed for user `7fd0f76f24ea481191dfd65fff2376af`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:38.701421 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d8112c0d-561a-4b32-a166-2828afc971c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:38.742222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:38.787404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 911/1836] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:38.791851 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d811fdb-7aba-49a3-9ad0-174c9bba43f1 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:38.792142 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d811fdb-7aba-49a3-9ad0-174c9bba43f1 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:38.792418 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d811fdb-7aba-49a3-9ad0-174c9bba43f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:38.832599 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:38.845375 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-1d811fdb-7aba-49a3-9ad0-174c9bba43f1 None None] MFA Rules not processed for user `7fd0f76f24ea481191dfd65fff2376af`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:38.851192 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-1d811fdb-7aba-49a3-9ad0-174c9bba43f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:38.873845 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 926/1837] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 10 13:16:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:38.891853 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 912/1838] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 10 13:16:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:38.940392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8112c0d-561a-4b32-a166-2828afc971c3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:38.942426 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d8112c0d-561a-4b32-a166-2828afc971c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:38.947946 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d811fdb-7aba-49a3-9ad0-174c9bba43f1 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:38.950782 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-1d811fdb-7aba-49a3-9ad0-174c9bba43f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:39.005240 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d811fdb-7aba-49a3-9ad0-174c9bba43f1 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:39.026906 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d64d1-b7b8-4f46-9ce3-13b12ec0e672 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:39.029200 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d64d1-b7b8-4f46-9ce3-13b12ec0e672 service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:39.030771 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d64d1-b7b8-4f46-9ce3-13b12ec0e672 service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:39.031854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d64d1-b7b8-4f46-9ce3-13b12ec0e672 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:39.079587 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d64d1-b7b8-4f46-9ce3-13b12ec0e672 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:39.082727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d64d1-b7b8-4f46-9ce3-13b12ec0e672 service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:39.104937 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 913/1839] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:16:39.111892 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8112c0d-561a-4b32-a166-2828afc971c3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:39.123972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7796963-4ec1-485f-bb94-183eaef0476c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:39.124657 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7796963-4ec1-485f-bb94-183eaef0476c service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:39.125041 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7796963-4ec1-485f-bb94-183eaef0476c service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:39.125348 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7796963-4ec1-485f-bb94-183eaef0476c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:39.150405 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7796963-4ec1-485f-bb94-183eaef0476c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:39.152099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7796963-4ec1-485f-bb94-183eaef0476c service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:39.191880 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 927/1840] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:39.544960 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fca67e-da3f-4374-98f1-1d460bcb4744 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:39.545558 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fca67e-da3f-4374-98f1-1d460bcb4744 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:39.545558 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fca67e-da3f-4374-98f1-1d460bcb4744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:39.585292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-23fca67e-da3f-4374-98f1-1d460bcb4744 None None] MFA Rules not processed for user `0ed48747fc084496ba252279614be4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:39.586607 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-23fca67e-da3f-4374-98f1-1d460bcb4744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:39.727155 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 914/1841] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:39.779874 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7796963-4ec1-485f-bb94-183eaef0476c service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:39.781566 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c7796963-4ec1-485f-bb94-183eaef0476c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:39.818481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7796963-4ec1-485f-bb94-183eaef0476c service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:39.832930 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be21f1b-2206-4b42-9017-11ba3804b993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:39.833386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be21f1b-2206-4b42-9017-11ba3804b993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:39.833673 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be21f1b-2206-4b42-9017-11ba3804b993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:39.833950 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be21f1b-2206-4b42-9017-11ba3804b993 admin admin] PATH_INFO: `/v3/projects/1ad907617df942b9bd33f9dbc30aca65` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:39.836307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be21f1b-2206-4b42-9017-11ba3804b993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ad907617df942b9bd33f9dbc30aca65)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:39.843695 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be21f1b-2206-4b42-9017-11ba3804b993 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:39.995087 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5be21f1b-2206-4b42-9017-11ba3804b993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ad907617df942b9bd33f9dbc30aca65', 'request_id': 'req-5be21f1b-2206-4b42-9017-11ba3804b993'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:40.008510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5be21f1b-2206-4b42-9017-11ba3804b993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ad907617df942b9bd33f9dbc30aca65', 'request_id': 'req-5be21f1b-2206-4b42-9017-11ba3804b993'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:40.010072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fca67e-da3f-4374-98f1-1d460bcb4744 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:40.015614 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-23fca67e-da3f-4374-98f1-1d460bcb4744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:40.019456 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5be21f1b-2206-4b42-9017-11ba3804b993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ad907617df942b9bd33f9dbc30aca65', 'request_id': 'req-5be21f1b-2206-4b42-9017-11ba3804b993'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:40.043556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fca67e-da3f-4374-98f1-1d460bcb4744 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:40.052305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5be21f1b-2206-4b42-9017-11ba3804b993 admin admin] The token cache is being invalidate because project 1ad907617df942b9bd33f9dbc30aca65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:40.052683 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5be21f1b-2206-4b42-9017-11ba3804b993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:40.053369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5be21f1b-2206-4b42-9017-11ba3804b993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:40.060335 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 928/1842] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:39 2022] DELETE /identity/v3/projects/1ad907617df942b9bd33f9dbc30aca65 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:40.061998 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff5c8a-6a0f-4d59-b848-dd76c8de7711 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:40.062291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff5c8a-6a0f-4d59-b848-dd76c8de7711 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:40.062569 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff5c8a-6a0f-4d59-b848-dd76c8de7711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:40.129209 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b8ff5c8a-6a0f-4d59-b848-dd76c8de7711 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:40.149854 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b8ff5c8a-6a0f-4d59-b848-dd76c8de7711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:40.196971 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bb722-da4d-4891-aa62-928cdac10be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:40.197952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bb722-da4d-4891-aa62-928cdac10be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:40.198580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bb722-da4d-4891-aa62-928cdac10be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:40.198956 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bb722-da4d-4891-aa62-928cdac10be2 admin admin] PATH_INFO: `/v3/projects/98bb64b8627f450caecf6e1bcfa40adf` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:40.207246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bb722-da4d-4891-aa62-928cdac10be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98bb64b8627f450caecf6e1bcfa40adf)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:40.209860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bb722-da4d-4891-aa62-928cdac10be2 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:40.352213 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-264bb722-da4d-4891-aa62-928cdac10be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98bb64b8627f450caecf6e1bcfa40adf', 'request_id': 'req-264bb722-da4d-4891-aa62-928cdac10be2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:40.407604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-264bb722-da4d-4891-aa62-928cdac10be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98bb64b8627f450caecf6e1bcfa40adf', 'request_id': 'req-264bb722-da4d-4891-aa62-928cdac10be2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:40.448947 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-264bb722-da4d-4891-aa62-928cdac10be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98bb64b8627f450caecf6e1bcfa40adf', 'request_id': 'req-264bb722-da4d-4891-aa62-928cdac10be2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:40.495114 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 929/1843] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:40.513720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4501fa-b068-4c1c-80b4-a8e0bd8eb60e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:40.514816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4501fa-b068-4c1c-80b4-a8e0bd8eb60e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:40.515273 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4501fa-b068-4c1c-80b4-a8e0bd8eb60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:40.533031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-264bb722-da4d-4891-aa62-928cdac10be2 admin admin] The token cache is being invalidate because project 98bb64b8627f450caecf6e1bcfa40adf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:40.533522 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-264bb722-da4d-4891-aa62-928cdac10be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:40.540209 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-264bb722-da4d-4891-aa62-928cdac10be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:40.549318 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 915/1844] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:40 2022] DELETE /identity/v3/projects/98bb64b8627f450caecf6e1bcfa40adf => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:40.554355 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bb722-da4d-4891-aa62-928cdac10be2 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:40.557739 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-264bb722-da4d-4891-aa62-928cdac10be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:40.598437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fc4501fa-b068-4c1c-80b4-a8e0bd8eb60e None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:40.605315 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fc4501fa-b068-4c1c-80b4-a8e0bd8eb60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:40.634297 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:40.676200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:40.774504 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 930/1845] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:40.778844 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4501fa-b068-4c1c-80b4-a8e0bd8eb60e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:40.797292 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4501fa-b068-4c1c-80b4-a8e0bd8eb60e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:40.803651 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0b7b7-30f4-49b0-895d-cb11c9efe2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:40.804561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0b7b7-30f4-49b0-895d-cb11c9efe2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:40.805023 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0b7b7-30f4-49b0-895d-cb11c9efe2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:40.805443 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0b7b7-30f4-49b0-895d-cb11c9efe2f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:40.806488 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0b7b7-30f4-49b0-895d-cb11c9efe2f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:16:40.807063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0b7b7-30f4-49b0-895d-cb11c9efe2f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:40.809074 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0b7b7-30f4-49b0-895d-cb11c9efe2f6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:40.813134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bb722-da4d-4891-aa62-928cdac10be2 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:40.826011 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 931/1846] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:16:40.830769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0b7b7-30f4-49b0-895d-cb11c9efe2f6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:40.838977 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af8faf-2bfa-4880-89a5-a0c83daec417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:40.840433 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af8faf-2bfa-4880-89a5-a0c83daec417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:40.840686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af8faf-2bfa-4880-89a5-a0c83daec417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:40.840977 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af8faf-2bfa-4880-89a5-a0c83daec417 admin admin] PATH_INFO: `/v3/users/51084a47aac9475d857fd664a6546a2c` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:40.842364 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af8faf-2bfa-4880-89a5-a0c83daec417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51084a47aac9475d857fd664a6546a2c)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:40.846761 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af8faf-2bfa-4880-89a5-a0c83daec417 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:40.853394 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0b7b7-30f4-49b0-895d-cb11c9efe2f6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:40.871416 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2a872-e1c1-4cbd-9124-a68426a5256f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:40.872335 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2a872-e1c1-4cbd-9124-a68426a5256f admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:40.872641 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2a872-e1c1-4cbd-9124-a68426a5256f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:40.872894 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2a872-e1c1-4cbd-9124-a68426a5256f admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:40.873565 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2a872-e1c1-4cbd-9124-a68426a5256f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:40.875610 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2a872-e1c1-4cbd-9124-a68426a5256f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:40.948867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 932/1847] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:40 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:16:40.950201 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2a872-e1c1-4cbd-9124-a68426a5256f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:40.985263 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d5af8faf-2bfa-4880-89a5-a0c83daec417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51084a47aac9475d857fd664a6546a2c'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:40.989963 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d5af8faf-2bfa-4880-89a5-a0c83daec417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51084a47aac9475d857fd664a6546a2c'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:41.022889 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d5af8faf-2bfa-4880-89a5-a0c83daec417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51084a47aac9475d857fd664a6546a2c'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:41.043594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d5af8faf-2bfa-4880-89a5-a0c83daec417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51084a47aac9475d857fd664a6546a2c'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:41.085652 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d5af8faf-2bfa-4880-89a5-a0c83daec417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51084a47aac9475d857fd664a6546a2c'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:41.115486 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 916/1848] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:40 2022] DELETE /identity/v3/users/51084a47aac9475d857fd664a6546a2c => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:41.154123 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2a872-e1c1-4cbd-9124-a68426a5256f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:41.233614 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af8faf-2bfa-4880-89a5-a0c83daec417 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:41.236500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d5af8faf-2bfa-4880-89a5-a0c83daec417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:41.413600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002fbc0-c1c5-4190-b227-7f8b5a22d700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:41.414255 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002fbc0-c1c5-4190-b227-7f8b5a22d700 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:41.414537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002fbc0-c1c5-4190-b227-7f8b5a22d700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:41.414813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002fbc0-c1c5-4190-b227-7f8b5a22d700 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:41.415552 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002fbc0-c1c5-4190-b227-7f8b5a22d700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:41.417658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002fbc0-c1c5-4190-b227-7f8b5a22d700 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:41.481329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 933/1849] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:40 2022] POST /identity/v3/users => generated 293 bytes in 531 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:41.485979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002fbc0-c1c5-4190-b227-7f8b5a22d700 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:41.509316 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af8faf-2bfa-4880-89a5-a0c83daec417 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:41.512332 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a002fbc0-c1c5-4190-b227-7f8b5a22d700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:41.519745 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac62686-e2aa-4996-9320-73059626e811 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:41.521249 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac62686-e2aa-4996-9320-73059626e811 service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:41.521975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac62686-e2aa-4996-9320-73059626e811 service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:41.522648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac62686-e2aa-4996-9320-73059626e811 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:41.526511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-aac62686-e2aa-4996-9320-73059626e811 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:41.557634 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac62686-e2aa-4996-9320-73059626e811 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:41.562313 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac62686-e2aa-4996-9320-73059626e811 service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:41.586643 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 917/1850] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:16:41.614130 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002fbc0-c1c5-4190-b227-7f8b5a22d700 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:41.647256 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5824b70-49c1-40da-9807-6cdc8c3cacb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:41.648616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5824b70-49c1-40da-9807-6cdc8c3cacb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:41.650609 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5824b70-49c1-40da-9807-6cdc8c3cacb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:41.650609 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5824b70-49c1-40da-9807-6cdc8c3cacb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:41.651096 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5824b70-49c1-40da-9807-6cdc8c3cacb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:41.670121 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5824b70-49c1-40da-9807-6cdc8c3cacb6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:41.738412 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 934/1851] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:41.740120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac62686-e2aa-4996-9320-73059626e811 service nova] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:41.757405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac62686-e2aa-4996-9320-73059626e811 service nova] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:41.779322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724bcdb-ecd4-4734-bb08-e8f372787ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:41.781524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724bcdb-ecd4-4734-bb08-e8f372787ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:41.782021 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724bcdb-ecd4-4734-bb08-e8f372787ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:41.782784 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724bcdb-ecd4-4734-bb08-e8f372787ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:41.784331 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724bcdb-ecd4-4734-bb08-e8f372787ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:41.796103 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724bcdb-ecd4-4734-bb08-e8f372787ef5 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:41.813764 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 918/1852] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:41.818873 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5824b70-49c1-40da-9807-6cdc8c3cacb6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:41.839771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5824b70-49c1-40da-9807-6cdc8c3cacb6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:41.866010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1758d98-d979-4790-ae4f-075c112ff3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:41.867335 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1758d98-d979-4790-ae4f-075c112ff3a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:41.867934 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1758d98-d979-4790-ae4f-075c112ff3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:41.868437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1758d98-d979-4790-ae4f-075c112ff3a4 admin admin] PATH_INFO: `/v3/projects/936ce75e78b14b7c904aeb20651105f9/users/959df2f1f4dd4c1789e0ee41070d3692/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:41.872119 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:41.917610 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1758d98-d979-4790-ae4f-075c112ff3a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936ce75e78b14b7c904aeb20651105f9, user_id=959df2f1f4dd4c1789e0ee41070d3692, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:41.929262 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1758d98-d979-4790-ae4f-075c112ff3a4 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:42.010409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 935/1853] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:41 2022] PUT /identity/v3/projects/936ce75e78b14b7c904aeb20651105f9/users/959df2f1f4dd4c1789e0ee41070d3692/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:42.026494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f23826-19cf-4e47-9557-51c6482c898f None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:42.027147 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f23826-19cf-4e47-9557-51c6482c898f None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:42.027719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f23826-19cf-4e47-9557-51c6482c898f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:42.056174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:42.082004 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-b3f23826-19cf-4e47-9557-51c6482c898f None None] MFA Rules not processed for user `959df2f1f4dd4c1789e0ee41070d3692`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:42.084868 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-b3f23826-19cf-4e47-9557-51c6482c898f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:42.093355 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1758d98-d979-4790-ae4f-075c112ff3a4 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:42.095704 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b1758d98-d979-4790-ae4f-075c112ff3a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:42.252943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1758d98-d979-4790-ae4f-075c112ff3a4 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:42.271087 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21e220-99ae-49ce-8911-76c4c361fa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:42.271087 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21e220-99ae-49ce-8911-76c4c361fa78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:42.271087 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21e220-99ae-49ce-8911-76c4c361fa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:42.271087 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21e220-99ae-49ce-8911-76c4c361fa78 admin admin] PATH_INFO: `/v3/projects/1586c9da911949d98678fe7fc0516c18` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:42.271533 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21e220-99ae-49ce-8911-76c4c361fa78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1586c9da911949d98678fe7fc0516c18)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:42.279782 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21e220-99ae-49ce-8911-76c4c361fa78 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:42.297932 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 919/1854] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:42.299335 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f23826-19cf-4e47-9557-51c6482c898f None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:42.380354 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f23826-19cf-4e47-9557-51c6482c898f None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:42.406330 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7e52b-b5da-4b46-a20a-e564be9284c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:42.407679 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7e52b-b5da-4b46-a20a-e564be9284c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:42.408315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7e52b-b5da-4b46-a20a-e564be9284c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:42.408862 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7e52b-b5da-4b46-a20a-e564be9284c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:42.410782 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7e52b-b5da-4b46-a20a-e564be9284c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:42.421727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8c21e220-99ae-49ce-8911-76c4c361fa78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1586c9da911949d98678fe7fc0516c18', 'request_id': 'req-8c21e220-99ae-49ce-8911-76c4c361fa78'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:42.427928 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7e52b-b5da-4b46-a20a-e564be9284c3 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:42.435885 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8c21e220-99ae-49ce-8911-76c4c361fa78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1586c9da911949d98678fe7fc0516c18', 'request_id': 'req-8c21e220-99ae-49ce-8911-76c4c361fa78'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:42.449405 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8c21e220-99ae-49ce-8911-76c4c361fa78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1586c9da911949d98678fe7fc0516c18', 'request_id': 'req-8c21e220-99ae-49ce-8911-76c4c361fa78'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:42.477207 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8c21e220-99ae-49ce-8911-76c4c361fa78 admin admin] The token cache is being invalidate because project 1586c9da911949d98678fe7fc0516c18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:42.477669 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8c21e220-99ae-49ce-8911-76c4c361fa78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:42.480265 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8c21e220-99ae-49ce-8911-76c4c361fa78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:42.488038 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 936/1855] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:42 2022] DELETE /identity/v3/projects/1586c9da911949d98678fe7fc0516c18 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:42.493823 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21e220-99ae-49ce-8911-76c4c361fa78 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:42.503224 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8c21e220-99ae-49ce-8911-76c4c361fa78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:42.531813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 920/1856] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:42 2022] POST /identity/v3/projects => generated 387 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:42.539394 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7e52b-b5da-4b46-a20a-e564be9284c3 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:42.543349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-02e7e52b-b5da-4b46-a20a-e564be9284c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:42.685106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21e220-99ae-49ce-8911-76c4c361fa78 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:42.702535 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abb2b9-1250-4e30-a3fd-629d04436e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:42.706245 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abb2b9-1250-4e30-a3fd-629d04436e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:42.707287 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abb2b9-1250-4e30-a3fd-629d04436e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:42.707787 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abb2b9-1250-4e30-a3fd-629d04436e5e admin admin] PATH_INFO: `/v3/users/1b54800713a64b6184bbb0c1b44680f3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:42.716114 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abb2b9-1250-4e30-a3fd-629d04436e5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b54800713a64b6184bbb0c1b44680f3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:42.730880 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7e52b-b5da-4b46-a20a-e564be9284c3 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:42.732199 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abb2b9-1250-4e30-a3fd-629d04436e5e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:42.742367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac6c10-4b85-4107-85dc-51d52944accd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:42.743224 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac6c10-4b85-4107-85dc-51d52944accd admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:42.743635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac6c10-4b85-4107-85dc-51d52944accd admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:42.744429 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac6c10-4b85-4107-85dc-51d52944accd admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:42.747181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac6c10-4b85-4107-85dc-51d52944accd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:42.754134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac6c10-4b85-4107-85dc-51d52944accd admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:42.792081 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:42.826296 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 921/1857] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:42 2022] POST /identity/v3/users => generated 300 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:16:42.830637 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac6c10-4b85-4107-85dc-51d52944accd admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:42.873709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac6c10-4b85-4107-85dc-51d52944accd admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:42.899938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c0558-8a7a-4a64-9fc8-fe1d5f22e8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:42.902653 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c0558-8a7a-4a64-9fc8-fe1d5f22e8be admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:42.902908 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c0558-8a7a-4a64-9fc8-fe1d5f22e8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:42.905001 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c0558-8a7a-4a64-9fc8-fe1d5f22e8be admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:42.908555 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c0558-8a7a-4a64-9fc8-fe1d5f22e8be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:42.915173 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c0558-8a7a-4a64-9fc8-fe1d5f22e8be admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:42.920683 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-69abb2b9-1250-4e30-a3fd-629d04436e5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b54800713a64b6184bbb0c1b44680f3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:42.924087 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-69abb2b9-1250-4e30-a3fd-629d04436e5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b54800713a64b6184bbb0c1b44680f3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:42.956416 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-69abb2b9-1250-4e30-a3fd-629d04436e5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b54800713a64b6184bbb0c1b44680f3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:42.970696 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 922/1858] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:42.972633 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c0558-8a7a-4a64-9fc8-fe1d5f22e8be admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:42.987307 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-698c0558-8a7a-4a64-9fc8-fe1d5f22e8be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:42.993875 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-69abb2b9-1250-4e30-a3fd-629d04436e5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b54800713a64b6184bbb0c1b44680f3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:43.036608 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-69abb2b9-1250-4e30-a3fd-629d04436e5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b54800713a64b6184bbb0c1b44680f3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:43.037740 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c0558-8a7a-4a64-9fc8-fe1d5f22e8be admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:43.057497 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 937/1859] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:42 2022] DELETE /identity/v3/users/1b54800713a64b6184bbb0c1b44680f3 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:43.059745 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ff27c-488c-4601-9813-8334ca98e3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:43.061031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ff27c-488c-4601-9813-8334ca98e3d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:43.061628 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ff27c-488c-4601-9813-8334ca98e3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:43.062451 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ff27c-488c-4601-9813-8334ca98e3d4 admin admin] PATH_INFO: `/v3/projects/fd809c67064e4e4a89b50fce1f228166/users/3f179a7816da42fc8a4c1dc10971a204/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:43.100603 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ff27c-488c-4601-9813-8334ca98e3d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd809c67064e4e4a89b50fce1f228166, user_id=3f179a7816da42fc8a4c1dc10971a204, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:43.108155 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ff27c-488c-4601-9813-8334ca98e3d4 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:43.143588 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abb2b9-1250-4e30-a3fd-629d04436e5e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:43.146524 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-69abb2b9-1250-4e30-a3fd-629d04436e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:43.154623 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 923/1860] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:42 2022] PUT /identity/v3/projects/fd809c67064e4e4a89b50fce1f228166/users/3f179a7816da42fc8a4c1dc10971a204/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:43.163995 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ff27c-488c-4601-9813-8334ca98e3d4 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:43.236566 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:43.281406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abb2b9-1250-4e30-a3fd-629d04436e5e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:43.286078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c13438-6b18-4c82-ace1-f671e7249341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:43.286740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c13438-6b18-4c82-ace1-f671e7249341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:43.287044 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c13438-6b18-4c82-ace1-f671e7249341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:43.287326 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c13438-6b18-4c82-ace1-f671e7249341 admin admin] PATH_INFO: `/v3/projects/b9fcff0c1d0c4d41982fc149c97a5b01` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:43.288493 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c13438-6b18-4c82-ace1-f671e7249341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9fcff0c1d0c4d41982fc149c97a5b01)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:43.290816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c13438-6b18-4c82-ace1-f671e7249341 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:43.313129 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ff27c-488c-4601-9813-8334ca98e3d4 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:43.320605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901176ff-5ffa-48bb-9e12-30cbc330ddad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:43.321451 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901176ff-5ffa-48bb-9e12-30cbc330ddad admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:43.321955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901176ff-5ffa-48bb-9e12-30cbc330ddad admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:43.322399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901176ff-5ffa-48bb-9e12-30cbc330ddad admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:43.323433 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901176ff-5ffa-48bb-9e12-30cbc330ddad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:43.327795 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901176ff-5ffa-48bb-9e12-30cbc330ddad admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:43.355577 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 924/1861] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:16:43.359962 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901176ff-5ffa-48bb-9e12-30cbc330ddad admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:43.375964 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-26c13438-6b18-4c82-ace1-f671e7249341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9fcff0c1d0c4d41982fc149c97a5b01', 'request_id': 'req-26c13438-6b18-4c82-ace1-f671e7249341'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:43.378855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901176ff-5ffa-48bb-9e12-30cbc330ddad admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:43.389067 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-26c13438-6b18-4c82-ace1-f671e7249341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9fcff0c1d0c4d41982fc149c97a5b01', 'request_id': 'req-26c13438-6b18-4c82-ace1-f671e7249341'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:43.408381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-26c13438-6b18-4c82-ace1-f671e7249341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9fcff0c1d0c4d41982fc149c97a5b01', 'request_id': 'req-26c13438-6b18-4c82-ace1-f671e7249341'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:43.440271 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-26c13438-6b18-4c82-ace1-f671e7249341 admin admin] The token cache is being invalidate because project b9fcff0c1d0c4d41982fc149c97a5b01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:43.440660 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-26c13438-6b18-4c82-ace1-f671e7249341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:43.442835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-26c13438-6b18-4c82-ace1-f671e7249341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:43.447593 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 938/1862] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:43 2022] DELETE /identity/v3/projects/b9fcff0c1d0c4d41982fc149c97a5b01 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:16:43.449889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c13438-6b18-4c82-ace1-f671e7249341 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:43.453664 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-26c13438-6b18-4c82-ace1-f671e7249341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:43.457007 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccf81a-d14a-4479-b845-2e054cba744a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:43.457731 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccf81a-d14a-4479-b845-2e054cba744a admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:43.458043 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccf81a-d14a-4479-b845-2e054cba744a admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:43.458313 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccf81a-d14a-4479-b845-2e054cba744a admin admin] PATH_INFO: `/v3/projects/fd809c67064e4e4a89b50fce1f228166/users/3f179a7816da42fc8a4c1dc10971a204/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:43.460571 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccf81a-d14a-4479-b845-2e054cba744a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd809c67064e4e4a89b50fce1f228166, user_id=3f179a7816da42fc8a4c1dc10971a204, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:43.465288 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccf81a-d14a-4479-b845-2e054cba744a admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:43.470542 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c13438-6b18-4c82-ace1-f671e7249341 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:43.478550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 925/1863] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:43 2022] PUT /identity/v3/projects/fd809c67064e4e4a89b50fce1f228166/users/3f179a7816da42fc8a4c1dc10971a204/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:43.479573 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccf81a-d14a-4479-b845-2e054cba744a admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:43.490530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-0cccf81a-d14a-4479-b845-2e054cba744a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:43.523948 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:43.614098 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccf81a-d14a-4479-b845-2e054cba744a admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:43.627947 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907b3c1-dc89-4785-9511-ec0d67d59669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:43.629139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907b3c1-dc89-4785-9511-ec0d67d59669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:43.629422 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907b3c1-dc89-4785-9511-ec0d67d59669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:43.629827 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907b3c1-dc89-4785-9511-ec0d67d59669 admin admin] PATH_INFO: `/v3/projects/4b5e5ca9cf21445cb2776610564a706a` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:43.631937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907b3c1-dc89-4785-9511-ec0d67d59669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b5e5ca9cf21445cb2776610564a706a)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:43.634413 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8583c0f-1b96-4002-8f4a-4caa4fa47ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:43.635131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8583c0f-1b96-4002-8f4a-4caa4fa47ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:43.635411 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8583c0f-1b96-4002-8f4a-4caa4fa47ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:43.635688 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8583c0f-1b96-4002-8f4a-4caa4fa47ed2 admin admin] PATH_INFO: `/v3/users/8a666e4a85fb4d11a1cec556e44bce36` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:43.636052 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907b3c1-dc89-4785-9511-ec0d67d59669 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:43.640905 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8583c0f-1b96-4002-8f4a-4caa4fa47ed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a666e4a85fb4d11a1cec556e44bce36)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:43.644854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8583c0f-1b96-4002-8f4a-4caa4fa47ed2 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:43.706225 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2907b3c1-dc89-4785-9511-ec0d67d59669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b5e5ca9cf21445cb2776610564a706a', 'request_id': 'req-2907b3c1-dc89-4785-9511-ec0d67d59669'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:43.723904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2907b3c1-dc89-4785-9511-ec0d67d59669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b5e5ca9cf21445cb2776610564a706a', 'request_id': 'req-2907b3c1-dc89-4785-9511-ec0d67d59669'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:43.742613 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2907b3c1-dc89-4785-9511-ec0d67d59669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b5e5ca9cf21445cb2776610564a706a', 'request_id': 'req-2907b3c1-dc89-4785-9511-ec0d67d59669'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:43.748172 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d8583c0f-1b96-4002-8f4a-4caa4fa47ed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a666e4a85fb4d11a1cec556e44bce36'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:43.749649 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d8583c0f-1b96-4002-8f4a-4caa4fa47ed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a666e4a85fb4d11a1cec556e44bce36'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:43.759787 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2907b3c1-dc89-4785-9511-ec0d67d59669 admin admin] The token cache is being invalidate because project 4b5e5ca9cf21445cb2776610564a706a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:43.760104 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2907b3c1-dc89-4785-9511-ec0d67d59669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:43.761152 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2907b3c1-dc89-4785-9511-ec0d67d59669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:43.762267 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d8583c0f-1b96-4002-8f4a-4caa4fa47ed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a666e4a85fb4d11a1cec556e44bce36'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:43.763341 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 939/1864] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:43 2022] DELETE /identity/v3/projects/4b5e5ca9cf21445cb2776610564a706a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:43.771874 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405004b9-211a-4ddd-b684-4ab8e1728a18 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:43.772217 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405004b9-211a-4ddd-b684-4ab8e1728a18 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:43.772817 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405004b9-211a-4ddd-b684-4ab8e1728a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:43.774710 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:43.780085 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d8583c0f-1b96-4002-8f4a-4caa4fa47ed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a666e4a85fb4d11a1cec556e44bce36'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:43.809069 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d8583c0f-1b96-4002-8f4a-4caa4fa47ed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a666e4a85fb4d11a1cec556e44bce36'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:43.821281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 926/1865] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:43 2022] DELETE /identity/v3/users/8a666e4a85fb4d11a1cec556e44bce36 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:43.823281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c043df3-bdb7-4144-b13f-29da918c4445 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:43.823924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c043df3-bdb7-4144-b13f-29da918c4445 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:43.824405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c043df3-bdb7-4144-b13f-29da918c4445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:43.833736 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-405004b9-211a-4ddd-b684-4ab8e1728a18 None None] MFA Rules not processed for user `3f179a7816da42fc8a4c1dc10971a204`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:43.835854 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-405004b9-211a-4ddd-b684-4ab8e1728a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:43.852870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-7c043df3-bdb7-4144-b13f-29da918c4445 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:43.854761 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7c043df3-bdb7-4144-b13f-29da918c4445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:43.957419 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 927/1866] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:43.957613 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 940/1867] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:43.962063 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90225d-d7ea-4fc5-ae97-03643462c4b3 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:43.962377 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90225d-d7ea-4fc5-ae97-03643462c4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:43.962878 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90225d-d7ea-4fc5-ae97-03643462c4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:43.966472 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405004b9-211a-4ddd-b684-4ab8e1728a18 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:43.968030 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-405004b9-211a-4ddd-b684-4ab8e1728a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:43.996553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-9a90225d-d7ea-4fc5-ae97-03643462c4b3 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:43.997863 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-9a90225d-d7ea-4fc5-ae97-03643462c4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:44.020850 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 928/1868] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:44.023089 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90225d-d7ea-4fc5-ae97-03643462c4b3 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:44.047243 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90225d-d7ea-4fc5-ae97-03643462c4b3 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:44.063015 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda344b7-5167-4bae-9097-0acd96f43c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:44.063702 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda344b7-5167-4bae-9097-0acd96f43c1d admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:44.063928 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda344b7-5167-4bae-9097-0acd96f43c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:44.065666 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda344b7-5167-4bae-9097-0acd96f43c1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:44.066943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda344b7-5167-4bae-9097-0acd96f43c1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:16:44.067440 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda344b7-5167-4bae-9097-0acd96f43c1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:44.069055 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda344b7-5167-4bae-9097-0acd96f43c1d admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:44.085205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:44.105544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 929/1869] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:16:44.113944 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda344b7-5167-4bae-9097-0acd96f43c1d admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:44.125638 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405004b9-211a-4ddd-b684-4ab8e1728a18 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:44.136135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda344b7-5167-4bae-9097-0acd96f43c1d admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:44.138542 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161e9ab-68f5-4bcc-a726-796c6574a545 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:44.139507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161e9ab-68f5-4bcc-a726-796c6574a545 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:44.141181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88d5b1-e909-4b35-af28-9577f6968358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:44.141787 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161e9ab-68f5-4bcc-a726-796c6574a545 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:44.141912 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88d5b1-e909-4b35-af28-9577f6968358 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:44.142154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88d5b1-e909-4b35-af28-9577f6968358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:44.142449 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88d5b1-e909-4b35-af28-9577f6968358 admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:44.143185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88d5b1-e909-4b35-af28-9577f6968358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:44.144467 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161e9ab-68f5-4bcc-a726-796c6574a545 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:44.146368 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88d5b1-e909-4b35-af28-9577f6968358 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:44.169446 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161e9ab-68f5-4bcc-a726-796c6574a545 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:44.170914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161e9ab-68f5-4bcc-a726-796c6574a545 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:44.182534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 941/1870] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:43 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:44.196389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 930/1871] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:44 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:44.200452 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161e9ab-68f5-4bcc-a726-796c6574a545 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:44.215507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161e9ab-68f5-4bcc-a726-796c6574a545 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:44.296877 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88d5b1-e909-4b35-af28-9577f6968358 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:44.300976 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-8f88d5b1-e909-4b35-af28-9577f6968358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:44.337946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa2fdf-a52a-4d9c-8ce1-14b0fbe340cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:44.338784 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa2fdf-a52a-4d9c-8ce1-14b0fbe340cb admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:44.341059 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa2fdf-a52a-4d9c-8ce1-14b0fbe340cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:44.342020 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa2fdf-a52a-4d9c-8ce1-14b0fbe340cb admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:44.342761 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa2fdf-a52a-4d9c-8ce1-14b0fbe340cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:44.350268 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa2fdf-a52a-4d9c-8ce1-14b0fbe340cb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:44.392307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 942/1872] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:44 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:44.397177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa2fdf-a52a-4d9c-8ce1-14b0fbe340cb admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:44.435328 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa2fdf-a52a-4d9c-8ce1-14b0fbe340cb admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:44.442357 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88d5b1-e909-4b35-af28-9577f6968358 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:44.449748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fe755-836d-4bce-b51b-790c24293b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:44.449987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887daec9-e8d3-4ff2-b58f-4ec5af68bb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:44.450650 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887daec9-e8d3-4ff2-b58f-4ec5af68bb58 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:44.450939 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887daec9-e8d3-4ff2-b58f-4ec5af68bb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:44.452074 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887daec9-e8d3-4ff2-b58f-4ec5af68bb58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:44.452074 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887daec9-e8d3-4ff2-b58f-4ec5af68bb58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:44.452506 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fe755-836d-4bce-b51b-790c24293b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:44.453032 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fe755-836d-4bce-b51b-790c24293b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:44.453488 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fe755-836d-4bce-b51b-790c24293b3b admin admin] PATH_INFO: `/v3/users/959df2f1f4dd4c1789e0ee41070d3692` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:44.453605 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887daec9-e8d3-4ff2-b58f-4ec5af68bb58 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:44.455457 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fe755-836d-4bce-b51b-790c24293b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=959df2f1f4dd4c1789e0ee41070d3692)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:44.457688 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fe755-836d-4bce-b51b-790c24293b3b admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:44.481333 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 943/1873] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:44.481333 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887daec9-e8d3-4ff2-b58f-4ec5af68bb58 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:44.504259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-887daec9-e8d3-4ff2-b58f-4ec5af68bb58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:44.539085 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887daec9-e8d3-4ff2-b58f-4ec5af68bb58 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:44.545685 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a7b96-2b12-4552-9d38-e6610553f68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:44.546467 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a7b96-2b12-4552-9d38-e6610553f68e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:44.546751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a7b96-2b12-4552-9d38-e6610553f68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:44.547125 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a7b96-2b12-4552-9d38-e6610553f68e admin admin] PATH_INFO: `/v3/projects/82342ebc56a84e37bc960f504775b285` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:44.548417 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a7b96-2b12-4552-9d38-e6610553f68e admin admin] RBAC: Authorizing `identity:delete_project(project_id=82342ebc56a84e37bc960f504775b285)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:44.550352 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a7b96-2b12-4552-9d38-e6610553f68e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:44.574437 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:44.583362 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d39fe755-836d-4bce-b51b-790c24293b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '959df2f1f4dd4c1789e0ee41070d3692'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:44.583362 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d39fe755-836d-4bce-b51b-790c24293b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '959df2f1f4dd4c1789e0ee41070d3692'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:44.596417 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d39fe755-836d-4bce-b51b-790c24293b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '959df2f1f4dd4c1789e0ee41070d3692'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:44.606407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d39fe755-836d-4bce-b51b-790c24293b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '959df2f1f4dd4c1789e0ee41070d3692'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:44.635909 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d39fe755-836d-4bce-b51b-790c24293b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '959df2f1f4dd4c1789e0ee41070d3692'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:44.654535 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 931/1874] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:44 2022] DELETE /identity/v3/users/959df2f1f4dd4c1789e0ee41070d3692 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:44.654535 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fe755-836d-4bce-b51b-790c24293b3b admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:44.654535 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d39fe755-836d-4bce-b51b-790c24293b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:44.680747 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bd4a7b96-2b12-4552-9d38-e6610553f68e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82342ebc56a84e37bc960f504775b285', 'request_id': 'req-bd4a7b96-2b12-4552-9d38-e6610553f68e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:44.697578 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bd4a7b96-2b12-4552-9d38-e6610553f68e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82342ebc56a84e37bc960f504775b285', 'request_id': 'req-bd4a7b96-2b12-4552-9d38-e6610553f68e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:44.715769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bd4a7b96-2b12-4552-9d38-e6610553f68e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82342ebc56a84e37bc960f504775b285', 'request_id': 'req-bd4a7b96-2b12-4552-9d38-e6610553f68e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:44.743939 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bd4a7b96-2b12-4552-9d38-e6610553f68e admin admin] The token cache is being invalidate because project 82342ebc56a84e37bc960f504775b285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:44.744577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bd4a7b96-2b12-4552-9d38-e6610553f68e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:44.745775 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bd4a7b96-2b12-4552-9d38-e6610553f68e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:44.754167 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 944/1875] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:44 2022] DELETE /identity/v3/projects/82342ebc56a84e37bc960f504775b285 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:44.755710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a7b96-2b12-4552-9d38-e6610553f68e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:44.758570 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bd4a7b96-2b12-4552-9d38-e6610553f68e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:44.778632 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fe755-836d-4bce-b51b-790c24293b3b admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:44.785067 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7aae67-a5c7-4a03-a66b-06a71623f7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:44.786311 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aae67-a5c7-4a03-a66b-06a71623f7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:44.786622 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aae67-a5c7-4a03-a66b-06a71623f7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:44.786899 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aae67-a5c7-4a03-a66b-06a71623f7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:44.787613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7aae67-a5c7-4a03-a66b-06a71623f7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:44.790081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7aae67-a5c7-4a03-a66b-06a71623f7c8 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:44.803339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 932/1876] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:44.804898 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb602e-e618-4e09-baae-5bd757eba375 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:44.805191 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb602e-e618-4e09-baae-5bd757eba375 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:44.805471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb602e-e618-4e09-baae-5bd757eba375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:44.828899 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-cbeb602e-e618-4e09-baae-5bd757eba375 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:44.830595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-cbeb602e-e618-4e09-baae-5bd757eba375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:44.845444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 933/1877] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:44.847093 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8934e-4960-4182-a50e-644064abd469 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:44.847463 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8934e-4960-4182-a50e-644064abd469 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:44.847873 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8934e-4960-4182-a50e-644064abd469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:44.874083 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-f5d8934e-4960-4182-a50e-644064abd469 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:44.875457 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-f5d8934e-4960-4182-a50e-644064abd469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:44.880695 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:44.889428 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 934/1878] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:44.890377 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8934e-4960-4182-a50e-644064abd469 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:44.891794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-f5d8934e-4960-4182-a50e-644064abd469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:44.906731 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8934e-4960-4182-a50e-644064abd469 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:44.912622 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c65d5-b36b-47c5-a57e-bd02583f6102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:44.913378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c65d5-b36b-47c5-a57e-bd02583f6102 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:44.913664 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c65d5-b36b-47c5-a57e-bd02583f6102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:44.913940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c65d5-b36b-47c5-a57e-bd02583f6102 admin admin] PATH_INFO: `/v3/projects/137fb04e307e43178d880048825d9a77/users/c34bf77d0979488d947a251f4ae9e650/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:44.924738 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a7b96-2b12-4552-9d38-e6610553f68e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:44.935716 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82836ea1-6df1-4698-a08a-292926f3b48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:44.936444 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82836ea1-6df1-4698-a08a-292926f3b48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:44.936601 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c65d5-b36b-47c5-a57e-bd02583f6102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=137fb04e307e43178d880048825d9a77, user_id=c34bf77d0979488d947a251f4ae9e650, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:44.936771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82836ea1-6df1-4698-a08a-292926f3b48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:44.937050 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82836ea1-6df1-4698-a08a-292926f3b48b admin admin] PATH_INFO: `/v3/projects/6ce9e874b7564a96a258534980eee1c9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:44.938476 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82836ea1-6df1-4698-a08a-292926f3b48b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce9e874b7564a96a258534980eee1c9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:44.939696 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c65d5-b36b-47c5-a57e-bd02583f6102 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:44.940667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82836ea1-6df1-4698-a08a-292926f3b48b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:44.964478 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 935/1879] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:44 2022] PUT /identity/v3/projects/137fb04e307e43178d880048825d9a77/users/c34bf77d0979488d947a251f4ae9e650/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:44.968689 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c65d5-b36b-47c5-a57e-bd02583f6102 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:44.974292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-f62c65d5-b36b-47c5-a57e-bd02583f6102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:45.018698 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-82836ea1-6df1-4698-a08a-292926f3b48b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce9e874b7564a96a258534980eee1c9', 'request_id': 'req-82836ea1-6df1-4698-a08a-292926f3b48b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:45.029811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-82836ea1-6df1-4698-a08a-292926f3b48b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce9e874b7564a96a258534980eee1c9', 'request_id': 'req-82836ea1-6df1-4698-a08a-292926f3b48b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:45.038222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-82836ea1-6df1-4698-a08a-292926f3b48b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce9e874b7564a96a258534980eee1c9', 'request_id': 'req-82836ea1-6df1-4698-a08a-292926f3b48b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:45.053527 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-82836ea1-6df1-4698-a08a-292926f3b48b admin admin] The token cache is being invalidate because project 6ce9e874b7564a96a258534980eee1c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:45.053848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-82836ea1-6df1-4698-a08a-292926f3b48b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:45.054674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-82836ea1-6df1-4698-a08a-292926f3b48b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:45.060812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 945/1880] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:44 2022] DELETE /identity/v3/projects/6ce9e874b7564a96a258534980eee1c9 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:45.062228 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319b506-041e-4d65-8af0-aa29692f0d64 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:45.062346 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319b506-041e-4d65-8af0-aa29692f0d64 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:45.062529 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319b506-041e-4d65-8af0-aa29692f0d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:45.081722 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c65d5-b36b-47c5-a57e-bd02583f6102 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:45.090208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-1319b506-041e-4d65-8af0-aa29692f0d64 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:45.091641 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1319b506-041e-4d65-8af0-aa29692f0d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:45.134478 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:45.183582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 946/1881] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:45.183582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455d636-6632-4cf1-9f77-f34d342c68ab None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:45.183582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455d636-6632-4cf1-9f77-f34d342c68ab None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:45.183949 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455d636-6632-4cf1-9f77-f34d342c68ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:45.187702 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb43fa-966a-4f72-8519-46df3933a5aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:45.188745 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb43fa-966a-4f72-8519-46df3933a5aa service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:45.189243 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb43fa-966a-4f72-8519-46df3933a5aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:45.189735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb43fa-966a-4f72-8519-46df3933a5aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:45.193096 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d1bb43fa-966a-4f72-8519-46df3933a5aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:45.214930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb43fa-966a-4f72-8519-46df3933a5aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:45.218122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb43fa-966a-4f72-8519-46df3933a5aa service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:45.220941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8455d636-6632-4cf1-9f77-f34d342c68ab None None] MFA Rules not processed for user `c34bf77d0979488d947a251f4ae9e650`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:45.222647 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8455d636-6632-4cf1-9f77-f34d342c68ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:45.237394 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 936/1882] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:45.240306 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7ced0-692c-4ff6-8f1d-215704670ac1 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:45.240807 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7ced0-692c-4ff6-8f1d-215704670ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:45.241405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7ced0-692c-4ff6-8f1d-215704670ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:45.277241 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-45e7ced0-692c-4ff6-8f1d-215704670ac1 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:45.280686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-45e7ced0-692c-4ff6-8f1d-215704670ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:45.299049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 937/1883] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:45.300921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7ced0-692c-4ff6-8f1d-215704670ac1 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:45.315283 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 947/1884] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:45.315283 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302da41-8a2a-4933-a7af-e23cb45f0dfa None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:45.316942 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302da41-8a2a-4933-a7af-e23cb45f0dfa None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:45.317240 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302da41-8a2a-4933-a7af-e23cb45f0dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:45.334749 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7ced0-692c-4ff6-8f1d-215704670ac1 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:45.336828 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:45.341132 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09184d51-819b-42d3-9abf-bb34e5bccaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:45.342128 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09184d51-819b-42d3-9abf-bb34e5bccaf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:45.342658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09184d51-819b-42d3-9abf-bb34e5bccaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:45.342910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09184d51-819b-42d3-9abf-bb34e5bccaf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:45.343681 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09184d51-819b-42d3-9abf-bb34e5bccaf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:16:45.344007 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09184d51-819b-42d3-9abf-bb34e5bccaf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:45.345637 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09184d51-819b-42d3-9abf-bb34e5bccaf9 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:45.364658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 938/1885] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:16:45.364658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09184d51-819b-42d3-9abf-bb34e5bccaf9 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:45.366277 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9302da41-8a2a-4933-a7af-e23cb45f0dfa None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:45.366853 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-09184d51-819b-42d3-9abf-bb34e5bccaf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:45.370426 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9302da41-8a2a-4933-a7af-e23cb45f0dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:45.385940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 948/1886] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:45.389513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302da41-8a2a-4933-a7af-e23cb45f0dfa None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:45.390919 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09184d51-819b-42d3-9abf-bb34e5bccaf9 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:45.396766 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f2a84-99e3-4f0f-b36d-0f9606792b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:45.397604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f2a84-99e3-4f0f-b36d-0f9606792b5a admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:45.397905 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f2a84-99e3-4f0f-b36d-0f9606792b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:45.398169 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f2a84-99e3-4f0f-b36d-0f9606792b5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:45.398814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f2a84-99e3-4f0f-b36d-0f9606792b5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:45.400838 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f2a84-99e3-4f0f-b36d-0f9606792b5a admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:45.408010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302da41-8a2a-4933-a7af-e23cb45f0dfa None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:45.417579 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428b5ef-cd2a-4e9e-8513-58cdbcc53e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:45.418727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428b5ef-cd2a-4e9e-8513-58cdbcc53e13 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:45.419442 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428b5ef-cd2a-4e9e-8513-58cdbcc53e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:45.420171 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428b5ef-cd2a-4e9e-8513-58cdbcc53e13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:45.421392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428b5ef-cd2a-4e9e-8513-58cdbcc53e13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:45.426434 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428b5ef-cd2a-4e9e-8513-58cdbcc53e13 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:45.439530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 939/1887] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:45 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:45.439530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f2a84-99e3-4f0f-b36d-0f9606792b5a admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:45.516217 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 949/1888] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:45 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:45.517250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428b5ef-cd2a-4e9e-8513-58cdbcc53e13 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:45.572706 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f2a84-99e3-4f0f-b36d-0f9606792b5a admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:45.639251 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428b5ef-cd2a-4e9e-8513-58cdbcc53e13 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:45.655519 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182b066-dc15-40ad-919f-bb987de4a035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:45.656168 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182b066-dc15-40ad-919f-bb987de4a035 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:45.656466 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182b066-dc15-40ad-919f-bb987de4a035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:45.656774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182b066-dc15-40ad-919f-bb987de4a035 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:45.658040 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182b066-dc15-40ad-919f-bb987de4a035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:45.662374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182b066-dc15-40ad-919f-bb987de4a035 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:45.704807 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f284075-76c1-49f1-bbc0-c64e4cc85ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:45.705320 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 950/1889] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:45 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:45.705975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f284075-76c1-49f1-bbc0-c64e4cc85ebd admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:45.706278 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182b066-dc15-40ad-919f-bb987de4a035 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:45.706444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f284075-76c1-49f1-bbc0-c64e4cc85ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:45.706698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f284075-76c1-49f1-bbc0-c64e4cc85ebd admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:45.707578 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f284075-76c1-49f1-bbc0-c64e4cc85ebd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:16:45.708313 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f284075-76c1-49f1-bbc0-c64e4cc85ebd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:45.710343 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f284075-76c1-49f1-bbc0-c64e4cc85ebd admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:45.722842 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182b066-dc15-40ad-919f-bb987de4a035 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:45.740875 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefa02c-7dbd-464c-8312-ec136f47664e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:45.742088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefa02c-7dbd-464c-8312-ec136f47664e admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:45.742627 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefa02c-7dbd-464c-8312-ec136f47664e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:45.743100 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefa02c-7dbd-464c-8312-ec136f47664e admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:45.743805 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbefa02c-7dbd-464c-8312-ec136f47664e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:45.746183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbefa02c-7dbd-464c-8312-ec136f47664e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:45.749641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 940/1890] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:16:45.751623 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f284075-76c1-49f1-bbc0-c64e4cc85ebd admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:45.776329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 951/1891] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:45 2022] POST /identity/v3/users => generated 291 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:45.777024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefa02c-7dbd-464c-8312-ec136f47664e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:45.779355 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f284075-76c1-49f1-bbc0-c64e4cc85ebd admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:45.788457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefa02c-7dbd-464c-8312-ec136f47664e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:45.794885 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519389c-53ff-431d-a39f-9530338a0776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:45.795380 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519389c-53ff-431d-a39f-9530338a0776 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:45.796529 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519389c-53ff-431d-a39f-9530338a0776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:45.796834 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519389c-53ff-431d-a39f-9530338a0776 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:45.797502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519389c-53ff-431d-a39f-9530338a0776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:45.797726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eb892-61b7-4337-b134-19cab50f7b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:45.798393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eb892-61b7-4337-b134-19cab50f7b6b admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:45.798909 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eb892-61b7-4337-b134-19cab50f7b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:45.799319 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eb892-61b7-4337-b134-19cab50f7b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:45.799550 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519389c-53ff-431d-a39f-9530338a0776 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:45.800365 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eb892-61b7-4337-b134-19cab50f7b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:45.802700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eb892-61b7-4337-b134-19cab50f7b6b admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:45.814635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 941/1892] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:45.819071 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eb892-61b7-4337-b134-19cab50f7b6b admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:45.832868 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eb892-61b7-4337-b134-19cab50f7b6b admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:45.835953 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 952/1893] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:45 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:45.841486 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519389c-53ff-431d-a39f-9530338a0776 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:45.842324 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf78f7-a39f-4f0f-bf6d-a544f82a8d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:45.843444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf78f7-a39f-4f0f-bf6d-a544f82a8d34 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:45.843950 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf78f7-a39f-4f0f-bf6d-a544f82a8d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:45.844448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf78f7-a39f-4f0f-bf6d-a544f82a8d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:45.845762 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf78f7-a39f-4f0f-bf6d-a544f82a8d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:45.849197 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf78f7-a39f-4f0f-bf6d-a544f82a8d34 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:45.876707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 942/1894] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:45.878709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf78f7-a39f-4f0f-bf6d-a544f82a8d34 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:45.911687 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf78f7-a39f-4f0f-bf6d-a544f82a8d34 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:45.926024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:45.991083 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3ef96-3ad5-4e96-ae37-484ab8355dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:45.991730 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3ef96-3ad5-4e96-ae37-484ab8355dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:45.992016 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3ef96-3ad5-4e96-ae37-484ab8355dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:45.992293 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3ef96-3ad5-4e96-ae37-484ab8355dc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:45.992939 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3ef96-3ad5-4e96-ae37-484ab8355dc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:45.995317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3ef96-3ad5-4e96-ae37-484ab8355dc3 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:46.004731 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519389c-53ff-431d-a39f-9530338a0776 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:46.011874 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb256d53-302c-4b95-8c44-e622351e6dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:46.012618 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb256d53-302c-4b95-8c44-e622351e6dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:46.012910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb256d53-302c-4b95-8c44-e622351e6dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:46.013346 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb256d53-302c-4b95-8c44-e622351e6dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:46.015392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb256d53-302c-4b95-8c44-e622351e6dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:46.017817 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb256d53-302c-4b95-8c44-e622351e6dd8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:46.037075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 943/1895] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:45 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:46.037075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3ef96-3ad5-4e96-ae37-484ab8355dc3 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:46.037643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 953/1896] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:46.037643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb256d53-302c-4b95-8c44-e622351e6dd8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:46.037643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bb256d53-302c-4b95-8c44-e622351e6dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:46.050068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb256d53-302c-4b95-8c44-e622351e6dd8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:46.054125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3ef96-3ad5-4e96-ae37-484ab8355dc3 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:46.056082 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13498b-9b6b-455a-8eeb-07f78fbdb360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:46.056943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13498b-9b6b-455a-8eeb-07f78fbdb360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:46.057196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13498b-9b6b-455a-8eeb-07f78fbdb360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:46.057460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13498b-9b6b-455a-8eeb-07f78fbdb360 admin admin] PATH_INFO: `/v3/projects/936ce75e78b14b7c904aeb20651105f9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:46.058644 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13498b-9b6b-455a-8eeb-07f78fbdb360 admin admin] RBAC: Authorizing `identity:delete_project(project_id=936ce75e78b14b7c904aeb20651105f9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:46.060676 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13498b-9b6b-455a-8eeb-07f78fbdb360 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:46.063943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ebba2-2af4-45d0-bff2-700785c9f9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:46.065132 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ebba2-2af4-45d0-bff2-700785c9f9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:46.066271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ebba2-2af4-45d0-bff2-700785c9f9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:46.066851 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ebba2-2af4-45d0-bff2-700785c9f9f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:46.068201 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ebba2-2af4-45d0-bff2-700785c9f9f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:46.071870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ebba2-2af4-45d0-bff2-700785c9f9f5 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:46.089850 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:46.105437 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 944/1897] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:46.107331 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ebba2-2af4-45d0-bff2-700785c9f9f5 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:46.129507 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ebba2-2af4-45d0-bff2-700785c9f9f5 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:46.131918 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ec13498b-9b6b-455a-8eeb-07f78fbdb360 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936ce75e78b14b7c904aeb20651105f9', 'request_id': 'req-ec13498b-9b6b-455a-8eeb-07f78fbdb360'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:46.156676 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ec13498b-9b6b-455a-8eeb-07f78fbdb360 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936ce75e78b14b7c904aeb20651105f9', 'request_id': 'req-ec13498b-9b6b-455a-8eeb-07f78fbdb360'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:46.173160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ec13498b-9b6b-455a-8eeb-07f78fbdb360 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936ce75e78b14b7c904aeb20651105f9', 'request_id': 'req-ec13498b-9b6b-455a-8eeb-07f78fbdb360'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:46.188122 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ec13498b-9b6b-455a-8eeb-07f78fbdb360 admin admin] The token cache is being invalidate because project 936ce75e78b14b7c904aeb20651105f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:46.188718 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ec13498b-9b6b-455a-8eeb-07f78fbdb360 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:46.189791 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ec13498b-9b6b-455a-8eeb-07f78fbdb360 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:46.198153 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 954/1898] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:46 2022] DELETE /identity/v3/projects/936ce75e78b14b7c904aeb20651105f9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:46.199810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13498b-9b6b-455a-8eeb-07f78fbdb360 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:46.202264 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ec13498b-9b6b-455a-8eeb-07f78fbdb360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:46.259770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f8e1c-c656-4223-b1d6-a07ed78beac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:46.264557 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f8e1c-c656-4223-b1d6-a07ed78beac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:46.265204 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f8e1c-c656-4223-b1d6-a07ed78beac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:46.265736 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f8e1c-c656-4223-b1d6-a07ed78beac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:46.266699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f8e1c-c656-4223-b1d6-a07ed78beac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:46.271825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f8e1c-c656-4223-b1d6-a07ed78beac4 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:46.306561 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 945/1899] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:46.306561 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f8e1c-c656-4223-b1d6-a07ed78beac4 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:46.306561 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-cd7f8e1c-c656-4223-b1d6-a07ed78beac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:46.357067 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f8e1c-c656-4223-b1d6-a07ed78beac4 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:46.378455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522afe42-9d4f-4a1e-962d-3493fa9d96af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:46.379808 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522afe42-9d4f-4a1e-962d-3493fa9d96af admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:46.380295 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522afe42-9d4f-4a1e-962d-3493fa9d96af admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:46.380616 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522afe42-9d4f-4a1e-962d-3493fa9d96af admin admin] PATH_INFO: `/v3/projects/1cb02d20c4624388b0e26038c4cc7532/users/b75e0b2e3ee642249cb336f734a866c5/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:46.391884 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13498b-9b6b-455a-8eeb-07f78fbdb360 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:46.399255 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178ba43-e6bc-4b68-8f68-3e42c84196f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:46.400862 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178ba43-e6bc-4b68-8f68-3e42c84196f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:46.401352 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178ba43-e6bc-4b68-8f68-3e42c84196f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:46.401832 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178ba43-e6bc-4b68-8f68-3e42c84196f6 admin admin] PATH_INFO: `/v3/projects/7fe1a1726f6e4e9f9605e0382f3872dd/users/9234f1b81c664024a55cb800a17cc1e5/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:46.431335 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522afe42-9d4f-4a1e-962d-3493fa9d96af admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb02d20c4624388b0e26038c4cc7532, user_id=b75e0b2e3ee642249cb336f734a866c5, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:46.438377 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522afe42-9d4f-4a1e-962d-3493fa9d96af admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:46.444724 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178ba43-e6bc-4b68-8f68-3e42c84196f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe1a1726f6e4e9f9605e0382f3872dd, user_id=9234f1b81c664024a55cb800a17cc1e5, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:46.447796 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178ba43-e6bc-4b68-8f68-3e42c84196f6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:46.479563 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 946/1900] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:46 2022] PUT /identity/v3/projects/1cb02d20c4624388b0e26038c4cc7532/users/b75e0b2e3ee642249cb336f734a866c5/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:46.481799 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522afe42-9d4f-4a1e-962d-3493fa9d96af admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:46.489780 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-522afe42-9d4f-4a1e-962d-3493fa9d96af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:46.491896 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 955/1901] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:46 2022] PUT /identity/v3/projects/7fe1a1726f6e4e9f9605e0382f3872dd/users/9234f1b81c664024a55cb800a17cc1e5/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:46.492922 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178ba43-e6bc-4b68-8f68-3e42c84196f6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:46.495643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5178ba43-e6bc-4b68-8f68-3e42c84196f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:46.643095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522afe42-9d4f-4a1e-962d-3493fa9d96af admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:46.646050 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178ba43-e6bc-4b68-8f68-3e42c84196f6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:46.648571 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ed0d9-d334-4b42-bf6b-88d54d790cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:46.649233 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ed0d9-d334-4b42-bf6b-88d54d790cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:46.649511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ed0d9-d334-4b42-bf6b-88d54d790cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:46.650086 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ed0d9-d334-4b42-bf6b-88d54d790cb4 admin admin] PATH_INFO: `/v3/users/3f179a7816da42fc8a4c1dc10971a204` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:46.652116 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ed0d9-d334-4b42-bf6b-88d54d790cb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f179a7816da42fc8a4c1dc10971a204)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:46.654184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ed0d9-d334-4b42-bf6b-88d54d790cb4 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:46.656093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acebf61-50a6-4713-bc84-334cf48453d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:46.656971 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:46.659883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acebf61-50a6-4713-bc84-334cf48453d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:46.660623 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acebf61-50a6-4713-bc84-334cf48453d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:46.661296 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acebf61-50a6-4713-bc84-334cf48453d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:46.664181 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acebf61-50a6-4713-bc84-334cf48453d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:46.667590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acebf61-50a6-4713-bc84-334cf48453d9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:46.688474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 956/1902] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:46.691268 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ee70f-186b-4201-8575-9dcbcf2ca226 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:46.691875 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ee70f-186b-4201-8575-9dcbcf2ca226 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:46.692343 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ee70f-186b-4201-8575-9dcbcf2ca226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:46.725584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-580ee70f-186b-4201-8575-9dcbcf2ca226 None None] MFA Rules not processed for user `b75e0b2e3ee642249cb336f734a866c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:46.726823 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-580ee70f-186b-4201-8575-9dcbcf2ca226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:46.738241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:46.761675 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d58ed0d9-d334-4b42-bf6b-88d54d790cb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f179a7816da42fc8a4c1dc10971a204'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:46.762404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d58ed0d9-d334-4b42-bf6b-88d54d790cb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f179a7816da42fc8a4c1dc10971a204'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:46.774575 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d58ed0d9-d334-4b42-bf6b-88d54d790cb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f179a7816da42fc8a4c1dc10971a204'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:46.786758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d58ed0d9-d334-4b42-bf6b-88d54d790cb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f179a7816da42fc8a4c1dc10971a204'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:46.807846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d58ed0d9-d334-4b42-bf6b-88d54d790cb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f179a7816da42fc8a4c1dc10971a204'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:46.813855 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 957/1903] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:46.815381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a59ace-1fc9-4bdb-be44-9930af25b516 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:46.816341 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a59ace-1fc9-4bdb-be44-9930af25b516 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:46.816626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a59ace-1fc9-4bdb-be44-9930af25b516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:46.821482 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 947/1904] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:46 2022] DELETE /identity/v3/users/3f179a7816da42fc8a4c1dc10971a204 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:46.823091 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ed0d9-d334-4b42-bf6b-88d54d790cb4 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:46.825406 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d58ed0d9-d334-4b42-bf6b-88d54d790cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:46.873299 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-42a59ace-1fc9-4bdb-be44-9930af25b516 None None] MFA Rules not processed for user `9234f1b81c664024a55cb800a17cc1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:46.874564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-42a59ace-1fc9-4bdb-be44-9930af25b516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:47.003324 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ed0d9-d334-4b42-bf6b-88d54d790cb4 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:47.010916 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e5690-1ba5-4128-b5cb-81685c1392aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:47.011698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e5690-1ba5-4128-b5cb-81685c1392aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:47.011984 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e5690-1ba5-4128-b5cb-81685c1392aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:47.012259 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e5690-1ba5-4128-b5cb-81685c1392aa admin admin] PATH_INFO: `/v3/projects/fc7835ab69c24a69af84d316e0c07342/users/23e11a02a50e49c4b48b07c918364b68/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:47.025515 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 958/1905] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:47.026526 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a59ace-1fc9-4bdb-be44-9930af25b516 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:47.028355 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-42a59ace-1fc9-4bdb-be44-9930af25b516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:47.044652 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e5690-1ba5-4128-b5cb-81685c1392aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7835ab69c24a69af84d316e0c07342, user_id=23e11a02a50e49c4b48b07c918364b68, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:47.045731 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a59ace-1fc9-4bdb-be44-9930af25b516 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:47.051219 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e5690-1ba5-4128-b5cb-81685c1392aa admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:47.053478 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dadf8-668e-4f95-9d94-7b20e78a3119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:47.054114 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dadf8-668e-4f95-9d94-7b20e78a3119 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:47.054393 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dadf8-668e-4f95-9d94-7b20e78a3119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:47.054674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dadf8-668e-4f95-9d94-7b20e78a3119 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:47.055349 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071dadf8-668e-4f95-9d94-7b20e78a3119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:47.057500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071dadf8-668e-4f95-9d94-7b20e78a3119 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:47.080914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 948/1906] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:46 2022] PUT /identity/v3/projects/fc7835ab69c24a69af84d316e0c07342/users/23e11a02a50e49c4b48b07c918364b68/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:47.082992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e5690-1ba5-4128-b5cb-81685c1392aa admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:47.086712 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-4e1e5690-1ba5-4128-b5cb-81685c1392aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:47.107345 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 959/1907] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:47 2022] POST /identity/v3/projects => generated 381 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:47.107345 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8fcd4-491a-48d4-a4fc-74a68375b561 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:47.107345 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8fcd4-491a-48d4-a4fc-74a68375b561 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:47.107345 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8fcd4-491a-48d4-a4fc-74a68375b561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:47.167251 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-77a8fcd4-491a-48d4-a4fc-74a68375b561 None None] MFA Rules not processed for user `23e11a02a50e49c4b48b07c918364b68`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:47.169049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-77a8fcd4-491a-48d4-a4fc-74a68375b561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:47.261329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e5690-1ba5-4128-b5cb-81685c1392aa admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:47.266992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 960/1908] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:47.271194 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8fcd4-491a-48d4-a4fc-74a68375b561 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:47.271897 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:47.280878 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:47.360938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9b38e-d88b-4aed-adde-95bc1430a441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:47.362704 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9b38e-d88b-4aed-adde-95bc1430a441 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:47.363368 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9b38e-d88b-4aed-adde-95bc1430a441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:47.363709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9b38e-d88b-4aed-adde-95bc1430a441 admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:47.364554 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9b38e-d88b-4aed-adde-95bc1430a441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:47.366800 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9b38e-d88b-4aed-adde-95bc1430a441 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:47.385745 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8fcd4-491a-48d4-a4fc-74a68375b561 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:47.392902 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c21768-0e90-4661-81f9-db3656270a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:47.394345 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c21768-0e90-4661-81f9-db3656270a3c admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:47.394692 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c21768-0e90-4661-81f9-db3656270a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:47.395062 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c21768-0e90-4661-81f9-db3656270a3c admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:47.395899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c21768-0e90-4661-81f9-db3656270a3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:47.398463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c21768-0e90-4661-81f9-db3656270a3c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:47.425523 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 949/1909] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:47 2022] POST /identity/v3/projects => generated 383 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:47.425523 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9b38e-d88b-4aed-adde-95bc1430a441 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:47.432691 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 961/1910] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:47 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:47.432691 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c21768-0e90-4661-81f9-db3656270a3c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:47.438534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e2c21768-0e90-4661-81f9-db3656270a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:47.471541 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c21768-0e90-4661-81f9-db3656270a3c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:47.522459 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9b38e-d88b-4aed-adde-95bc1430a441 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:47.529274 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1eb185-701e-42d4-9eb4-e33b8b975bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:47.530733 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eb185-701e-42d4-9eb4-e33b8b975bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:47.531052 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eb185-701e-42d4-9eb4-e33b8b975bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:47.531331 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eb185-701e-42d4-9eb4-e33b8b975bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:47.531984 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1eb185-701e-42d4-9eb4-e33b8b975bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:47.535296 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1eb185-701e-42d4-9eb4-e33b8b975bd6 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:47.578192 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 950/1911] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:47 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:47.580275 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1eb185-701e-42d4-9eb4-e33b8b975bd6 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:47.584653 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4591990-d8ec-4c5e-8971-8452a9072ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:47.585273 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4591990-d8ec-4c5e-8971-8452a9072ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:47.585554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4591990-d8ec-4c5e-8971-8452a9072ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:47.585883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4591990-d8ec-4c5e-8971-8452a9072ee2 admin admin] PATH_INFO: `/v3/projects/fd809c67064e4e4a89b50fce1f228166` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:47.587125 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4591990-d8ec-4c5e-8971-8452a9072ee2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd809c67064e4e4a89b50fce1f228166)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:47.589371 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4591990-d8ec-4c5e-8971-8452a9072ee2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:47.682437 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1eb185-701e-42d4-9eb4-e33b8b975bd6 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:47.709348 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4591990-d8ec-4c5e-8971-8452a9072ee2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd809c67064e4e4a89b50fce1f228166', 'request_id': 'req-a4591990-d8ec-4c5e-8971-8452a9072ee2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:47.724721 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4591990-d8ec-4c5e-8971-8452a9072ee2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd809c67064e4e4a89b50fce1f228166', 'request_id': 'req-a4591990-d8ec-4c5e-8971-8452a9072ee2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:47.741235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4591990-d8ec-4c5e-8971-8452a9072ee2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd809c67064e4e4a89b50fce1f228166', 'request_id': 'req-a4591990-d8ec-4c5e-8971-8452a9072ee2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:47.771757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4591990-d8ec-4c5e-8971-8452a9072ee2 admin admin] The token cache is being invalidate because project fd809c67064e4e4a89b50fce1f228166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:47.772393 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4591990-d8ec-4c5e-8971-8452a9072ee2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:47.774096 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4591990-d8ec-4c5e-8971-8452a9072ee2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:47.782691 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:47.785468 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 962/1912] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:47 2022] DELETE /identity/v3/projects/fd809c67064e4e4a89b50fce1f228166 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:47.786948 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4591990-d8ec-4c5e-8971-8452a9072ee2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:47.789609 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a4591990-d8ec-4c5e-8971-8452a9072ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:47.862566 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127c827-6864-43f0-9054-c80af15484c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:47.864034 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127c827-6864-43f0-9054-c80af15484c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:47.864542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127c827-6864-43f0-9054-c80af15484c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:47.864977 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127c827-6864-43f0-9054-c80af15484c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:47.865909 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127c827-6864-43f0-9054-c80af15484c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:47.868630 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127c827-6864-43f0-9054-c80af15484c4 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:47.902114 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:47.912774 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 951/1913] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:47 2022] POST /identity/v3/users => generated 298 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:47.915208 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127c827-6864-43f0-9054-c80af15484c4 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:47.919736 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-2127c827-6864-43f0-9054-c80af15484c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:47.947383 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127c827-6864-43f0-9054-c80af15484c4 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:47.966357 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075366fc-9352-43d0-a50c-ddaa9ef65dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:47.967306 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075366fc-9352-43d0-a50c-ddaa9ef65dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:47.969436 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075366fc-9352-43d0-a50c-ddaa9ef65dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:47.970011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075366fc-9352-43d0-a50c-ddaa9ef65dd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:47.970864 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075366fc-9352-43d0-a50c-ddaa9ef65dd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:47.974977 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075366fc-9352-43d0-a50c-ddaa9ef65dd0 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:48.014113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 952/1914] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:47 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:48.016139 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69856df7-6454-4148-8089-30005dec4a26 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:48.016679 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69856df7-6454-4148-8089-30005dec4a26 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:48.017051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4591990-d8ec-4c5e-8971-8452a9072ee2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:48.017269 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69856df7-6454-4148-8089-30005dec4a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:48.028509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8842fed-f6a6-4bcc-ad05-5a1cfa05a3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:48.029639 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8842fed-f6a6-4bcc-ad05-5a1cfa05a3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:48.030164 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8842fed-f6a6-4bcc-ad05-5a1cfa05a3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:48.030597 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8842fed-f6a6-4bcc-ad05-5a1cfa05a3e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:48.031661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8842fed-f6a6-4bcc-ad05-5a1cfa05a3e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:48.035820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8842fed-f6a6-4bcc-ad05-5a1cfa05a3e0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:48.059531 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-69856df7-6454-4148-8089-30005dec4a26 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:48.061383 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-69856df7-6454-4148-8089-30005dec4a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:48.063927 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 963/1915] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:48.070049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8842fed-f6a6-4bcc-ad05-5a1cfa05a3e0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:48.076450 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 953/1916] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:48.086828 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69856df7-6454-4148-8089-30005dec4a26 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:48.092007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b8842fed-f6a6-4bcc-ad05-5a1cfa05a3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:48.103166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69856df7-6454-4148-8089-30005dec4a26 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:48.110691 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21f460-775f-4f13-909d-7168aee828f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:48.113240 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21f460-775f-4f13-909d-7168aee828f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:48.113792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21f460-775f-4f13-909d-7168aee828f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:48.114281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21f460-775f-4f13-909d-7168aee828f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:48.115260 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21f460-775f-4f13-909d-7168aee828f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:48.117314 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21f460-775f-4f13-909d-7168aee828f2 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:48.133332 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8842fed-f6a6-4bcc-ad05-5a1cfa05a3e0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:48.141477 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 954/1917] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:48.144851 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21f460-775f-4f13-909d-7168aee828f2 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:48.154361 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc732d57-6ef7-4bd8-9a73-ba3a0137b362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:48.155322 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc732d57-6ef7-4bd8-9a73-ba3a0137b362 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:48.155910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc732d57-6ef7-4bd8-9a73-ba3a0137b362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:48.156175 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc732d57-6ef7-4bd8-9a73-ba3a0137b362 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:48.157129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc732d57-6ef7-4bd8-9a73-ba3a0137b362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:48.160132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc732d57-6ef7-4bd8-9a73-ba3a0137b362 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:48.177340 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21f460-775f-4f13-909d-7168aee828f2 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:48.178982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 964/1918] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:48.180067 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79502147-3f23-41e3-9ab8-218c45a9e512 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:48.180464 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79502147-3f23-41e3-9ab8-218c45a9e512 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:48.180844 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79502147-3f23-41e3-9ab8-218c45a9e512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:48.186510 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f44a7-ebfc-4486-987e-6ddbd3875f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:48.187583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f44a7-ebfc-4486-987e-6ddbd3875f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:48.188035 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f44a7-ebfc-4486-987e-6ddbd3875f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:48.188488 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f44a7-ebfc-4486-987e-6ddbd3875f41 admin admin] PATH_INFO: `/v3/projects/bb18dc20a53b4adf97e6df37b76343fd/users/8ee8d4aad91e4104b12f5184bc871885/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:48.211474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-79502147-3f23-41e3-9ab8-218c45a9e512 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:48.213515 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-79502147-3f23-41e3-9ab8-218c45a9e512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:48.216277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f44a7-ebfc-4486-987e-6ddbd3875f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb18dc20a53b4adf97e6df37b76343fd, user_id=8ee8d4aad91e4104b12f5184bc871885, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:48.220178 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f44a7-ebfc-4486-987e-6ddbd3875f41 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:48.226541 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 965/1919] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:48.227914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79502147-3f23-41e3-9ab8-218c45a9e512 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:48.245953 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79502147-3f23-41e3-9ab8-218c45a9e512 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:48.250844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 955/1920] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:48 2022] PUT /identity/v3/projects/bb18dc20a53b4adf97e6df37b76343fd/users/8ee8d4aad91e4104b12f5184bc871885/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:48.251996 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f44a7-ebfc-4486-987e-6ddbd3875f41 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:48.392844 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d06a2e-54be-4d01-a95e-b6fd0925bd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:48.395454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d06a2e-54be-4d01-a95e-b6fd0925bd62 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:48.395454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d06a2e-54be-4d01-a95e-b6fd0925bd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:48.396244 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d06a2e-54be-4d01-a95e-b6fd0925bd62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:48.397134 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d06a2e-54be-4d01-a95e-b6fd0925bd62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:48.400542 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d06a2e-54be-4d01-a95e-b6fd0925bd62 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:48.407497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f44a7-ebfc-4486-987e-6ddbd3875f41 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:48.413040 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfae1e3-e56b-4060-9000-75f2361b818a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:48.413735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfae1e3-e56b-4060-9000-75f2361b818a admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:48.414018 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfae1e3-e56b-4060-9000-75f2361b818a admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:48.414296 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfae1e3-e56b-4060-9000-75f2361b818a admin admin] PATH_INFO: `/v3/projects/974568937ea74aab8a038acef7bbdbc3/users/e995f3f3e4e1451d81021d51746d7bd6/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:48.432726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfae1e3-e56b-4060-9000-75f2361b818a admin admin] RBAC: Authorizing `identity:create_grant(project_id=974568937ea74aab8a038acef7bbdbc3, user_id=e995f3f3e4e1451d81021d51746d7bd6, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:48.435998 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfae1e3-e56b-4060-9000-75f2361b818a admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:48.437835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 966/1921] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:48.438836 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d06a2e-54be-4d01-a95e-b6fd0925bd62 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:48.458926 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 956/1922] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:48 2022] PUT /identity/v3/projects/974568937ea74aab8a038acef7bbdbc3/users/e995f3f3e4e1451d81021d51746d7bd6/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:48.460131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfae1e3-e56b-4060-9000-75f2361b818a admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:48.461387 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d06a2e-54be-4d01-a95e-b6fd0925bd62 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:48.533713 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:48.558797 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfae1e3-e56b-4060-9000-75f2361b818a admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:48.567947 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7266e1-cdb7-45d8-9295-e3ccd6ddd405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:48.568628 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7266e1-cdb7-45d8-9295-e3ccd6ddd405 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:48.569584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7266e1-cdb7-45d8-9295-e3ccd6ddd405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:48.569878 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7266e1-cdb7-45d8-9295-e3ccd6ddd405 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:48.570582 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7266e1-cdb7-45d8-9295-e3ccd6ddd405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:48.572579 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7266e1-cdb7-45d8-9295-e3ccd6ddd405 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:48.589855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 957/1923] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:48.594373 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7266e1-cdb7-45d8-9295-e3ccd6ddd405 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:48.604754 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1c403-15f8-44b3-b5fb-1f5a7d2f4a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:48.605534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1c403-15f8-44b3-b5fb-1f5a7d2f4a8f admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:48.605822 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1c403-15f8-44b3-b5fb-1f5a7d2f4a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:48.605997 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7266e1-cdb7-45d8-9295-e3ccd6ddd405 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:48.606240 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1c403-15f8-44b3-b5fb-1f5a7d2f4a8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:48.607435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1c403-15f8-44b3-b5fb-1f5a7d2f4a8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:16:48.607846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1c403-15f8-44b3-b5fb-1f5a7d2f4a8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:48.611236 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160452e9-4e25-41f6-b869-2eaa5f7b5d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:48.612079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160452e9-4e25-41f6-b869-2eaa5f7b5d56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:48.613111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160452e9-4e25-41f6-b869-2eaa5f7b5d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:48.613470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160452e9-4e25-41f6-b869-2eaa5f7b5d56 admin admin] PATH_INFO: `/v3/projects/8835a0b3c09c408bbcc8511f25b0d4e7/users/4c5dc81bffbf498a8986edfcfc857d09/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:48.613846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1c403-15f8-44b3-b5fb-1f5a7d2f4a8f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:48.635681 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160452e9-4e25-41f6-b869-2eaa5f7b5d56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8835a0b3c09c408bbcc8511f25b0d4e7, user_id=4c5dc81bffbf498a8986edfcfc857d09, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:48.638773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160452e9-4e25-41f6-b869-2eaa5f7b5d56 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:48.653725 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 967/1924] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:16:48.655497 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1c403-15f8-44b3-b5fb-1f5a7d2f4a8f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:48.664493 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 958/1925] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:48 2022] PUT /identity/v3/projects/8835a0b3c09c408bbcc8511f25b0d4e7/users/4c5dc81bffbf498a8986edfcfc857d09/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:48.665466 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160452e9-4e25-41f6-b869-2eaa5f7b5d56 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:48.671670 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1c403-15f8-44b3-b5fb-1f5a7d2f4a8f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:48.731730 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:48.785890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94b988-633a-4fd3-a714-fb7f6b57c6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:48.787515 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94b988-633a-4fd3-a714-fb7f6b57c6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:48.787992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94b988-633a-4fd3-a714-fb7f6b57c6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:48.788860 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94b988-633a-4fd3-a714-fb7f6b57c6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:48.790876 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94b988-633a-4fd3-a714-fb7f6b57c6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:48.792988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94b988-633a-4fd3-a714-fb7f6b57c6f8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:48.809140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 968/1926] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:48.810878 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94b988-633a-4fd3-a714-fb7f6b57c6f8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:48.828821 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94b988-633a-4fd3-a714-fb7f6b57c6f8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:48.834959 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160452e9-4e25-41f6-b869-2eaa5f7b5d56 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:48.838631 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287ab42-4690-43c0-8d8c-815b870184a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:48.839692 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287ab42-4690-43c0-8d8c-815b870184a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:48.840159 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287ab42-4690-43c0-8d8c-815b870184a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:48.840808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287ab42-4690-43c0-8d8c-815b870184a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:48.841700 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287ab42-4690-43c0-8d8c-815b870184a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:48.841949 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976d086-e9b5-4155-ae61-2323c254d065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:48.842798 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976d086-e9b5-4155-ae61-2323c254d065 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:48.843135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976d086-e9b5-4155-ae61-2323c254d065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:48.843931 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976d086-e9b5-4155-ae61-2323c254d065 admin admin] PATH_INFO: `/v3/projects/bb18dc20a53b4adf97e6df37b76343fd/users/8ee8d4aad91e4104b12f5184bc871885/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:48.845755 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287ab42-4690-43c0-8d8c-815b870184a8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:48.846734 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976d086-e9b5-4155-ae61-2323c254d065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb18dc20a53b4adf97e6df37b76343fd, user_id=8ee8d4aad91e4104b12f5184bc871885, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:48.849728 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976d086-e9b5-4155-ae61-2323c254d065 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:48.869561 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 959/1927] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:48 2022] PUT /identity/v3/projects/bb18dc20a53b4adf97e6df37b76343fd/users/8ee8d4aad91e4104b12f5184bc871885/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:48.871542 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc7567-c386-4b0b-9622-2d4062846e16 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:48.871828 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc7567-c386-4b0b-9622-2d4062846e16 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:48.872101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc7567-c386-4b0b-9622-2d4062846e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:48.903433 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 969/1928] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:48 2022] POST /identity/v3/projects => generated 393 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:48.904530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287ab42-4690-43c0-8d8c-815b870184a8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:48.913283 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-4acc7567-c386-4b0b-9622-2d4062846e16 None None] MFA Rules not processed for user `4c5dc81bffbf498a8986edfcfc857d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:48.916047 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-4acc7567-c386-4b0b-9622-2d4062846e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:49.028921 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287ab42-4690-43c0-8d8c-815b870184a8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:49.043996 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802dc2f-4fc0-47f9-a9f4-67fa918fa8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:49.044784 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802dc2f-4fc0-47f9-a9f4-67fa918fa8e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:49.045063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802dc2f-4fc0-47f9-a9f4-67fa918fa8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:49.045429 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802dc2f-4fc0-47f9-a9f4-67fa918fa8e0 admin admin] PATH_INFO: `/v3/projects/974568937ea74aab8a038acef7bbdbc3/users/e995f3f3e4e1451d81021d51746d7bd6/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:49.048678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802dc2f-4fc0-47f9-a9f4-67fa918fa8e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=974568937ea74aab8a038acef7bbdbc3, user_id=e995f3f3e4e1451d81021d51746d7bd6, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:49.052646 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 960/1929] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:49.054288 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57e37f-7295-4360-b132-cdf96854c60f None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:49.054580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57e37f-7295-4360-b132-cdf96854c60f None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:49.054854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57e37f-7295-4360-b132-cdf96854c60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:49.055240 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802dc2f-4fc0-47f9-a9f4-67fa918fa8e0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:49.080061 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 970/1930] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:48 2022] PUT /identity/v3/projects/974568937ea74aab8a038acef7bbdbc3/users/e995f3f3e4e1451d81021d51746d7bd6/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:49.082089 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802dc2f-4fc0-47f9-a9f4-67fa918fa8e0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:49.124529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-1e57e37f-7295-4360-b132-cdf96854c60f None None] MFA Rules not processed for user `8ee8d4aad91e4104b12f5184bc871885`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:49.127102 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-1e57e37f-7295-4360-b132-cdf96854c60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:49.174137 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:49.199924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802dc2f-4fc0-47f9-a9f4-67fa918fa8e0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:49.206891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08c7a6-ea4a-43c9-9a84-1cbefdcefdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:49.207675 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08c7a6-ea4a-43c9-9a84-1cbefdcefdb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:49.208020 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08c7a6-ea4a-43c9-9a84-1cbefdcefdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:49.208363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08c7a6-ea4a-43c9-9a84-1cbefdcefdb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:49.209167 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08c7a6-ea4a-43c9-9a84-1cbefdcefdb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:49.211320 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08c7a6-ea4a-43c9-9a84-1cbefdcefdb2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:49.240178 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 971/1931] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:49 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:49.242113 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08c7a6-ea4a-43c9-9a84-1cbefdcefdb2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:49.259809 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 961/1932] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:49.259809 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65387134-8f82-4c3c-a88b-ad9370bb4cdb None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:49.259809 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65387134-8f82-4c3c-a88b-ad9370bb4cdb None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:49.259809 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65387134-8f82-4c3c-a88b-ad9370bb4cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:49.264753 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08c7a6-ea4a-43c9-9a84-1cbefdcefdb2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:49.285249 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef33bb-9588-495d-a003-dbb18009ec77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:49.287738 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef33bb-9588-495d-a003-dbb18009ec77 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:49.288568 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef33bb-9588-495d-a003-dbb18009ec77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:49.289256 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef33bb-9588-495d-a003-dbb18009ec77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:49.291881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef33bb-9588-495d-a003-dbb18009ec77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:49.298166 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef33bb-9588-495d-a003-dbb18009ec77 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:49.308931 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-65387134-8f82-4c3c-a88b-ad9370bb4cdb None None] MFA Rules not processed for user `e995f3f3e4e1451d81021d51746d7bd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:49.310912 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-65387134-8f82-4c3c-a88b-ad9370bb4cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:49.399695 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 972/1933] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:49 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:49.401461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef33bb-9588-495d-a003-dbb18009ec77 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:49.424042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:49.527393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 962/1934] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:49.528930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65387134-8f82-4c3c-a88b-ad9370bb4cdb None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:49.529952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-65387134-8f82-4c3c-a88b-ad9370bb4cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:49.535861 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef33bb-9588-495d-a003-dbb18009ec77 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:49.545066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a56ab-1cb8-4a57-b26b-d53578d9bd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:49.546387 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a56ab-1cb8-4a57-b26b-d53578d9bd8b admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:49.547243 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a56ab-1cb8-4a57-b26b-d53578d9bd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:49.547628 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a56ab-1cb8-4a57-b26b-d53578d9bd8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:49.550382 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a56ab-1cb8-4a57-b26b-d53578d9bd8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:49.554153 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a56ab-1cb8-4a57-b26b-d53578d9bd8b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:49.572300 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 973/1935] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:49.572300 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a56ab-1cb8-4a57-b26b-d53578d9bd8b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:49.587275 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a56ab-1cb8-4a57-b26b-d53578d9bd8b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:49.606613 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2a141-0c5f-460d-83bf-b40c9c051633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:49.607631 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2a141-0c5f-460d-83bf-b40c9c051633 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:49.607929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2a141-0c5f-460d-83bf-b40c9c051633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:49.608206 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2a141-0c5f-460d-83bf-b40c9c051633 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:49.608853 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2a141-0c5f-460d-83bf-b40c9c051633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:49.613134 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2a141-0c5f-460d-83bf-b40c9c051633 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:49.658393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65387134-8f82-4c3c-a88b-ad9370bb4cdb None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:49.675490 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 974/1936] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:49 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:49.678931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2a141-0c5f-460d-83bf-b40c9c051633 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:49.685503 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dba2a141-0c5f-460d-83bf-b40c9c051633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:49.772223 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cf4fe-6304-420d-a239-e9172847c061 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:49.772863 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cf4fe-6304-420d-a239-e9172847c061 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:49.773146 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cf4fe-6304-420d-a239-e9172847c061 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:49.773652 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cf4fe-6304-420d-a239-e9172847c061 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:49.803622 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:49.843227 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2a141-0c5f-460d-83bf-b40c9c051633 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:49.852616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc529d-a475-408c-9e7f-5360325c61f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:49.853643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc529d-a475-408c-9e7f-5360325c61f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:49.854185 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc529d-a475-408c-9e7f-5360325c61f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:49.855219 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc529d-a475-408c-9e7f-5360325c61f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:49.880508 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47cf4fe-6304-420d-a239-e9172847c061 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:49.882218 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47cf4fe-6304-420d-a239-e9172847c061 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:49.914162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 963/1937] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:49.915988 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cf4fe-6304-420d-a239-e9172847c061 service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:49.929824 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cf4fe-6304-420d-a239-e9172847c061 service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:49.935743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8340ac-793b-4b6c-8a69-7dc5910c5f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:49.935969 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8340ac-793b-4b6c-8a69-7dc5910c5f5d admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:49.936095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8340ac-793b-4b6c-8a69-7dc5910c5f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:49.936380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8340ac-793b-4b6c-8a69-7dc5910c5f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:49.937365 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8340ac-793b-4b6c-8a69-7dc5910c5f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:49.940025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8340ac-793b-4b6c-8a69-7dc5910c5f5d admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:49.958027 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 964/1938] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:49.959408 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8340ac-793b-4b6c-8a69-7dc5910c5f5d admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:49.972346 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8340ac-793b-4b6c-8a69-7dc5910c5f5d admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:49.978349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dc082-a92f-4e17-9797-c68b4f83e084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:49.978986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dc082-a92f-4e17-9797-c68b4f83e084 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:49.979317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dc082-a92f-4e17-9797-c68b4f83e084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:49.979598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dc082-a92f-4e17-9797-c68b4f83e084 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:49.980541 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dc082-a92f-4e17-9797-c68b4f83e084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:49.982884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dc082-a92f-4e17-9797-c68b4f83e084 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:50.007545 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 965/1939] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:50.008232 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dc082-a92f-4e17-9797-c68b4f83e084 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:50.024783 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dc082-a92f-4e17-9797-c68b4f83e084 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:50.030177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66de42-7fef-4156-82c1-1b4cf65887e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:50.030719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66de42-7fef-4156-82c1-1b4cf65887e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:50.031928 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66de42-7fef-4156-82c1-1b4cf65887e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:50.032291 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66de42-7fef-4156-82c1-1b4cf65887e2 admin admin] PATH_INFO: `/v3/projects/3a45f38eee25414eaa97a5fad9bae30b/users/ea7da3f654984d2b8643de9d5ad1227f/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:50.041890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc529d-a475-408c-9e7f-5360325c61f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:50.046917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc529d-a475-408c-9e7f-5360325c61f5 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:50.062440 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66de42-7fef-4156-82c1-1b4cf65887e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a45f38eee25414eaa97a5fad9bae30b, user_id=ea7da3f654984d2b8643de9d5ad1227f, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:50.070563 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66de42-7fef-4156-82c1-1b4cf65887e2 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:50.074923 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 975/1940] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:50.089467 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc529d-a475-408c-9e7f-5360325c61f5 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:50.111402 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 966/1941] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:50 2022] PUT /identity/v3/projects/3a45f38eee25414eaa97a5fad9bae30b/users/ea7da3f654984d2b8643de9d5ad1227f/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:50.124292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7987e-76b0-430e-b939-a5050cd05ae6 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:50.124657 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7987e-76b0-430e-b939-a5050cd05ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:50.125076 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7987e-76b0-430e-b939-a5050cd05ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:50.133095 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc529d-a475-408c-9e7f-5360325c61f5 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:50.226351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-bfd7987e-76b0-430e-b939-a5050cd05ae6 None None] MFA Rules not processed for user `ea7da3f654984d2b8643de9d5ad1227f`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:50.228150 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-bfd7987e-76b0-430e-b939-a5050cd05ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:50.270084 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:50.304831 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e8a15-a38e-4826-8201-9718132e462a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:50.305538 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e8a15-a38e-4826-8201-9718132e462a admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:50.305826 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e8a15-a38e-4826-8201-9718132e462a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:50.306101 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e8a15-a38e-4826-8201-9718132e462a admin admin] PATH_INFO: `/v3/projects/70c5d0a49b9146f695057c3ea12096f1/users/fa0205fc09c043998334f37433f24a23/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:50.341762 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e8a15-a38e-4826-8201-9718132e462a admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c5d0a49b9146f695057c3ea12096f1, user_id=fa0205fc09c043998334f37433f24a23, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:50.344490 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e8a15-a38e-4826-8201-9718132e462a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:50.383396 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 976/1942] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:50 2022] PUT /identity/v3/projects/70c5d0a49b9146f695057c3ea12096f1/users/fa0205fc09c043998334f37433f24a23/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:50.389090 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e8a15-a38e-4826-8201-9718132e462a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:50.443473 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 967/1943] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:50.448257 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7987e-76b0-430e-b939-a5050cd05ae6 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:50.470185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7987e-76b0-430e-b939-a5050cd05ae6 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:50.564603 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e8a15-a38e-4826-8201-9718132e462a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:50.570641 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686a7f6-e893-496c-b3a4-b64fd17abae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:50.572009 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686a7f6-e893-496c-b3a4-b64fd17abae3 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:50.572495 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686a7f6-e893-496c-b3a4-b64fd17abae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:50.572774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686a7f6-e893-496c-b3a4-b64fd17abae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:50.573720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686a7f6-e893-496c-b3a4-b64fd17abae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:50.577388 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686a7f6-e893-496c-b3a4-b64fd17abae3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:50.607628 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:50.618781 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8068c4-f5cb-464a-8fe2-a176a95c5b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:50.619522 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8068c4-f5cb-464a-8fe2-a176a95c5b0b admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:50.619803 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8068c4-f5cb-464a-8fe2-a176a95c5b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:50.620080 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8068c4-f5cb-464a-8fe2-a176a95c5b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:50.620880 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8068c4-f5cb-464a-8fe2-a176a95c5b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:50.625023 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8068c4-f5cb-464a-8fe2-a176a95c5b0b admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:50.625219 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 977/1944] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:16:50.627128 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686a7f6-e893-496c-b3a4-b64fd17abae3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:50.657152 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686a7f6-e893-496c-b3a4-b64fd17abae3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:50.676906 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa69b7-b71d-4176-bd3b-647ce9b5fd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:50.679907 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa69b7-b71d-4176-bd3b-647ce9b5fd1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:50.680335 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa69b7-b71d-4176-bd3b-647ce9b5fd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:50.680658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa69b7-b71d-4176-bd3b-647ce9b5fd1d admin admin] PATH_INFO: `/v3/projects/70c5d0a49b9146f695057c3ea12096f1/users/fa0205fc09c043998334f37433f24a23/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:50.686892 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa69b7-b71d-4176-bd3b-647ce9b5fd1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c5d0a49b9146f695057c3ea12096f1, user_id=fa0205fc09c043998334f37433f24a23, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:50.691898 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa69b7-b71d-4176-bd3b-647ce9b5fd1d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:50.693963 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 968/1945] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:50 2022] POST /identity/v3/projects => generated 393 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:16:50.698057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8068c4-f5cb-464a-8fe2-a176a95c5b0b admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:50.729984 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 978/1946] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:50 2022] PUT /identity/v3/projects/70c5d0a49b9146f695057c3ea12096f1/users/fa0205fc09c043998334f37433f24a23/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:50.742162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e5563-c2b9-4907-adde-937d90de6e34 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:50.742567 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e5563-c2b9-4907-adde-937d90de6e34 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:50.744225 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e5563-c2b9-4907-adde-937d90de6e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:50.815052 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ac6e5563-c2b9-4907-adde-937d90de6e34 None None] MFA Rules not processed for user `fa0205fc09c043998334f37433f24a23`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:50.816294 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ac6e5563-c2b9-4907-adde-937d90de6e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:50.835970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8068c4-f5cb-464a-8fe2-a176a95c5b0b admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:50.940240 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 979/1947] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:50.942859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e5563-c2b9-4907-adde-937d90de6e34 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:51.011326 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:51.023240 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40448d-9c94-4caa-936b-2d9ee347c808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:51.024918 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40448d-9c94-4caa-936b-2d9ee347c808 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:51.025206 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40448d-9c94-4caa-936b-2d9ee347c808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:51.025481 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40448d-9c94-4caa-936b-2d9ee347c808 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:51.028788 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40448d-9c94-4caa-936b-2d9ee347c808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:51.032177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40448d-9c94-4caa-936b-2d9ee347c808 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:51.078160 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 969/1948] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:50 2022] POST /identity/v3/users => generated 303 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:51.079529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40448d-9c94-4caa-936b-2d9ee347c808 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:51.111543 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e5563-c2b9-4907-adde-937d90de6e34 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:51.125965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdb406-8ad6-4d81-ac54-0fa5d4f08246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:51.128808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdb406-8ad6-4d81-ac54-0fa5d4f08246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:51.129201 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdb406-8ad6-4d81-ac54-0fa5d4f08246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:51.130171 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdb406-8ad6-4d81-ac54-0fa5d4f08246 admin admin] PATH_INFO: `/v3/users/b75e0b2e3ee642249cb336f734a866c5` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:51.142752 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdb406-8ad6-4d81-ac54-0fa5d4f08246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b75e0b2e3ee642249cb336f734a866c5)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:51.150387 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdb406-8ad6-4d81-ac54-0fa5d4f08246 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:51.223183 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40448d-9c94-4caa-936b-2d9ee347c808 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:51.233361 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8641df-9a62-43ce-95d5-29df4321b594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:51.234388 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8641df-9a62-43ce-95d5-29df4321b594 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:51.234865 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8641df-9a62-43ce-95d5-29df4321b594 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:51.235308 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8641df-9a62-43ce-95d5-29df4321b594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:51.277842 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5bcdb406-8ad6-4d81-ac54-0fa5d4f08246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b75e0b2e3ee642249cb336f734a866c5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:51.278825 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5bcdb406-8ad6-4d81-ac54-0fa5d4f08246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b75e0b2e3ee642249cb336f734a866c5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:51.280679 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8641df-9a62-43ce-95d5-29df4321b594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:51.284443 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8641df-9a62-43ce-95d5-29df4321b594 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:51.296677 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5bcdb406-8ad6-4d81-ac54-0fa5d4f08246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b75e0b2e3ee642249cb336f734a866c5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:51.322734 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 970/1949] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:51.324146 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8641df-9a62-43ce-95d5-29df4321b594 service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:51.327847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5bcdb406-8ad6-4d81-ac54-0fa5d4f08246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b75e0b2e3ee642249cb336f734a866c5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:51.355675 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8641df-9a62-43ce-95d5-29df4321b594 service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:51.356636 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5bcdb406-8ad6-4d81-ac54-0fa5d4f08246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b75e0b2e3ee642249cb336f734a866c5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:51.366429 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288c609-5059-4419-b4d0-eb81e4d9e5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:51.366429 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288c609-5059-4419-b4d0-eb81e4d9e5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:51.366429 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288c609-5059-4419-b4d0-eb81e4d9e5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:51.366429 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288c609-5059-4419-b4d0-eb81e4d9e5f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:51.369215 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288c609-5059-4419-b4d0-eb81e4d9e5f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:51.374872 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288c609-5059-4419-b4d0-eb81e4d9e5f3 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:51.379747 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 980/1950] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:50 2022] DELETE /identity/v3/users/b75e0b2e3ee642249cb336f734a866c5 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:51.384215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdb406-8ad6-4d81-ac54-0fa5d4f08246 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:51.385976 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5bcdb406-8ad6-4d81-ac54-0fa5d4f08246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:51.406085 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 971/1951] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:51.408378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd000d0f-4465-4248-a32f-1095c27225f8 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:51.410889 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd000d0f-4465-4248-a32f-1095c27225f8 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:51.411364 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd000d0f-4465-4248-a32f-1095c27225f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:51.492313 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-dd000d0f-4465-4248-a32f-1095c27225f8 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:51.493762 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-dd000d0f-4465-4248-a32f-1095c27225f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:51.501849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:51.533833 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdb406-8ad6-4d81-ac54-0fa5d4f08246 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:51.544549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faec95e-e16d-46ae-bd47-d4b6014ff84d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:51.545187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faec95e-e16d-46ae-bd47-d4b6014ff84d service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:51.545475 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faec95e-e16d-46ae-bd47-d4b6014ff84d service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:51.545786 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faec95e-e16d-46ae-bd47-d4b6014ff84d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:51.565599 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5faec95e-e16d-46ae-bd47-d4b6014ff84d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:51.617442 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 972/1952] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:51.619298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd000d0f-4465-4248-a32f-1095c27225f8 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:51.622221 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-dd000d0f-4465-4248-a32f-1095c27225f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:51.645893 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd000d0f-4465-4248-a32f-1095c27225f8 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:51.653934 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1448826-4f4c-467f-8824-e56dd0099697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:51.655218 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1448826-4f4c-467f-8824-e56dd0099697 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:51.655751 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1448826-4f4c-467f-8824-e56dd0099697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:51.656176 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1448826-4f4c-467f-8824-e56dd0099697 admin admin] PATH_INFO: `/v3/projects/30399605c76d4ca4abae7109d2e8e1f6/users/e42b19fe826a4574a421eec3290de796/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:51.668068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faec95e-e16d-46ae-bd47-d4b6014ff84d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:51.670411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faec95e-e16d-46ae-bd47-d4b6014ff84d service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:51.677241 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1448826-4f4c-467f-8824-e56dd0099697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30399605c76d4ca4abae7109d2e8e1f6, user_id=e42b19fe826a4574a421eec3290de796, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:51.681139 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1448826-4f4c-467f-8824-e56dd0099697 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:51.694401 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 981/1953] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:51.695441 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faec95e-e16d-46ae-bd47-d4b6014ff84d service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:51.698856 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5faec95e-e16d-46ae-bd47-d4b6014ff84d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:51.712252 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 973/1954] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:51 2022] PUT /identity/v3/projects/30399605c76d4ca4abae7109d2e8e1f6/users/e42b19fe826a4574a421eec3290de796/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:51.712252 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1448826-4f4c-467f-8824-e56dd0099697 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:51.714717 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-a1448826-4f4c-467f-8824-e56dd0099697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:51.719723 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faec95e-e16d-46ae-bd47-d4b6014ff84d service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:51.725963 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:51.840304 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65223699-4697-49b4-9e08-493ae022eb94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:51.841033 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65223699-4697-49b4-9e08-493ae022eb94 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:51.841377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65223699-4697-49b4-9e08-493ae022eb94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:51.841712 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65223699-4697-49b4-9e08-493ae022eb94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:51.847258 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-65223699-4697-49b4-9e08-493ae022eb94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:51.865705 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1448826-4f4c-467f-8824-e56dd0099697 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:51.880098 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a72106-ca08-401a-8b4b-aed72f16cf67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:51.881039 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a72106-ca08-401a-8b4b-aed72f16cf67 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:51.883805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a72106-ca08-401a-8b4b-aed72f16cf67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:51.884148 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a72106-ca08-401a-8b4b-aed72f16cf67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:52.020713 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65223699-4697-49b4-9e08-493ae022eb94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:52.022200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65223699-4697-49b4-9e08-493ae022eb94 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:52.057338 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 982/1955] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:52.058061 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65223699-4697-49b4-9e08-493ae022eb94 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:52.059922 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a72106-ca08-401a-8b4b-aed72f16cf67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:52.061400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a72106-ca08-401a-8b4b-aed72f16cf67 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:52.081820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65223699-4697-49b4-9e08-493ae022eb94 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:52.085130 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 974/1956] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:52.110647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7735bf8-a0b6-4e81-acdf-28940b61f6ee None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:52.113135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7735bf8-a0b6-4e81-acdf-28940b61f6ee None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:52.113536 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7735bf8-a0b6-4e81-acdf-28940b61f6ee None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:52.116542 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b73e3-dfa2-4a30-86df-86ba7f7d11b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:52.117309 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b73e3-dfa2-4a30-86df-86ba7f7d11b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:52.117594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b73e3-dfa2-4a30-86df-86ba7f7d11b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:52.117838 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 975/1957] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 10 13:16:52 2022] GET /identity => generated 270 bytes in 29 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:16:52.118119 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b73e3-dfa2-4a30-86df-86ba7f7d11b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:52.119083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b73e3-dfa2-4a30-86df-86ba7f7d11b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:52.120807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b73e3-dfa2-4a30-86df-86ba7f7d11b0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:52.133318 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca46ef-7839-4546-b645-85adbdffe827 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:52.134355 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca46ef-7839-4546-b645-85adbdffe827 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:52.134635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca46ef-7839-4546-b645-85adbdffe827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:52.149767 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 983/1958] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:52.154568 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b73e3-dfa2-4a30-86df-86ba7f7d11b0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:52.180633 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-8cca46ef-7839-4546-b645-85adbdffe827 None None] MFA Rules not processed for user `7fd0f76f24ea481191dfd65fff2376af`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:52.182139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b73e3-dfa2-4a30-86df-86ba7f7d11b0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:52.183841 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-8cca46ef-7839-4546-b645-85adbdffe827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:52.207586 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21b971-196a-4384-9d51-4aaf2e84c97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:52.209973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21b971-196a-4384-9d51-4aaf2e84c97c admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:52.210371 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21b971-196a-4384-9d51-4aaf2e84c97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:52.212201 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21b971-196a-4384-9d51-4aaf2e84c97c admin admin] PATH_INFO: `/v3/projects/30399605c76d4ca4abae7109d2e8e1f6/users/e42b19fe826a4574a421eec3290de796/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:52.232890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21b971-196a-4384-9d51-4aaf2e84c97c admin admin] RBAC: Authorizing `identity:create_grant(project_id=30399605c76d4ca4abae7109d2e8e1f6, user_id=e42b19fe826a4574a421eec3290de796, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:52.244382 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21b971-196a-4384-9d51-4aaf2e84c97c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:52.295078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 984/1959] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:52 2022] PUT /identity/v3/projects/30399605c76d4ca4abae7109d2e8e1f6/users/e42b19fe826a4574a421eec3290de796/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:52.306000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b3131-c302-40ab-9558-fad65a82661a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:52.306570 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b3131-c302-40ab-9558-fad65a82661a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:52.306931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b3131-c302-40ab-9558-fad65a82661a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:52.340730 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:52.379566 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a71b3131-c302-40ab-9558-fad65a82661a None None] MFA Rules not processed for user `e42b19fe826a4574a421eec3290de796`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:52.384107 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a71b3131-c302-40ab-9558-fad65a82661a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:52.437042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 976/1960] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 10 13:16:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:16:52.458628 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca46ef-7839-4546-b645-85adbdffe827 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:52.460602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-8cca46ef-7839-4546-b645-85adbdffe827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:52.485920 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca46ef-7839-4546-b645-85adbdffe827 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:52.592762 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 985/1961] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:52 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:52.606749 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b3131-c302-40ab-9558-fad65a82661a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:52.690522 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5b039-ce53-4b25-9842-01575d6129c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:52.691282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5b039-ce53-4b25-9842-01575d6129c7 service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:52.691588 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5b039-ce53-4b25-9842-01575d6129c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:52.692009 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5b039-ce53-4b25-9842-01575d6129c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:52.717415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:52.718704 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5b039-ce53-4b25-9842-01575d6129c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:52.723266 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5b039-ce53-4b25-9842-01575d6129c7 service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:52.740081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 977/1962] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:16:52.835253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b3131-c302-40ab-9558-fad65a82661a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:52.847520 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a896f3-c69b-4687-bbbc-735b4f15c6c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:52.848544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a896f3-c69b-4687-bbbc-735b4f15c6c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:52.849634 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a896f3-c69b-4687-bbbc-735b4f15c6c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:52.850882 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a896f3-c69b-4687-bbbc-735b4f15c6c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:52.856971 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5b039-ce53-4b25-9842-01575d6129c7 service nova] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:52.860134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-01b5b039-ce53-4b25-9842-01575d6129c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:52.898551 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a896f3-c69b-4687-bbbc-735b4f15c6c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:52.903740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a896f3-c69b-4687-bbbc-735b4f15c6c6 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:52.933307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 986/1963] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:52 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:53.009037 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5b039-ce53-4b25-9842-01575d6129c7 service nova] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:53.016706 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcebfe-7d8c-4d35-9b44-ab3703d9332c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:53.016897 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a896f3-c69b-4687-bbbc-735b4f15c6c6 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:53.017025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcebfe-7d8c-4d35-9b44-ab3703d9332c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:53.019461 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcebfe-7d8c-4d35-9b44-ab3703d9332c admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:53.019667 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcebfe-7d8c-4d35-9b44-ab3703d9332c admin admin] PATH_INFO: `/v3/projects/1cb02d20c4624388b0e26038c4cc7532` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:53.022183 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bcebfe-7d8c-4d35-9b44-ab3703d9332c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb02d20c4624388b0e26038c4cc7532)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:53.027037 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bcebfe-7d8c-4d35-9b44-ab3703d9332c admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:53.027976 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a896f3-c69b-4687-bbbc-735b4f15c6c6 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:53.032341 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e10f33-3f70-463e-9a32-d6da823f82ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:53.033035 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e10f33-3f70-463e-9a32-d6da823f82ed service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:53.033353 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e10f33-3f70-463e-9a32-d6da823f82ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:53.033674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e10f33-3f70-463e-9a32-d6da823f82ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:53.037591 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c9e10f33-3f70-463e-9a32-d6da823f82ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:53.102738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-59bcebfe-7d8c-4d35-9b44-ab3703d9332c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb02d20c4624388b0e26038c4cc7532', 'request_id': 'req-59bcebfe-7d8c-4d35-9b44-ab3703d9332c'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:53.110514 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:53.114731 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-59bcebfe-7d8c-4d35-9b44-ab3703d9332c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb02d20c4624388b0e26038c4cc7532', 'request_id': 'req-59bcebfe-7d8c-4d35-9b44-ab3703d9332c'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:53.114898 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e10f33-3f70-463e-9a32-d6da823f82ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:53.116616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e10f33-3f70-463e-9a32-d6da823f82ed service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:53.131724 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-59bcebfe-7d8c-4d35-9b44-ab3703d9332c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb02d20c4624388b0e26038c4cc7532', 'request_id': 'req-59bcebfe-7d8c-4d35-9b44-ab3703d9332c'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:53.140626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 987/1964] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:53 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:53.151451 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-59bcebfe-7d8c-4d35-9b44-ab3703d9332c admin admin] The token cache is being invalidate because project 1cb02d20c4624388b0e26038c4cc7532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:53.151714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-59bcebfe-7d8c-4d35-9b44-ab3703d9332c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:53.152500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-59bcebfe-7d8c-4d35-9b44-ab3703d9332c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:53.154820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 978/1965] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:52 2022] DELETE /identity/v3/projects/1cb02d20c4624388b0e26038c4cc7532 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:16:53.158858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e10f33-3f70-463e-9a32-d6da823f82ed service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:53.173248 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e10f33-3f70-463e-9a32-d6da823f82ed service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:53.292428 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29dda8-09d8-452c-848d-15f3405b334b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:53.294006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29dda8-09d8-452c-848d-15f3405b334b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:53.295311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29dda8-09d8-452c-848d-15f3405b334b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:53.295620 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29dda8-09d8-452c-848d-15f3405b334b admin admin] PATH_INFO: `/v3/users/8ee8d4aad91e4104b12f5184bc871885` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:53.298762 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29dda8-09d8-452c-848d-15f3405b334b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ee8d4aad91e4104b12f5184bc871885)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:53.304231 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29dda8-09d8-452c-848d-15f3405b334b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:53.411665 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2f29dda8-09d8-452c-848d-15f3405b334b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ee8d4aad91e4104b12f5184bc871885'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:53.412480 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2f29dda8-09d8-452c-848d-15f3405b334b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ee8d4aad91e4104b12f5184bc871885'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:53.422581 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2f29dda8-09d8-452c-848d-15f3405b334b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ee8d4aad91e4104b12f5184bc871885'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:53.434322 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2f29dda8-09d8-452c-848d-15f3405b334b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ee8d4aad91e4104b12f5184bc871885'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:53.437833 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:53.485351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2f29dda8-09d8-452c-848d-15f3405b334b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ee8d4aad91e4104b12f5184bc871885'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:53.504821 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 988/1966] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:53 2022] DELETE /identity/v3/users/8ee8d4aad91e4104b12f5184bc871885 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:16:54.292543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcebfe-7d8c-4d35-9b44-ab3703d9332c admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:54.292543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-59bcebfe-7d8c-4d35-9b44-ab3703d9332c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:54.320532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcebfe-7d8c-4d35-9b44-ab3703d9332c admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:54.453706 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bc9dc-ca3e-4797-88c0-e3489d7b6905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:54.453941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bc9dc-ca3e-4797-88c0-e3489d7b6905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:54.454409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bc9dc-ca3e-4797-88c0-e3489d7b6905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:54.454674 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bc9dc-ca3e-4797-88c0-e3489d7b6905 admin admin] PATH_INFO: `/v3/projects/bb18dc20a53b4adf97e6df37b76343fd` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:54.456780 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bc9dc-ca3e-4797-88c0-e3489d7b6905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb18dc20a53b4adf97e6df37b76343fd)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:54.459299 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bc9dc-ca3e-4797-88c0-e3489d7b6905 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:54.542310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-9b8bc9dc-ca3e-4797-88c0-e3489d7b6905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb18dc20a53b4adf97e6df37b76343fd', 'request_id': 'req-9b8bc9dc-ca3e-4797-88c0-e3489d7b6905'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:54.557059 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-9b8bc9dc-ca3e-4797-88c0-e3489d7b6905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb18dc20a53b4adf97e6df37b76343fd', 'request_id': 'req-9b8bc9dc-ca3e-4797-88c0-e3489d7b6905'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:54.568475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-9b8bc9dc-ca3e-4797-88c0-e3489d7b6905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb18dc20a53b4adf97e6df37b76343fd', 'request_id': 'req-9b8bc9dc-ca3e-4797-88c0-e3489d7b6905'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:54.585751 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-9b8bc9dc-ca3e-4797-88c0-e3489d7b6905 admin admin] The token cache is being invalidate because project bb18dc20a53b4adf97e6df37b76343fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:54.586118 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-9b8bc9dc-ca3e-4797-88c0-e3489d7b6905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:54.586815 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-9b8bc9dc-ca3e-4797-88c0-e3489d7b6905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:54.594217 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 979/1967] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:54 2022] DELETE /identity/v3/projects/bb18dc20a53b4adf97e6df37b76343fd => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:54.596454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56834adf-8e16-4ef3-9194-e5f09efd3f2b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:54.597944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56834adf-8e16-4ef3-9194-e5f09efd3f2b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:54.598676 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56834adf-8e16-4ef3-9194-e5f09efd3f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:54.634178 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-56834adf-8e16-4ef3-9194-e5f09efd3f2b None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:54.635980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-56834adf-8e16-4ef3-9194-e5f09efd3f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:54.727254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 989/1968] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:54.730573 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2ddb3-e985-44a0-aca2-cf8b8d9f7e01 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:54.730995 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2ddb3-e985-44a0-aca2-cf8b8d9f7e01 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:54.731201 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2ddb3-e985-44a0-aca2-cf8b8d9f7e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:54.756888 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-6ee2ddb3-e985-44a0-aca2-cf8b8d9f7e01 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:54.758379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-6ee2ddb3-e985-44a0-aca2-cf8b8d9f7e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:54.766756 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 980/1969] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:54.772084 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56834adf-8e16-4ef3-9194-e5f09efd3f2b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:54.786965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56834adf-8e16-4ef3-9194-e5f09efd3f2b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:54.791778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5972d4-6440-4f4f-b2d7-14c45dc952b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:54.792408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5972d4-6440-4f4f-b2d7-14c45dc952b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:54.792686 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5972d4-6440-4f4f-b2d7-14c45dc952b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:54.792959 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5972d4-6440-4f4f-b2d7-14c45dc952b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:54.793617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5972d4-6440-4f4f-b2d7-14c45dc952b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:16:54.793920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5972d4-6440-4f4f-b2d7-14c45dc952b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:54.795589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5972d4-6440-4f4f-b2d7-14c45dc952b9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:54.813482 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 990/1970] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:16:54.816965 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2ddb3-e985-44a0-aca2-cf8b8d9f7e01 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:54.828679 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2ddb3-e985-44a0-aca2-cf8b8d9f7e01 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:54.834147 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6b7dd-8e51-4deb-9eae-81d233c503c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:54.834781 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6b7dd-8e51-4deb-9eae-81d233c503c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:54.835087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6b7dd-8e51-4deb-9eae-81d233c503c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:54.835365 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6b7dd-8e51-4deb-9eae-81d233c503c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:54.836098 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6b7dd-8e51-4deb-9eae-81d233c503c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:54.838188 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6b7dd-8e51-4deb-9eae-81d233c503c0 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:54.878387 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 981/1971] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:54 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:16:54.882432 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5972d4-6440-4f4f-b2d7-14c45dc952b9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:54.894317 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5972d4-6440-4f4f-b2d7-14c45dc952b9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:54.960171 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98250d4c-421f-4b29-843a-63461e260f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:54.960800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98250d4c-421f-4b29-843a-63461e260f22 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:54.961080 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98250d4c-421f-4b29-843a-63461e260f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:54.961360 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98250d4c-421f-4b29-843a-63461e260f22 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:54.962041 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98250d4c-421f-4b29-843a-63461e260f22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:54.964537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98250d4c-421f-4b29-843a-63461e260f22 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:55.004241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 991/1972] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:54 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:16:55.008467 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6b7dd-8e51-4deb-9eae-81d233c503c0 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:55.020031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6b7dd-8e51-4deb-9eae-81d233c503c0 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:55.025339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30db5b-8a44-4c18-8c10-98b94c8c3370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:55.026315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30db5b-8a44-4c18-8c10-98b94c8c3370 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:55.026668 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30db5b-8a44-4c18-8c10-98b94c8c3370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:55.027070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30db5b-8a44-4c18-8c10-98b94c8c3370 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:55.027806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30db5b-8a44-4c18-8c10-98b94c8c3370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:55.029697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30db5b-8a44-4c18-8c10-98b94c8c3370 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:55.043870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 982/1973] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:55.046984 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98250d4c-421f-4b29-843a-63461e260f22 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:55.072573 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98250d4c-421f-4b29-843a-63461e260f22 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:55.079743 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea03278-cce4-4e80-a5f9-37fa057a4114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:55.082382 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea03278-cce4-4e80-a5f9-37fa057a4114 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:55.082687 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea03278-cce4-4e80-a5f9-37fa057a4114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:55.083158 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea03278-cce4-4e80-a5f9-37fa057a4114 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:55.083773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea03278-cce4-4e80-a5f9-37fa057a4114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:55.085693 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea03278-cce4-4e80-a5f9-37fa057a4114 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:55.100289 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 992/1974] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:55.105554 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30db5b-8a44-4c18-8c10-98b94c8c3370 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:55.116783 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30db5b-8a44-4c18-8c10-98b94c8c3370 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:55.132286 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15243c-8436-432c-9ac0-720ec4cf7b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:55.133217 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15243c-8436-432c-9ac0-720ec4cf7b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:55.133588 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15243c-8436-432c-9ac0-720ec4cf7b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:55.138963 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15243c-8436-432c-9ac0-720ec4cf7b5f admin admin] PATH_INFO: `/v3/projects/51bf46117a0a48d4a9721cffcd6af5e9/users/f531200578194e35a20e28e4d11daa5f/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:55.173522 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15243c-8436-432c-9ac0-720ec4cf7b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=51bf46117a0a48d4a9721cffcd6af5e9, user_id=f531200578194e35a20e28e4d11daa5f, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:55.178679 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15243c-8436-432c-9ac0-720ec4cf7b5f admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:55.215552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 983/1975] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:55 2022] PUT /identity/v3/projects/51bf46117a0a48d4a9721cffcd6af5e9/users/f531200578194e35a20e28e4d11daa5f/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:55.218773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bbefd-27d4-472e-9d9b-b20ad902be2f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:55.219088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bbefd-27d4-472e-9d9b-b20ad902be2f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:55.219363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bbefd-27d4-472e-9d9b-b20ad902be2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:55.263877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-869bbefd-27d4-472e-9d9b-b20ad902be2f None None] MFA Rules not processed for user `f531200578194e35a20e28e4d11daa5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:55.266177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-869bbefd-27d4-472e-9d9b-b20ad902be2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:55.324371 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:55.392679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 993/1976] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:55.395076 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15243c-8436-432c-9ac0-720ec4cf7b5f admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:55.411347 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:55.520488 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15243c-8436-432c-9ac0-720ec4cf7b5f admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:55.526461 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8acd8-7efa-4161-a3d5-87a955d0157a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:55.527113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8acd8-7efa-4161-a3d5-87a955d0157a admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:55.527391 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8acd8-7efa-4161-a3d5-87a955d0157a admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:55.527660 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8acd8-7efa-4161-a3d5-87a955d0157a admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:55.528286 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8acd8-7efa-4161-a3d5-87a955d0157a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:55.530196 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8acd8-7efa-4161-a3d5-87a955d0157a admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:55.580012 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 984/1977] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:16:55 2022] POST /identity/v3/projects => generated 383 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:16:55.583215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bbefd-27d4-472e-9d9b-b20ad902be2f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:55.600226 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bbefd-27d4-472e-9d9b-b20ad902be2f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:55.747512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045ef81-23f6-4403-b295-f13c6667cdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:55.751872 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045ef81-23f6-4403-b295-f13c6667cdaf admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:55.752156 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045ef81-23f6-4403-b295-f13c6667cdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:55.752432 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045ef81-23f6-4403-b295-f13c6667cdaf admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:55.754924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045ef81-23f6-4403-b295-f13c6667cdaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:55.763170 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045ef81-23f6-4403-b295-f13c6667cdaf admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:55.819466 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 994/1978] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:16:55 2022] POST /identity/v3/users => generated 298 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:16:55.822977 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8acd8-7efa-4161-a3d5-87a955d0157a admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:55.838584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8acd8-7efa-4161-a3d5-87a955d0157a admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:55.870560 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe844a4b-dcf9-47eb-8508-f085e3cb0ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:55.872267 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe844a4b-dcf9-47eb-8508-f085e3cb0ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:55.872746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe844a4b-dcf9-47eb-8508-f085e3cb0ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:55.873196 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe844a4b-dcf9-47eb-8508-f085e3cb0ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:55.878398 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe844a4b-dcf9-47eb-8508-f085e3cb0ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:55.880689 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe844a4b-dcf9-47eb-8508-f085e3cb0ba6 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:55.911657 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 985/1979] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:16:55.913678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045ef81-23f6-4403-b295-f13c6667cdaf admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:55.915427 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e045ef81-23f6-4403-b295-f13c6667cdaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:55.916607 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe844a4b-dcf9-47eb-8508-f085e3cb0ba6 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:55.937516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe844a4b-dcf9-47eb-8508-f085e3cb0ba6 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:55.944228 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045ef81-23f6-4403-b295-f13c6667cdaf admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:55.961783 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a57770-1c2c-4bb8-813c-0a33d84a9676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:55.962953 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a57770-1c2c-4bb8-813c-0a33d84a9676 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:55.963364 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a57770-1c2c-4bb8-813c-0a33d84a9676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:55.963741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a57770-1c2c-4bb8-813c-0a33d84a9676 admin admin] PATH_INFO: `/v3/projects/0470f3ec707443e794e7db6f4cc9dbe6/users/06c563fcd24d4a268d6fa6c1b011d0f2/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:55.973651 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be0484-018f-4f7e-8e52-ab85d9e73a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:55.974325 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be0484-018f-4f7e-8e52-ab85d9e73a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:55.974612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be0484-018f-4f7e-8e52-ab85d9e73a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:55.974888 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be0484-018f-4f7e-8e52-ab85d9e73a6b admin admin] PATH_INFO: `/v3/users/23e11a02a50e49c4b48b07c918364b68` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:55.978676 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be0484-018f-4f7e-8e52-ab85d9e73a6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=23e11a02a50e49c4b48b07c918364b68)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:55.981171 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be0484-018f-4f7e-8e52-ab85d9e73a6b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:56.022342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a57770-1c2c-4bb8-813c-0a33d84a9676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0470f3ec707443e794e7db6f4cc9dbe6, user_id=06c563fcd24d4a268d6fa6c1b011d0f2, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:56.031375 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a57770-1c2c-4bb8-813c-0a33d84a9676 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:56.059708 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 986/1980] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:55 2022] PUT /identity/v3/projects/0470f3ec707443e794e7db6f4cc9dbe6/users/06c563fcd24d4a268d6fa6c1b011d0f2/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:56.063647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a57770-1c2c-4bb8-813c-0a33d84a9676 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:56.065218 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a2be0484-018f-4f7e-8e52-ab85d9e73a6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23e11a02a50e49c4b48b07c918364b68'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:56.066245 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a2be0484-018f-4f7e-8e52-ab85d9e73a6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23e11a02a50e49c4b48b07c918364b68'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:56.077305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a2be0484-018f-4f7e-8e52-ab85d9e73a6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23e11a02a50e49c4b48b07c918364b68'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:56.091546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a2be0484-018f-4f7e-8e52-ab85d9e73a6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23e11a02a50e49c4b48b07c918364b68'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:56.123999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a2be0484-018f-4f7e-8e52-ab85d9e73a6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23e11a02a50e49c4b48b07c918364b68'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:56.138923 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 995/1981] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:55 2022] DELETE /identity/v3/users/23e11a02a50e49c4b48b07c918364b68 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:16:56.144866 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb109d5-dea6-4090-8adb-7f595cf3b7aa None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:56.145241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb109d5-dea6-4090-8adb-7f595cf3b7aa None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:56.145405 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb109d5-dea6-4090-8adb-7f595cf3b7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:56.197152 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6eb109d5-dea6-4090-8adb-7f595cf3b7aa None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:56.199615 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6eb109d5-dea6-4090-8adb-7f595cf3b7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:56.227642 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a57770-1c2c-4bb8-813c-0a33d84a9676 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:56.278581 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:56.360890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 996/1982] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:56.365128 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b22ff-841b-4bd6-9f35-ce5db59e8970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:56.366260 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b22ff-841b-4bd6-9f35-ce5db59e8970 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:56.366260 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b22ff-841b-4bd6-9f35-ce5db59e8970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:56.366260 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b22ff-841b-4bd6-9f35-ce5db59e8970 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:56.367314 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b22ff-841b-4bd6-9f35-ce5db59e8970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:56.368928 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b22ff-841b-4bd6-9f35-ce5db59e8970 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:56.381450 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 987/1983] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:16:56.385369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb109d5-dea6-4090-8adb-7f595cf3b7aa None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:56.387216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6eb109d5-dea6-4090-8adb-7f595cf3b7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:56.399161 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b22ff-841b-4bd6-9f35-ce5db59e8970 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:56.402055 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c20b22ff-841b-4bd6-9f35-ce5db59e8970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:56.407294 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb109d5-dea6-4090-8adb-7f595cf3b7aa None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:56.410240 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:56.412550 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56df21-1ce3-4bed-bfc7-f807fa290c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:56.413999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56df21-1ce3-4bed-bfc7-f807fa290c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:56.414287 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56df21-1ce3-4bed-bfc7-f807fa290c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:56.414572 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56df21-1ce3-4bed-bfc7-f807fa290c02 admin admin] PATH_INFO: `/v3/projects/0470f3ec707443e794e7db6f4cc9dbe6/users/06c563fcd24d4a268d6fa6c1b011d0f2/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:56.417663 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56df21-1ce3-4bed-bfc7-f807fa290c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0470f3ec707443e794e7db6f4cc9dbe6, user_id=06c563fcd24d4a268d6fa6c1b011d0f2, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:56.422086 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56df21-1ce3-4bed-bfc7-f807fa290c02 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:56.446769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 997/1984] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:16:56 2022] PUT /identity/v3/projects/0470f3ec707443e794e7db6f4cc9dbe6/users/06c563fcd24d4a268d6fa6c1b011d0f2/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:56.449139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c3606-d02b-47e7-ab40-cb049d26da01 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:56.449671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c3606-d02b-47e7-ab40-cb049d26da01 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:56.450174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c3606-d02b-47e7-ab40-cb049d26da01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:56.484099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-536c3606-d02b-47e7-ab40-cb049d26da01 None None] MFA Rules not processed for user `06c563fcd24d4a268d6fa6c1b011d0f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:56.485785 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-536c3606-d02b-47e7-ab40-cb049d26da01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:56.517529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b22ff-841b-4bd6-9f35-ce5db59e8970 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:56.593606 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 998/1985] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:16:56.605701 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c3606-d02b-47e7-ab40-cb049d26da01 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:56.608740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-536c3606-d02b-47e7-ab40-cb049d26da01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:56.612876 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4015a-a318-4226-afab-bd085e8102f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:56.613491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4015a-a318-4226-afab-bd085e8102f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:56.613773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4015a-a318-4226-afab-bd085e8102f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:56.614049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4015a-a318-4226-afab-bd085e8102f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:56.678285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c3606-d02b-47e7-ab40-cb049d26da01 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:56.682137 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32049934-ab29-4b0d-b4a0-110540d1f85c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:56.682775 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32049934-ab29-4b0d-b4a0-110540d1f85c service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:56.683093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32049934-ab29-4b0d-b4a0-110540d1f85c service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:56.683508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32049934-ab29-4b0d-b4a0-110540d1f85c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:56.685282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4015a-a318-4226-afab-bd085e8102f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:56.686744 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4015a-a318-4226-afab-bd085e8102f1 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:56.695453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32049934-ab29-4b0d-b4a0-110540d1f85c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:56.697131 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32049934-ab29-4b0d-b4a0-110540d1f85c service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:56.699402 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 988/1986] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:16:56.714447 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 999/1987] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:56.826140 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4015a-a318-4226-afab-bd085e8102f1 service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:56.837925 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4015a-a318-4226-afab-bd085e8102f1 service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:56.842436 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c305003-dcfb-4a6a-b5b7-6bdc30df8c14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:56.843145 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c305003-dcfb-4a6a-b5b7-6bdc30df8c14 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:56.843459 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c305003-dcfb-4a6a-b5b7-6bdc30df8c14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:56.843867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c305003-dcfb-4a6a-b5b7-6bdc30df8c14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:56.846269 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-8c305003-dcfb-4a6a-b5b7-6bdc30df8c14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:56.936028 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c305003-dcfb-4a6a-b5b7-6bdc30df8c14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:56.937544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c305003-dcfb-4a6a-b5b7-6bdc30df8c14 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:56.962770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 989/1988] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:57.119287 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32049934-ab29-4b0d-b4a0-110540d1f85c service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:57.120914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-32049934-ab29-4b0d-b4a0-110540d1f85c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:57.144230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32049934-ab29-4b0d-b4a0-110540d1f85c service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:57.154081 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb432e2-8028-4c25-a842-ca173ea24d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:57.154940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb432e2-8028-4c25-a842-ca173ea24d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:57.155412 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb432e2-8028-4c25-a842-ca173ea24d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:57.155844 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb432e2-8028-4c25-a842-ca173ea24d65 admin admin] PATH_INFO: `/v3/projects/fc7835ab69c24a69af84d316e0c07342` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:57.157706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb432e2-8028-4c25-a842-ca173ea24d65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc7835ab69c24a69af84d316e0c07342)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:57.160953 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb432e2-8028-4c25-a842-ca173ea24d65 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:57.251146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1bb432e2-8028-4c25-a842-ca173ea24d65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc7835ab69c24a69af84d316e0c07342', 'request_id': 'req-1bb432e2-8028-4c25-a842-ca173ea24d65'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:57.253128 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:57.272848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1bb432e2-8028-4c25-a842-ca173ea24d65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc7835ab69c24a69af84d316e0c07342', 'request_id': 'req-1bb432e2-8028-4c25-a842-ca173ea24d65'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:57.289317 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1bb432e2-8028-4c25-a842-ca173ea24d65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc7835ab69c24a69af84d316e0c07342', 'request_id': 'req-1bb432e2-8028-4c25-a842-ca173ea24d65'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:57.302637 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1bb432e2-8028-4c25-a842-ca173ea24d65 admin admin] The token cache is being invalidate because project fc7835ab69c24a69af84d316e0c07342 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:57.302931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1bb432e2-8028-4c25-a842-ca173ea24d65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:57.303631 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1bb432e2-8028-4c25-a842-ca173ea24d65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:57.305169 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1000/1989] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:57 2022] DELETE /identity/v3/projects/fc7835ab69c24a69af84d316e0c07342 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:57.309473 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c305003-dcfb-4a6a-b5b7-6bdc30df8c14 service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:57.322621 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c305003-dcfb-4a6a-b5b7-6bdc30df8c14 service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:57.329813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:57.407420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d6757-4f36-493c-9167-015d316aa3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:57.407420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d6757-4f36-493c-9167-015d316aa3bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:57.407420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d6757-4f36-493c-9167-015d316aa3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:57.407420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d6757-4f36-493c-9167-015d316aa3bc admin admin] PATH_INFO: `/v3/users/4c5dc81bffbf498a8986edfcfc857d09` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:57.408204 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d6757-4f36-493c-9167-015d316aa3bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c5dc81bffbf498a8986edfcfc857d09)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:57.409709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb432e2-8028-4c25-a842-ca173ea24d65 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:57.410277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d6757-4f36-493c-9167-015d316aa3bc admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:57.412233 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1bb432e2-8028-4c25-a842-ca173ea24d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:57.432093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb432e2-8028-4c25-a842-ca173ea24d65 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:57.438075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cc19b-525e-4390-b814-1d7f535f31b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:57.438800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cc19b-525e-4390-b814-1d7f535f31b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:57.439230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cc19b-525e-4390-b814-1d7f535f31b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:57.439421 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cc19b-525e-4390-b814-1d7f535f31b2 admin admin] PATH_INFO: `/v3/users/f531200578194e35a20e28e4d11daa5f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:57.441622 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cc19b-525e-4390-b814-1d7f535f31b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f531200578194e35a20e28e4d11daa5f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:57.443713 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cc19b-525e-4390-b814-1d7f535f31b2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:57.471504 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-ce9d6757-4f36-493c-9167-015d316aa3bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c5dc81bffbf498a8986edfcfc857d09'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:57.472335 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-ce9d6757-4f36-493c-9167-015d316aa3bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c5dc81bffbf498a8986edfcfc857d09'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:57.486463 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-ce9d6757-4f36-493c-9167-015d316aa3bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c5dc81bffbf498a8986edfcfc857d09'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:57.496823 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-ce9d6757-4f36-493c-9167-015d316aa3bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c5dc81bffbf498a8986edfcfc857d09'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:57.518025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-ce9d6757-4f36-493c-9167-015d316aa3bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c5dc81bffbf498a8986edfcfc857d09'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:57.532058 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 990/1990] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:57 2022] DELETE /identity/v3/users/4c5dc81bffbf498a8986edfcfc857d09 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:57.582403 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bc2cc19b-525e-4390-b814-1d7f535f31b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f531200578194e35a20e28e4d11daa5f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:57.591824 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bc2cc19b-525e-4390-b814-1d7f535f31b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f531200578194e35a20e28e4d11daa5f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:57.595490 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d6757-4f36-493c-9167-015d316aa3bc admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:57.597955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-ce9d6757-4f36-493c-9167-015d316aa3bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:57.602897 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bc2cc19b-525e-4390-b814-1d7f535f31b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f531200578194e35a20e28e4d11daa5f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:57.617829 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bc2cc19b-525e-4390-b814-1d7f535f31b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f531200578194e35a20e28e4d11daa5f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:57.645343 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bc2cc19b-525e-4390-b814-1d7f535f31b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f531200578194e35a20e28e4d11daa5f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:57.655447 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1001/1991] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:57 2022] DELETE /identity/v3/users/f531200578194e35a20e28e4d11daa5f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:57.662033 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f42b1-9c13-4b6b-83e3-07ff685ad868 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:57.662623 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f42b1-9c13-4b6b-83e3-07ff685ad868 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:57.663060 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f42b1-9c13-4b6b-83e3-07ff685ad868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:57.727812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-094f42b1-9c13-4b6b-83e3-07ff685ad868 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:57.727812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-094f42b1-9c13-4b6b-83e3-07ff685ad868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:57.748188 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d6757-4f36-493c-9167-015d316aa3bc admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:57.828437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1002/1992] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:57.829471 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f42b1-9c13-4b6b-83e3-07ff685ad868 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:57.831560 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-094f42b1-9c13-4b6b-83e3-07ff685ad868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:57.848393 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f42b1-9c13-4b6b-83e3-07ff685ad868 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:57.854821 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39bb28-07a7-4ed8-92b9-c49d5b8ba100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:57.855683 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39bb28-07a7-4ed8-92b9-c49d5b8ba100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:57.856242 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39bb28-07a7-4ed8-92b9-c49d5b8ba100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:57.856626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39bb28-07a7-4ed8-92b9-c49d5b8ba100 admin admin] PATH_INFO: `/v3/users/ea7da3f654984d2b8643de9d5ad1227f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:57.858204 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:57.860457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39bb28-07a7-4ed8-92b9-c49d5b8ba100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea7da3f654984d2b8643de9d5ad1227f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:57.863249 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39bb28-07a7-4ed8-92b9-c49d5b8ba100 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:57.885685 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f5423-5e39-4036-ab84-a8c5d14e872e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:57.886916 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f5423-5e39-4036-ab84-a8c5d14e872e service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:57.887062 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f5423-5e39-4036-ab84-a8c5d14e872e service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:57.887339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f5423-5e39-4036-ab84-a8c5d14e872e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:57.891501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-079f5423-5e39-4036-ab84-a8c5d14e872e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:57.931702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:INSERT=2,keystone:DELETE=20,keystone:SELECT=78 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:57.934275 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4e39bb28-07a7-4ed8-92b9-c49d5b8ba100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea7da3f654984d2b8643de9d5ad1227f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:57.936350 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4e39bb28-07a7-4ed8-92b9-c49d5b8ba100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea7da3f654984d2b8643de9d5ad1227f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:57.949261 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4e39bb28-07a7-4ed8-92b9-c49d5b8ba100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea7da3f654984d2b8643de9d5ad1227f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:57.966389 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4e39bb28-07a7-4ed8-92b9-c49d5b8ba100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea7da3f654984d2b8643de9d5ad1227f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:57.991044 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4e39bb28-07a7-4ed8-92b9-c49d5b8ba100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea7da3f654984d2b8643de9d5ad1227f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:58.003331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1003/1993] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:57 2022] DELETE /identity/v3/users/ea7da3f654984d2b8643de9d5ad1227f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:58.004697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39bb28-07a7-4ed8-92b9-c49d5b8ba100 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:58.007315 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4e39bb28-07a7-4ed8-92b9-c49d5b8ba100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:58.024481 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f5423-5e39-4036-ab84-a8c5d14e872e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:58.026061 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f5423-5e39-4036-ab84-a8c5d14e872e service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:58.036945 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 991/1994] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:58.038216 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166f29e-8203-4fe2-bd08-35ddd820d3fe None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:58.038501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166f29e-8203-4fe2-bd08-35ddd820d3fe None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:58.038955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166f29e-8203-4fe2-bd08-35ddd820d3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:58.069161 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-6166f29e-8203-4fe2-bd08-35ddd820d3fe None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:58.071209 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-6166f29e-8203-4fe2-bd08-35ddd820d3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:58.115177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39bb28-07a7-4ed8-92b9-c49d5b8ba100 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:58.120541 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feee62a-7bf0-43e8-9f28-e54ffbb4de6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:58.120737 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feee62a-7bf0-43e8-9f28-e54ffbb4de6c service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:58.121120 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feee62a-7bf0-43e8-9f28-e54ffbb4de6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:58.121517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feee62a-7bf0-43e8-9f28-e54ffbb4de6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:58.127553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1feee62a-7bf0-43e8-9f28-e54ffbb4de6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:58.192725 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 992/1995] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:58.194598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166f29e-8203-4fe2-bd08-35ddd820d3fe None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:58.197407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-6166f29e-8203-4fe2-bd08-35ddd820d3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:58.211854 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feee62a-7bf0-43e8-9f28-e54ffbb4de6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:58.213675 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feee62a-7bf0-43e8-9f28-e54ffbb4de6c service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:58.225922 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1004/1996] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:58.227075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feee62a-7bf0-43e8-9f28-e54ffbb4de6c service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:58.228980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1feee62a-7bf0-43e8-9f28-e54ffbb4de6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:58.240305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166f29e-8203-4fe2-bd08-35ddd820d3fe None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:58.243205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feee62a-7bf0-43e8-9f28-e54ffbb4de6c service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:58.250208 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980eb43-a03d-49dd-895f-88a0bc0c12ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:58.250838 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980eb43-a03d-49dd-895f-88a0bc0c12ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:58.251140 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980eb43-a03d-49dd-895f-88a0bc0c12ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:58.251494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980eb43-a03d-49dd-895f-88a0bc0c12ef admin admin] PATH_INFO: `/v3/projects/8835a0b3c09c408bbcc8511f25b0d4e7` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:58.253321 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7a947-4f41-4e0f-ba0a-9671a3aa2265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:58.253899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7a947-4f41-4e0f-ba0a-9671a3aa2265 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:58.254171 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7a947-4f41-4e0f-ba0a-9671a3aa2265 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:58.254436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7a947-4f41-4e0f-ba0a-9671a3aa2265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:58.256340 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980eb43-a03d-49dd-895f-88a0bc0c12ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=8835a0b3c09c408bbcc8511f25b0d4e7)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:58.260319 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980eb43-a03d-49dd-895f-88a0bc0c12ef admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:58.274798 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7a947-4f41-4e0f-ba0a-9671a3aa2265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:58.277975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7a947-4f41-4e0f-ba0a-9671a3aa2265 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:58.292205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1005/1997] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:16:58.346002 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7980eb43-a03d-49dd-895f-88a0bc0c12ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8835a0b3c09c408bbcc8511f25b0d4e7', 'request_id': 'req-7980eb43-a03d-49dd-895f-88a0bc0c12ef'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:58.354602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7980eb43-a03d-49dd-895f-88a0bc0c12ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8835a0b3c09c408bbcc8511f25b0d4e7', 'request_id': 'req-7980eb43-a03d-49dd-895f-88a0bc0c12ef'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:58.368659 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7980eb43-a03d-49dd-895f-88a0bc0c12ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8835a0b3c09c408bbcc8511f25b0d4e7', 'request_id': 'req-7980eb43-a03d-49dd-895f-88a0bc0c12ef'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:58.410598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7980eb43-a03d-49dd-895f-88a0bc0c12ef admin admin] The token cache is being invalidate because project 8835a0b3c09c408bbcc8511f25b0d4e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:58.411277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7980eb43-a03d-49dd-895f-88a0bc0c12ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:58.415067 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7980eb43-a03d-49dd-895f-88a0bc0c12ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:58.422438 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 993/1998] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:58 2022] DELETE /identity/v3/projects/8835a0b3c09c408bbcc8511f25b0d4e7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:58.423701 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7a947-4f41-4e0f-ba0a-9671a3aa2265 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:58.463428 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7a947-4f41-4e0f-ba0a-9671a3aa2265 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:58.599293 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf856f-6a28-4f2d-9194-1f43cf9d7916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:58.600476 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf856f-6a28-4f2d-9194-1f43cf9d7916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:58.600761 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf856f-6a28-4f2d-9194-1f43cf9d7916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:58.601737 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf856f-6a28-4f2d-9194-1f43cf9d7916 admin admin] PATH_INFO: `/v3/users/fa0205fc09c043998334f37433f24a23` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:58.603203 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf856f-6a28-4f2d-9194-1f43cf9d7916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa0205fc09c043998334f37433f24a23)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:58.606319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf856f-6a28-4f2d-9194-1f43cf9d7916 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:58.610748 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:58.628210 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980eb43-a03d-49dd-895f-88a0bc0c12ef admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:58.630339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7980eb43-a03d-49dd-895f-88a0bc0c12ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:58.652788 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980eb43-a03d-49dd-895f-88a0bc0c12ef admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:58.666025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e5282-51b4-4d51-a4ff-a5d508ecd633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:58.668410 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e5282-51b4-4d51-a4ff-a5d508ecd633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:58.668779 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e5282-51b4-4d51-a4ff-a5d508ecd633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:58.672001 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e5282-51b4-4d51-a4ff-a5d508ecd633 admin admin] PATH_INFO: `/v3/projects/51bf46117a0a48d4a9721cffcd6af5e9` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:58.674158 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e5282-51b4-4d51-a4ff-a5d508ecd633 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51bf46117a0a48d4a9721cffcd6af5e9)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:58.676702 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e5282-51b4-4d51-a4ff-a5d508ecd633 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:58.724390 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-29bf856f-6a28-4f2d-9194-1f43cf9d7916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa0205fc09c043998334f37433f24a23'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:58.726289 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-29bf856f-6a28-4f2d-9194-1f43cf9d7916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa0205fc09c043998334f37433f24a23'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:58.728368 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:58.745556 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-29bf856f-6a28-4f2d-9194-1f43cf9d7916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa0205fc09c043998334f37433f24a23'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:58.766094 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-29bf856f-6a28-4f2d-9194-1f43cf9d7916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa0205fc09c043998334f37433f24a23'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:58.795545 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-29bf856f-6a28-4f2d-9194-1f43cf9d7916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa0205fc09c043998334f37433f24a23'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:58.797911 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d47e5282-51b4-4d51-a4ff-a5d508ecd633 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51bf46117a0a48d4a9721cffcd6af5e9', 'request_id': 'req-d47e5282-51b4-4d51-a4ff-a5d508ecd633'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:58.809910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1006/1999] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:58 2022] DELETE /identity/v3/users/fa0205fc09c043998334f37433f24a23 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:16:58.815470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d47e5282-51b4-4d51-a4ff-a5d508ecd633 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51bf46117a0a48d4a9721cffcd6af5e9', 'request_id': 'req-d47e5282-51b4-4d51-a4ff-a5d508ecd633'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:58.825450 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d47e5282-51b4-4d51-a4ff-a5d508ecd633 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51bf46117a0a48d4a9721cffcd6af5e9', 'request_id': 'req-d47e5282-51b4-4d51-a4ff-a5d508ecd633'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:58.830168 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf856f-6a28-4f2d-9194-1f43cf9d7916 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:58.832000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-29bf856f-6a28-4f2d-9194-1f43cf9d7916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:58.868391 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d47e5282-51b4-4d51-a4ff-a5d508ecd633 admin admin] The token cache is being invalidate because project 51bf46117a0a48d4a9721cffcd6af5e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:58.869001 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d47e5282-51b4-4d51-a4ff-a5d508ecd633 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:58.869930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d47e5282-51b4-4d51-a4ff-a5d508ecd633 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:58.871932 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 994/2000] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:58 2022] DELETE /identity/v3/projects/51bf46117a0a48d4a9721cffcd6af5e9 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:16:58.876664 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e5282-51b4-4d51-a4ff-a5d508ecd633 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:58.878689 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d47e5282-51b4-4d51-a4ff-a5d508ecd633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:58.996545 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e5282-51b4-4d51-a4ff-a5d508ecd633 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:59.008552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc477aa-1a07-4251-8af6-bfb323e4e869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:59.009317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc477aa-1a07-4251-8af6-bfb323e4e869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:59.009606 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc477aa-1a07-4251-8af6-bfb323e4e869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:59.009826 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf856f-6a28-4f2d-9194-1f43cf9d7916 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:59.009984 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc477aa-1a07-4251-8af6-bfb323e4e869 admin admin] PATH_INFO: `/v3/users/06c563fcd24d4a268d6fa6c1b011d0f2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:59.011292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc477aa-1a07-4251-8af6-bfb323e4e869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06c563fcd24d4a268d6fa6c1b011d0f2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:59.013590 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc477aa-1a07-4251-8af6-bfb323e4e869 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:59.017521 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447df19f-d351-4506-8126-1c7b9234af39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:59.019187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447df19f-d351-4506-8126-1c7b9234af39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:59.019912 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447df19f-d351-4506-8126-1c7b9234af39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:59.020799 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447df19f-d351-4506-8126-1c7b9234af39 admin admin] PATH_INFO: `/v3/projects/3a45f38eee25414eaa97a5fad9bae30b` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:59.024653 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447df19f-d351-4506-8126-1c7b9234af39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a45f38eee25414eaa97a5fad9bae30b)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:59.027503 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447df19f-d351-4506-8126-1c7b9234af39 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:59.093617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7bc477aa-1a07-4251-8af6-bfb323e4e869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06c563fcd24d4a268d6fa6c1b011d0f2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.096402 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7bc477aa-1a07-4251-8af6-bfb323e4e869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06c563fcd24d4a268d6fa6c1b011d0f2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.110714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7bc477aa-1a07-4251-8af6-bfb323e4e869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06c563fcd24d4a268d6fa6c1b011d0f2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.122180 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7bc477aa-1a07-4251-8af6-bfb323e4e869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06c563fcd24d4a268d6fa6c1b011d0f2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.123587 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-447df19f-d351-4506-8126-1c7b9234af39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a45f38eee25414eaa97a5fad9bae30b', 'request_id': 'req-447df19f-d351-4506-8126-1c7b9234af39'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.135039 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-447df19f-d351-4506-8126-1c7b9234af39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a45f38eee25414eaa97a5fad9bae30b', 'request_id': 'req-447df19f-d351-4506-8126-1c7b9234af39'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.144819 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7bc477aa-1a07-4251-8af6-bfb323e4e869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06c563fcd24d4a268d6fa6c1b011d0f2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.146509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-447df19f-d351-4506-8126-1c7b9234af39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a45f38eee25414eaa97a5fad9bae30b', 'request_id': 'req-447df19f-d351-4506-8126-1c7b9234af39'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.161198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-447df19f-d351-4506-8126-1c7b9234af39 admin admin] The token cache is being invalidate because project 3a45f38eee25414eaa97a5fad9bae30b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:59.161646 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-447df19f-d351-4506-8126-1c7b9234af39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.161807 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 995/2001] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:58 2022] DELETE /identity/v3/users/06c563fcd24d4a268d6fa6c1b011d0f2 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:59.163980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-447df19f-d351-4506-8126-1c7b9234af39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.169599 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1007/2002] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:58 2022] DELETE /identity/v3/projects/3a45f38eee25414eaa97a5fad9bae30b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:59.173753 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc477aa-1a07-4251-8af6-bfb323e4e869 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:59.175315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7bc477aa-1a07-4251-8af6-bfb323e4e869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:59.225114 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:59.320595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc477aa-1a07-4251-8af6-bfb323e4e869 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:59.327727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf858ccd-8acb-40b0-aa10-9baf932f2775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:59.330150 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf858ccd-8acb-40b0-aa10-9baf932f2775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:59.330697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf858ccd-8acb-40b0-aa10-9baf932f2775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:59.331881 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf858ccd-8acb-40b0-aa10-9baf932f2775 admin admin] PATH_INFO: `/v3/users/e42b19fe826a4574a421eec3290de796` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:59.333413 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf858ccd-8acb-40b0-aa10-9baf932f2775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e42b19fe826a4574a421eec3290de796)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:59.336259 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf858ccd-8acb-40b0-aa10-9baf932f2775 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:59.423330 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-bf858ccd-8acb-40b0-aa10-9baf932f2775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e42b19fe826a4574a421eec3290de796'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.424358 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-bf858ccd-8acb-40b0-aa10-9baf932f2775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e42b19fe826a4574a421eec3290de796'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.430443 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447df19f-d351-4506-8126-1c7b9234af39 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:59.432179 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-447df19f-d351-4506-8126-1c7b9234af39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:59.434887 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-bf858ccd-8acb-40b0-aa10-9baf932f2775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e42b19fe826a4574a421eec3290de796'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.445749 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:59.455394 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-bf858ccd-8acb-40b0-aa10-9baf932f2775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e42b19fe826a4574a421eec3290de796'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.487628 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-bf858ccd-8acb-40b0-aa10-9baf932f2775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e42b19fe826a4574a421eec3290de796'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.495271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 996/2003] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:16:59 2022] DELETE /identity/v3/users/e42b19fe826a4574a421eec3290de796 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:59.552802 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447df19f-d351-4506-8126-1c7b9234af39 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:59.588334 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf858ccd-8acb-40b0-aa10-9baf932f2775 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:16:59.592097 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-bf858ccd-8acb-40b0-aa10-9baf932f2775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:59.671899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaca15d-0e80-4d7f-a4ec-86457f200321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:59.672809 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaca15d-0e80-4d7f-a4ec-86457f200321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:59.673259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaca15d-0e80-4d7f-a4ec-86457f200321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:59.673691 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaca15d-0e80-4d7f-a4ec-86457f200321 admin admin] PATH_INFO: `/v3/projects/70c5d0a49b9146f695057c3ea12096f1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:59.675861 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaca15d-0e80-4d7f-a4ec-86457f200321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c5d0a49b9146f695057c3ea12096f1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:59.678656 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaca15d-0e80-4d7f-a4ec-86457f200321 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:59.699255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf858ccd-8acb-40b0-aa10-9baf932f2775 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:16:59.704918 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83789a-203c-4d1f-9c53-6e033ab03b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:16:59.706108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83789a-203c-4d1f-9c53-6e033ab03b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:59.706389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83789a-203c-4d1f-9c53-6e033ab03b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:59.706799 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83789a-203c-4d1f-9c53-6e033ab03b8d admin admin] PATH_INFO: `/v3/projects/0470f3ec707443e794e7db6f4cc9dbe6` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:59.707969 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83789a-203c-4d1f-9c53-6e033ab03b8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0470f3ec707443e794e7db6f4cc9dbe6)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:16:59.709813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83789a-203c-4d1f-9c53-6e033ab03b8d admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:16:59.744415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ecaca15d-0e80-4d7f-a4ec-86457f200321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c5d0a49b9146f695057c3ea12096f1', 'request_id': 'req-ecaca15d-0e80-4d7f-a4ec-86457f200321'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.754538 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ecaca15d-0e80-4d7f-a4ec-86457f200321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c5d0a49b9146f695057c3ea12096f1', 'request_id': 'req-ecaca15d-0e80-4d7f-a4ec-86457f200321'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.762313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ecaca15d-0e80-4d7f-a4ec-86457f200321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c5d0a49b9146f695057c3ea12096f1', 'request_id': 'req-ecaca15d-0e80-4d7f-a4ec-86457f200321'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.774074 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:59.779249 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ecaca15d-0e80-4d7f-a4ec-86457f200321 admin admin] The token cache is being invalidate because project 70c5d0a49b9146f695057c3ea12096f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:59.779467 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ecaca15d-0e80-4d7f-a4ec-86457f200321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.779734 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-ce83789a-203c-4d1f-9c53-6e033ab03b8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0470f3ec707443e794e7db6f4cc9dbe6', 'request_id': 'req-ce83789a-203c-4d1f-9c53-6e033ab03b8d'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.781160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ecaca15d-0e80-4d7f-a4ec-86457f200321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.783353 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1008/2004] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:59 2022] DELETE /identity/v3/projects/70c5d0a49b9146f695057c3ea12096f1 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:16:59.790213 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e36e2f-f8ef-4a0e-93c9-0596a0cc543b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:59.791206 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e36e2f-f8ef-4a0e-93c9-0596a0cc543b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:59.793104 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e36e2f-f8ef-4a0e-93c9-0596a0cc543b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:59.798148 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-ce83789a-203c-4d1f-9c53-6e033ab03b8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0470f3ec707443e794e7db6f4cc9dbe6', 'request_id': 'req-ce83789a-203c-4d1f-9c53-6e033ab03b8d'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.807127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-ce83789a-203c-4d1f-9c53-6e033ab03b8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0470f3ec707443e794e7db6f4cc9dbe6', 'request_id': 'req-ce83789a-203c-4d1f-9c53-6e033ab03b8d'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.816582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-09e36e2f-f8ef-4a0e-93c9-0596a0cc543b None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:59.817988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-09e36e2f-f8ef-4a0e-93c9-0596a0cc543b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:59.821593 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-ce83789a-203c-4d1f-9c53-6e033ab03b8d admin admin] The token cache is being invalidate because project 0470f3ec707443e794e7db6f4cc9dbe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:16:59.822029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-ce83789a-203c-4d1f-9c53-6e033ab03b8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.822830 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-ce83789a-203c-4d1f-9c53-6e033ab03b8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:16:59.825012 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 997/2005] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:16:59 2022] DELETE /identity/v3/projects/0470f3ec707443e794e7db6f4cc9dbe6 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:16:59.831638 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99711da3-1b9e-401c-99f0-3b5dc40b6143 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:59.832010 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99711da3-1b9e-401c-99f0-3b5dc40b6143 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:59.832290 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99711da3-1b9e-401c-99f0-3b5dc40b6143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:59.859379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-99711da3-1b9e-401c-99f0-3b5dc40b6143 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:59.860858 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-99711da3-1b9e-401c-99f0-3b5dc40b6143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:59.874475 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:59.903227 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1009/2006] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:59.911585 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d769f-feec-470e-aa10-a2b685e347e9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:59.912274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d769f-feec-470e-aa10-a2b685e347e9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:59.912537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d769f-feec-470e-aa10-a2b685e347e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:59.975512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-755d769f-feec-470e-aa10-a2b685e347e9 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:16:59.976292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 998/2007] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:16:59.976999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-755d769f-feec-470e-aa10-a2b685e347e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:16:59.984513 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbf064-f243-4cb3-bb0b-59a475d99eb4 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:16:59.985104 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbf064-f243-4cb3-bb0b-59a475d99eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:16:59.985682 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbf064-f243-4cb3-bb0b-59a475d99eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:16:59.993237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1010/2008] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:16:59.998284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d769f-feec-470e-aa10-a2b685e347e9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:00.008630 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d769f-feec-470e-aa10-a2b685e347e9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:00.011625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-f6dbf064-f243-4cb3-bb0b-59a475d99eb4 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:00.012852 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-f6dbf064-f243-4cb3-bb0b-59a475d99eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:00.014487 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381c4b0-38ec-4139-b58c-9193ec4973bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:00.015574 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381c4b0-38ec-4139-b58c-9193ec4973bf admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:00.016109 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381c4b0-38ec-4139-b58c-9193ec4973bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:00.016933 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381c4b0-38ec-4139-b58c-9193ec4973bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:00.017903 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381c4b0-38ec-4139-b58c-9193ec4973bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:17:00.020763 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381c4b0-38ec-4139-b58c-9193ec4973bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:00.022697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381c4b0-38ec-4139-b58c-9193ec4973bf admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:00.023115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 999/2009] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:00.026919 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbf064-f243-4cb3-bb0b-59a475d99eb4 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:00.040415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbf064-f243-4cb3-bb0b-59a475d99eb4 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:00.043528 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1011/2010] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:17:00.047704 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381c4b0-38ec-4139-b58c-9193ec4973bf admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:00.050848 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab73993-1ec0-4c5b-909d-20afc6107e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:00.051506 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab73993-1ec0-4c5b-909d-20afc6107e50 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:00.051783 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab73993-1ec0-4c5b-909d-20afc6107e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:00.052054 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab73993-1ec0-4c5b-909d-20afc6107e50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:00.052708 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab73993-1ec0-4c5b-909d-20afc6107e50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:17:00.053007 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab73993-1ec0-4c5b-909d-20afc6107e50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:00.054610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab73993-1ec0-4c5b-909d-20afc6107e50 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:00.064375 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381c4b0-38ec-4139-b58c-9193ec4973bf admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:00.072052 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1000/2011] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:17:00.072563 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0e5c8-3c49-46ee-b7e5-d66147e19d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:00.073456 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0e5c8-3c49-46ee-b7e5-d66147e19d36 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:00.073747 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0e5c8-3c49-46ee-b7e5-d66147e19d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:00.074028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0e5c8-3c49-46ee-b7e5-d66147e19d36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:00.074665 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0e5c8-3c49-46ee-b7e5-d66147e19d36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:00.077022 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0e5c8-3c49-46ee-b7e5-d66147e19d36 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:00.077570 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab73993-1ec0-4c5b-909d-20afc6107e50 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:00.089852 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab73993-1ec0-4c5b-909d-20afc6107e50 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:00.096463 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195518cc-58b3-443d-9c80-eea23b253edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:00.097208 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195518cc-58b3-443d-9c80-eea23b253edf admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:00.097591 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195518cc-58b3-443d-9c80-eea23b253edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:00.097965 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195518cc-58b3-443d-9c80-eea23b253edf admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:00.099641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195518cc-58b3-443d-9c80-eea23b253edf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:00.101885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195518cc-58b3-443d-9c80-eea23b253edf admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:00.118752 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1012/2012] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:17:00 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:17:00.119866 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0e5c8-3c49-46ee-b7e5-d66147e19d36 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:00.157283 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1001/2013] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:17:00 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:17:00.161301 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195518cc-58b3-443d-9c80-eea23b253edf admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:00.219738 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0e5c8-3c49-46ee-b7e5-d66147e19d36 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:00.323502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab413cd-ba14-4508-a61e-5ebf0fee426b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:00.325334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab413cd-ba14-4508-a61e-5ebf0fee426b admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:00.325778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab413cd-ba14-4508-a61e-5ebf0fee426b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:00.326362 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab413cd-ba14-4508-a61e-5ebf0fee426b admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:00.327698 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab413cd-ba14-4508-a61e-5ebf0fee426b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:00.334469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab413cd-ba14-4508-a61e-5ebf0fee426b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:00.406967 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195518cc-58b3-443d-9c80-eea23b253edf admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:00.413484 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1013/2014] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:17:00 2022] POST /identity/v3/users => generated 287 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:17:00.416672 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab413cd-ba14-4508-a61e-5ebf0fee426b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:00.429542 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cab413cd-ba14-4508-a61e-5ebf0fee426b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:00.434673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c844f-72b8-442a-8807-3e43c98ade67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:00.434673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c844f-72b8-442a-8807-3e43c98ade67 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:00.436699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c844f-72b8-442a-8807-3e43c98ade67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:00.436699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c844f-72b8-442a-8807-3e43c98ade67 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:00.438955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c844f-72b8-442a-8807-3e43c98ade67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:00.447849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c844f-72b8-442a-8807-3e43c98ade67 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:00.462026 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab413cd-ba14-4508-a61e-5ebf0fee426b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:00.469412 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcf46c-0466-42fc-ae9f-e9d7c3ab2bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:00.470072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcf46c-0466-42fc-ae9f-e9d7c3ab2bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:00.470353 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcf46c-0466-42fc-ae9f-e9d7c3ab2bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:00.470637 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcf46c-0466-42fc-ae9f-e9d7c3ab2bc2 admin admin] PATH_INFO: `/v3/projects/30399605c76d4ca4abae7109d2e8e1f6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:00.472205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcf46c-0466-42fc-ae9f-e9d7c3ab2bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30399605c76d4ca4abae7109d2e8e1f6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:00.474435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcf46c-0466-42fc-ae9f-e9d7c3ab2bc2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:00.513291 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1002/2015] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:17:00 2022] POST /identity/v3/users => generated 286 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:17:00.513911 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c844f-72b8-442a-8807-3e43c98ade67 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:00.535245 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:00.552768 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c844f-72b8-442a-8807-3e43c98ade67 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:00.557290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-94dcf46c-0466-42fc-ae9f-e9d7c3ab2bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30399605c76d4ca4abae7109d2e8e1f6', 'request_id': 'req-94dcf46c-0466-42fc-ae9f-e9d7c3ab2bc2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:00.569804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-94dcf46c-0466-42fc-ae9f-e9d7c3ab2bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30399605c76d4ca4abae7109d2e8e1f6', 'request_id': 'req-94dcf46c-0466-42fc-ae9f-e9d7c3ab2bc2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:00.581524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:00.584819 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-94dcf46c-0466-42fc-ae9f-e9d7c3ab2bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30399605c76d4ca4abae7109d2e8e1f6', 'request_id': 'req-94dcf46c-0466-42fc-ae9f-e9d7c3ab2bc2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:00.620110 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-94dcf46c-0466-42fc-ae9f-e9d7c3ab2bc2 admin admin] The token cache is being invalidate because project 30399605c76d4ca4abae7109d2e8e1f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:17:00.627700 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-94dcf46c-0466-42fc-ae9f-e9d7c3ab2bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:00.628769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-94dcf46c-0466-42fc-ae9f-e9d7c3ab2bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:00.630891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1014/2016] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:17:00 2022] DELETE /identity/v3/projects/30399605c76d4ca4abae7109d2e8e1f6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:00.632085 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcf46c-0466-42fc-ae9f-e9d7c3ab2bc2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:00.636128 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-94dcf46c-0466-42fc-ae9f-e9d7c3ab2bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:00.636291 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3029b-0dc2-4e78-81e3-4c58e8a66920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:00.639288 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3029b-0dc2-4e78-81e3-4c58e8a66920 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:00.639732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3029b-0dc2-4e78-81e3-4c58e8a66920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:00.640444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3029b-0dc2-4e78-81e3-4c58e8a66920 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:00.642279 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3029b-0dc2-4e78-81e3-4c58e8a66920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:00.647045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3029b-0dc2-4e78-81e3-4c58e8a66920 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:00.669073 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcf46c-0466-42fc-ae9f-e9d7c3ab2bc2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:00.674231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1003/2017] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:00.674231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d40c2-acf8-4df5-a77c-0c76535d798d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:00.674231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d40c2-acf8-4df5-a77c-0c76535d798d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:00.674231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d40c2-acf8-4df5-a77c-0c76535d798d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:00.676085 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cd5fb-d1e6-4288-95cc-93d85d617156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:00.676814 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cd5fb-d1e6-4288-95cc-93d85d617156 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:00.677244 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cd5fb-d1e6-4288-95cc-93d85d617156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:00.677616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cd5fb-d1e6-4288-95cc-93d85d617156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:00.678447 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857cd5fb-d1e6-4288-95cc-93d85d617156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:00.680186 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857cd5fb-d1e6-4288-95cc-93d85d617156 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:00.699998 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1015/2018] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:00.707247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cd5fb-d1e6-4288-95cc-93d85d617156 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:00.709822 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-b80d40c2-acf8-4df5-a77c-0c76535d798d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:00.711175 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-b80d40c2-acf8-4df5-a77c-0c76535d798d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:00.711900 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-857cd5fb-d1e6-4288-95cc-93d85d617156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:00.726956 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1004/2019] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:00.727924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d40c2-acf8-4df5-a77c-0c76535d798d None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:00.740890 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d40c2-acf8-4df5-a77c-0c76535d798d None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:00.754941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cd5fb-d1e6-4288-95cc-93d85d617156 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:00.755439 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aed071-4b12-4f81-9abc-6c2654270efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:00.755439 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aed071-4b12-4f81-9abc-6c2654270efd admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:00.755439 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aed071-4b12-4f81-9abc-6c2654270efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:00.755439 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aed071-4b12-4f81-9abc-6c2654270efd admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:00.760198 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aed071-4b12-4f81-9abc-6c2654270efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:00.760198 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aed071-4b12-4f81-9abc-6c2654270efd admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:00.767674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae73e96-2692-4297-a02c-4eaef31c859f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:00.767674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae73e96-2692-4297-a02c-4eaef31c859f admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:00.767674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae73e96-2692-4297-a02c-4eaef31c859f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:00.767674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae73e96-2692-4297-a02c-4eaef31c859f admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:00.768688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae73e96-2692-4297-a02c-4eaef31c859f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:00.771131 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae73e96-2692-4297-a02c-4eaef31c859f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:00.799635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1005/2020] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:00.801069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1016/2021] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:00.801844 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae73e96-2692-4297-a02c-4eaef31c859f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:00.803725 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9397bc-7016-4784-8759-8b59a61edef3 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:00.806271 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9397bc-7016-4784-8759-8b59a61edef3 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:00.806686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9397bc-7016-4784-8759-8b59a61edef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:00.825706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae73e96-2692-4297-a02c-4eaef31c859f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:00.843213 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa798f0-0d35-44dc-903c-4d697fb485f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:00.843892 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa798f0-0d35-44dc-903c-4d697fb485f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:00.844171 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa798f0-0d35-44dc-903c-4d697fb485f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:00.844446 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa798f0-0d35-44dc-903c-4d697fb485f9 admin admin] PATH_INFO: `/v3/projects/74451ede8ce748b691fbc1ef9a471914/users/3363adffb38d4747b21232375db2a3cb/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:00.850937 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-dc9397bc-7016-4784-8759-8b59a61edef3 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:00.852318 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-dc9397bc-7016-4784-8759-8b59a61edef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:00.866403 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1006/2022] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:00.866403 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9397bc-7016-4784-8759-8b59a61edef3 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:00.870888 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa798f0-0d35-44dc-903c-4d697fb485f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74451ede8ce748b691fbc1ef9a471914, user_id=3363adffb38d4747b21232375db2a3cb, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:00.873595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9397bc-7016-4784-8759-8b59a61edef3 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:00.873820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa798f0-0d35-44dc-903c-4d697fb485f9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:00.882272 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388a45c-5511-4839-8297-f3dd7423734e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:00.883347 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388a45c-5511-4839-8297-f3dd7423734e admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:00.883729 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388a45c-5511-4839-8297-f3dd7423734e admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:00.884106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388a45c-5511-4839-8297-f3dd7423734e admin admin] PATH_INFO: `/v3/projects/2799e25e35df428d98bfb3a310e660ae/users/970d298682ee42a19d2d425be202450e/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:00.903884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388a45c-5511-4839-8297-f3dd7423734e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2799e25e35df428d98bfb3a310e660ae, user_id=970d298682ee42a19d2d425be202450e, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:00.908400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388a45c-5511-4839-8297-f3dd7423734e admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:00.926912 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1017/2023] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:17:00 2022] PUT /identity/v3/projects/74451ede8ce748b691fbc1ef9a471914/users/3363adffb38d4747b21232375db2a3cb/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:00.928015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa798f0-0d35-44dc-903c-4d697fb485f9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:00.937171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1007/2024] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:17:00 2022] PUT /identity/v3/projects/2799e25e35df428d98bfb3a310e660ae/users/970d298682ee42a19d2d425be202450e/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:00.941197 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444780e-78bd-4a90-a492-ba9a70513c29 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:00.941882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444780e-78bd-4a90-a492-ba9a70513c29 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:00.942367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444780e-78bd-4a90-a492-ba9a70513c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:00.985905 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-6444780e-78bd-4a90-a492-ba9a70513c29 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:00.985905 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-6444780e-78bd-4a90-a492-ba9a70513c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:01.032744 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa798f0-0d35-44dc-903c-4d697fb485f9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:01.099580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1008/2025] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:01.101329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e9bc2-64c1-4b3d-8ad9-50e9a413e2bd None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:01.101624 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e9bc2-64c1-4b3d-8ad9-50e9a413e2bd None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:01.102399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e9bc2-64c1-4b3d-8ad9-50e9a413e2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:01.139166 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2025889-2eb8-434e-aa31-8670732613dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:01.139815 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2025889-2eb8-434e-aa31-8670732613dd admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:01.140241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2025889-2eb8-434e-aa31-8670732613dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:01.140537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2025889-2eb8-434e-aa31-8670732613dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:01.141169 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2025889-2eb8-434e-aa31-8670732613dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:17:01.141477 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2025889-2eb8-434e-aa31-8670732613dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:01.143713 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-bf0e9bc2-64c1-4b3d-8ad9-50e9a413e2bd None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:01.144014 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2025889-2eb8-434e-aa31-8670732613dd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:01.145714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-bf0e9bc2-64c1-4b3d-8ad9-50e9a413e2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:01.158211 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1009/2026] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:01.159617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e9bc2-64c1-4b3d-8ad9-50e9a413e2bd None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:01.162092 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1018/2027] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:17:01.162535 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-bf0e9bc2-64c1-4b3d-8ad9-50e9a413e2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:01.167158 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2025889-2eb8-434e-aa31-8670732613dd admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:01.182398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2025889-2eb8-434e-aa31-8670732613dd admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:01.187812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08e081-d38a-45ee-9f91-5f6ae3fb17c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:01.188522 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08e081-d38a-45ee-9f91-5f6ae3fb17c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:01.188805 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08e081-d38a-45ee-9f91-5f6ae3fb17c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:01.189079 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08e081-d38a-45ee-9f91-5f6ae3fb17c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:01.189895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08e081-d38a-45ee-9f91-5f6ae3fb17c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:01.192159 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08e081-d38a-45ee-9f91-5f6ae3fb17c7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:01.217203 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:01.234641 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1019/2028] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:17:01 2022] POST /identity/v3/projects => generated 399 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:17:01.235920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08e081-d38a-45ee-9f91-5f6ae3fb17c7 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:01.245437 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e9bc2-64c1-4b3d-8ad9-50e9a413e2bd None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:01.267203 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:01.317559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452acd6-cb70-4f1d-96f2-69a0b4695347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:01.318476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452acd6-cb70-4f1d-96f2-69a0b4695347 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:01.319322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452acd6-cb70-4f1d-96f2-69a0b4695347 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:01.319615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452acd6-cb70-4f1d-96f2-69a0b4695347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:01.335697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08e081-d38a-45ee-9f91-5f6ae3fb17c7 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:01.340750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d425d7-0570-4017-b5c4-12890184782c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:01.341607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d425d7-0570-4017-b5c4-12890184782c service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:01.341961 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d425d7-0570-4017-b5c4-12890184782c service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:01.342308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d425d7-0570-4017-b5c4-12890184782c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:01.404545 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452acd6-cb70-4f1d-96f2-69a0b4695347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:01.407034 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452acd6-cb70-4f1d-96f2-69a0b4695347 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:01.420099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d425d7-0570-4017-b5c4-12890184782c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:01.420673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1010/2029] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:17:01.421555 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452acd6-cb70-4f1d-96f2-69a0b4695347 service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:01.422734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d425d7-0570-4017-b5c4-12890184782c service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:01.423188 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-6452acd6-cb70-4f1d-96f2-69a0b4695347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:01.437995 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452acd6-cb70-4f1d-96f2-69a0b4695347 service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:01.438767 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1020/2030] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:17:01.439723 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d425d7-0570-4017-b5c4-12890184782c service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:01.445674 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f3750-b9ba-4bc6-8000-e0edde5f42a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:01.446550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f3750-b9ba-4bc6-8000-e0edde5f42a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:01.447020 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f3750-b9ba-4bc6-8000-e0edde5f42a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:01.447408 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f3750-b9ba-4bc6-8000-e0edde5f42a3 admin admin] PATH_INFO: `/v3/users/c34bf77d0979488d947a251f4ae9e650` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:01.448817 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f3750-b9ba-4bc6-8000-e0edde5f42a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34bf77d0979488d947a251f4ae9e650)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:01.451032 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f3750-b9ba-4bc6-8000-e0edde5f42a3 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:01.452336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d425d7-0570-4017-b5c4-12890184782c service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:01.459308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574dad7a-50dc-4a3d-9ac4-832fb484b1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:01.460205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dad7a-50dc-4a3d-9ac4-832fb484b1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:01.460638 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dad7a-50dc-4a3d-9ac4-832fb484b1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:01.461092 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dad7a-50dc-4a3d-9ac4-832fb484b1c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:01.461940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574dad7a-50dc-4a3d-9ac4-832fb484b1c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:01.464527 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574dad7a-50dc-4a3d-9ac4-832fb484b1c5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:01.500059 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1021/2031] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:17:01 2022] POST /identity/v3/users => generated 300 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:17:01.501367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574dad7a-50dc-4a3d-9ac4-832fb484b1c5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:01.517114 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574dad7a-50dc-4a3d-9ac4-832fb484b1c5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:01.524389 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647aaab2-2f31-4660-8c21-77d704007109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:01.525076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647aaab2-2f31-4660-8c21-77d704007109 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:01.525366 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647aaab2-2f31-4660-8c21-77d704007109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:01.525654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647aaab2-2f31-4660-8c21-77d704007109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:01.526318 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647aaab2-2f31-4660-8c21-77d704007109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:01.528117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647aaab2-2f31-4660-8c21-77d704007109 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:01.540462 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-cd7f3750-b9ba-4bc6-8000-e0edde5f42a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34bf77d0979488d947a251f4ae9e650'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:01.541872 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-cd7f3750-b9ba-4bc6-8000-e0edde5f42a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34bf77d0979488d947a251f4ae9e650'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:01.546374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1022/2032] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:01.547607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647aaab2-2f31-4660-8c21-77d704007109 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:01.550858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-647aaab2-2f31-4660-8c21-77d704007109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:01.558696 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-cd7f3750-b9ba-4bc6-8000-e0edde5f42a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34bf77d0979488d947a251f4ae9e650'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:01.570039 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-cd7f3750-b9ba-4bc6-8000-e0edde5f42a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34bf77d0979488d947a251f4ae9e650'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:01.575961 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647aaab2-2f31-4660-8c21-77d704007109 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:01.585218 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bfc65-5612-49c0-bbe2-efc35a74b09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:01.586061 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bfc65-5612-49c0-bbe2-efc35a74b09f admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:01.586652 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bfc65-5612-49c0-bbe2-efc35a74b09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:01.587594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bfc65-5612-49c0-bbe2-efc35a74b09f admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:01.588716 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bfc65-5612-49c0-bbe2-efc35a74b09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:01.590741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bfc65-5612-49c0-bbe2-efc35a74b09f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:01.609098 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-cd7f3750-b9ba-4bc6-8000-e0edde5f42a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34bf77d0979488d947a251f4ae9e650'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:01.609832 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1023/2033] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:01.616197 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bfc65-5612-49c0-bbe2-efc35a74b09f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:01.625154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1011/2034] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:17:01 2022] DELETE /identity/v3/users/c34bf77d0979488d947a251f4ae9e650 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:01.629092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e82dc-6948-4385-8eba-36941f9ccbe0 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:01.629535 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e82dc-6948-4385-8eba-36941f9ccbe0 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:01.629910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e82dc-6948-4385-8eba-36941f9ccbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:01.634221 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bfc65-5612-49c0-bbe2-efc35a74b09f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:01.662158 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-6e6e82dc-6948-4385-8eba-36941f9ccbe0 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:01.664158 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-6e6e82dc-6948-4385-8eba-36941f9ccbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:01.729169 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7b8df-63fc-4a2c-b546-92a7c3223d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:01.729974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7b8df-63fc-4a2c-b546-92a7c3223d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:01.730415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7b8df-63fc-4a2c-b546-92a7c3223d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:01.730698 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7b8df-63fc-4a2c-b546-92a7c3223d0f admin admin] PATH_INFO: `/v3/projects/037a4cab7c6147338610deebed80d60f/users/25869d8a8903404a918bf9e31a137c8a/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:01.747341 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:01.747910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:01.753612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7b8df-63fc-4a2c-b546-92a7c3223d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=037a4cab7c6147338610deebed80d60f, user_id=25869d8a8903404a918bf9e31a137c8a, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:01.757333 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7b8df-63fc-4a2c-b546-92a7c3223d0f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:01.779861 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1024/2035] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:17:01 2022] PUT /identity/v3/projects/037a4cab7c6147338610deebed80d60f/users/25869d8a8903404a918bf9e31a137c8a/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:17:01.794348 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6825f16-4813-45c5-8264-0293ea88cff2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:01.794348 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6825f16-4813-45c5-8264-0293ea88cff2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:01.794348 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6825f16-4813-45c5-8264-0293ea88cff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:01.823313 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1012/2036] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:01.851502 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e82dc-6948-4385-8eba-36941f9ccbe0 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:01.853368 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-6e6e82dc-6948-4385-8eba-36941f9ccbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:01.872357 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f6825f16-4813-45c5-8264-0293ea88cff2 None None] MFA Rules not processed for user `25869d8a8903404a918bf9e31a137c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:01.879196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f6825f16-4813-45c5-8264-0293ea88cff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:01.995540 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e82dc-6948-4385-8eba-36941f9ccbe0 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:02.049118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1025/2037] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:01 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:02.055938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6825f16-4813-45c5-8264-0293ea88cff2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:02.203116 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91aa76-b23a-460e-925b-55808f040d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:02.204110 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91aa76-b23a-460e-925b-55808f040d77 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:02.204901 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91aa76-b23a-460e-925b-55808f040d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:02.205186 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91aa76-b23a-460e-925b-55808f040d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:02.233832 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6825f16-4813-45c5-8264-0293ea88cff2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:02.243688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d304df-6321-4b6a-8ecb-246814fcb8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:02.246117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d304df-6321-4b6a-8ecb-246814fcb8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:02.246584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d304df-6321-4b6a-8ecb-246814fcb8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:02.247064 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d304df-6321-4b6a-8ecb-246814fcb8d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:02.249510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d304df-6321-4b6a-8ecb-246814fcb8d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:02.253921 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d304df-6321-4b6a-8ecb-246814fcb8d1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:02.307532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91aa76-b23a-460e-925b-55808f040d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:02.310030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91aa76-b23a-460e-925b-55808f040d77 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:02.319322 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1026/2038] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:17:02 2022] POST /identity/v3/projects => generated 397 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:17:02.324409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d304df-6321-4b6a-8ecb-246814fcb8d1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:02.327690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1013/2039] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:17:02.407589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d304df-6321-4b6a-8ecb-246814fcb8d1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:02.414810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddca514-9b8d-464e-b8c7-69de3d4796c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:02.415592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddca514-9b8d-464e-b8c7-69de3d4796c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:02.415875 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddca514-9b8d-464e-b8c7-69de3d4796c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:02.416142 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddca514-9b8d-464e-b8c7-69de3d4796c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:02.416848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddca514-9b8d-464e-b8c7-69de3d4796c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:02.418925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddca514-9b8d-464e-b8c7-69de3d4796c6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:02.436413 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:02.461273 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1027/2040] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:17:02 2022] POST /identity/v3/users => generated 305 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:17:02.466646 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91aa76-b23a-460e-925b-55808f040d77 service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:02.486424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91aa76-b23a-460e-925b-55808f040d77 service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:02.497937 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd488522-908b-45a0-8760-d9579f04e885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:02.499252 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd488522-908b-45a0-8760-d9579f04e885 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:02.500374 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd488522-908b-45a0-8760-d9579f04e885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:02.501300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd488522-908b-45a0-8760-d9579f04e885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:02.502701 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd488522-908b-45a0-8760-d9579f04e885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:02.507817 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd488522-908b-45a0-8760-d9579f04e885 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:02.534492 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1014/2041] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:02.539282 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddca514-9b8d-464e-b8c7-69de3d4796c6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:02.620580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddca514-9b8d-464e-b8c7-69de3d4796c6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:02.656371 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e37c6c-c81e-4121-b716-116f12008945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:02.657517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e37c6c-c81e-4121-b716-116f12008945 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:02.658021 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e37c6c-c81e-4121-b716-116f12008945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:02.658494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e37c6c-c81e-4121-b716-116f12008945 admin admin] PATH_INFO: `/v3/projects/79ff321845424f78b88424a3fa237e4d/users/d284ee7320d141a990de00a4997ab7c1/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:02.721978 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44929e16-1686-4f33-a661-ec999b16a6e0 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:02.722441 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44929e16-1686-4f33-a661-ec999b16a6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:02.722895 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44929e16-1686-4f33-a661-ec999b16a6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:02.779463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e37c6c-c81e-4121-b716-116f12008945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ff321845424f78b88424a3fa237e4d, user_id=d284ee7320d141a990de00a4997ab7c1, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:02.792900 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e37c6c-c81e-4121-b716-116f12008945 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:02.816877 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-44929e16-1686-4f33-a661-ec999b16a6e0 None None] MFA Rules not processed for user `970d298682ee42a19d2d425be202450e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:02.821537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1028/2042] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:17:02 2022] PUT /identity/v3/projects/79ff321845424f78b88424a3fa237e4d/users/d284ee7320d141a990de00a4997ab7c1/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:17:02.822820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e37c6c-c81e-4121-b716-116f12008945 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:02.824623 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-44929e16-1686-4f33-a661-ec999b16a6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:02.904674 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:02.961413 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e37c6c-c81e-4121-b716-116f12008945 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:02.975679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bc974-58fb-4368-ba02-d46cf88e08c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:02.976310 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bc974-58fb-4368-ba02-d46cf88e08c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:02.976590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bc974-58fb-4368-ba02-d46cf88e08c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:02.976863 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bc974-58fb-4368-ba02-d46cf88e08c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:02.982041 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bc974-58fb-4368-ba02-d46cf88e08c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:02.989667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bc974-58fb-4368-ba02-d46cf88e08c8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:02.995247 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1015/2043] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:02.997392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44929e16-1686-4f33-a661-ec999b16a6e0 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:03.000861 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-44929e16-1686-4f33-a661-ec999b16a6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:03.026323 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1029/2044] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:03.027382 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bc974-58fb-4368-ba02-d46cf88e08c8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:03.048918 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bc974-58fb-4368-ba02-d46cf88e08c8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:03.068464 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a41f1-c0bd-4d7f-84fc-9cf84caad51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:03.069146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a41f1-c0bd-4d7f-84fc-9cf84caad51a admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:03.069428 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a41f1-c0bd-4d7f-84fc-9cf84caad51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:03.069702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a41f1-c0bd-4d7f-84fc-9cf84caad51a admin admin] PATH_INFO: `/v3/projects/79ff321845424f78b88424a3fa237e4d/users/d284ee7320d141a990de00a4997ab7c1/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:03.076854 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a41f1-c0bd-4d7f-84fc-9cf84caad51a admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ff321845424f78b88424a3fa237e4d, user_id=d284ee7320d141a990de00a4997ab7c1, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:03.079635 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a41f1-c0bd-4d7f-84fc-9cf84caad51a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:03.114219 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1030/2045] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:17:03 2022] PUT /identity/v3/projects/79ff321845424f78b88424a3fa237e4d/users/d284ee7320d141a990de00a4997ab7c1/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:03.121370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74343ec-55e4-48d8-8920-ed24cb1695da None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:03.123649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74343ec-55e4-48d8-8920-ed24cb1695da None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:03.123825 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74343ec-55e4-48d8-8920-ed24cb1695da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:03.202477 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44929e16-1686-4f33-a661-ec999b16a6e0 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:03.206537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f74343ec-55e4-48d8-8920-ed24cb1695da None None] MFA Rules not processed for user `d284ee7320d141a990de00a4997ab7c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:03.211485 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f74343ec-55e4-48d8-8920-ed24cb1695da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:03.335041 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c4f1d-317f-430e-ab4b-36f71cb10a37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:03.335796 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c4f1d-317f-430e-ab4b-36f71cb10a37 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:03.338576 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c4f1d-317f-430e-ab4b-36f71cb10a37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:03.338887 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c4f1d-317f-430e-ab4b-36f71cb10a37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:03.378581 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1031/2046] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:03 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:17:03.402395 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74343ec-55e4-48d8-8920-ed24cb1695da None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:03.404504 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f74343ec-55e4-48d8-8920-ed24cb1695da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:03.429402 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74343ec-55e4-48d8-8920-ed24cb1695da None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:03.440436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed7065-6a24-4ee0-815d-7d57f7f83fb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:03.441069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed7065-6a24-4ee0-815d-7d57f7f83fb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:03.441351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed7065-6a24-4ee0-815d-7d57f7f83fb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:03.441621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed7065-6a24-4ee0-815d-7d57f7f83fb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:03.454096 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed7065-6a24-4ee0-815d-7d57f7f83fb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:03.456757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed7065-6a24-4ee0-815d-7d57f7f83fb1 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:03.474516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c4f1d-317f-430e-ab4b-36f71cb10a37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:03.476414 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c4f1d-317f-430e-ab4b-36f71cb10a37 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:03.487872 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1032/2047] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:03 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:17:03.492946 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1016/2048] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:17:03.506313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed7065-6a24-4ee0-815d-7d57f7f83fb1 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:03.509707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-feed7065-6a24-4ee0-815d-7d57f7f83fb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:03.580340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:03.628328 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f1e82-cf12-4d5f-8cf3-6cbbc088731d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:03.629468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f1e82-cf12-4d5f-8cf3-6cbbc088731d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:03.629753 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f1e82-cf12-4d5f-8cf3-6cbbc088731d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:03.679884 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed7065-6a24-4ee0-815d-7d57f7f83fb1 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:03.685402 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00930d7-720f-4e04-8997-c1a0caa753f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:03.686455 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00930d7-720f-4e04-8997-c1a0caa753f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:03.686971 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00930d7-720f-4e04-8997-c1a0caa753f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:03.687463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00930d7-720f-4e04-8997-c1a0caa753f4 admin admin] PATH_INFO: `/v3/projects/137fb04e307e43178d880048825d9a77` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:03.688870 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00930d7-720f-4e04-8997-c1a0caa753f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=137fb04e307e43178d880048825d9a77)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:03.691333 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00930d7-720f-4e04-8997-c1a0caa753f4 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:03.740194 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-767f1e82-cf12-4d5f-8cf3-6cbbc088731d None None] MFA Rules not processed for user `3363adffb38d4747b21232375db2a3cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:03.744688 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-767f1e82-cf12-4d5f-8cf3-6cbbc088731d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:03.810914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:03.820027 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a00930d7-720f-4e04-8997-c1a0caa753f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '137fb04e307e43178d880048825d9a77', 'request_id': 'req-a00930d7-720f-4e04-8997-c1a0caa753f4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:03.851435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a00930d7-720f-4e04-8997-c1a0caa753f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '137fb04e307e43178d880048825d9a77', 'request_id': 'req-a00930d7-720f-4e04-8997-c1a0caa753f4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:03.871719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a00930d7-720f-4e04-8997-c1a0caa753f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '137fb04e307e43178d880048825d9a77', 'request_id': 'req-a00930d7-720f-4e04-8997-c1a0caa753f4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:03.911051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a00930d7-720f-4e04-8997-c1a0caa753f4 admin admin] The token cache is being invalidate because project 137fb04e307e43178d880048825d9a77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:17:03.911982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a00930d7-720f-4e04-8997-c1a0caa753f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:03.915688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a00930d7-720f-4e04-8997-c1a0caa753f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:03.922262 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1033/2049] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:17:03 2022] DELETE /identity/v3/projects/137fb04e307e43178d880048825d9a77 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:03.922262 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00930d7-720f-4e04-8997-c1a0caa753f4 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:03.924990 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a00930d7-720f-4e04-8997-c1a0caa753f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:03.935909 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1017/2050] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:17:03.938149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f1e82-cf12-4d5f-8cf3-6cbbc088731d None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:04.051778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00930d7-720f-4e04-8997-c1a0caa753f4 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:04.060372 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb895da-b32f-4dd8-b46b-26f3b00f395b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:04.061496 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb895da-b32f-4dd8-b46b-26f3b00f395b service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:04.061779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb895da-b32f-4dd8-b46b-26f3b00f395b service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:04.062054 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb895da-b32f-4dd8-b46b-26f3b00f395b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:04.070346 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cfb895da-b32f-4dd8-b46b-26f3b00f395b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:04.130122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f1e82-cf12-4d5f-8cf3-6cbbc088731d None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:04.146672 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c09db3-0976-4368-858d-9d6002273f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:04.147830 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c09db3-0976-4368-858d-9d6002273f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:04.148329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c09db3-0976-4368-858d-9d6002273f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:04.148831 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c09db3-0976-4368-858d-9d6002273f68 admin admin] PATH_INFO: `/v3/users/9234f1b81c664024a55cb800a17cc1e5` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:04.152220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c09db3-0976-4368-858d-9d6002273f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9234f1b81c664024a55cb800a17cc1e5)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:04.154725 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c09db3-0976-4368-858d-9d6002273f68 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:04.231287 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb895da-b32f-4dd8-b46b-26f3b00f395b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:04.235933 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb895da-b32f-4dd8-b46b-26f3b00f395b service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:04.262635 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1034/2051] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:03 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:17:04.266606 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb895da-b32f-4dd8-b46b-26f3b00f395b service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:04.271180 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cfb895da-b32f-4dd8-b46b-26f3b00f395b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:04.277806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c7c09db3-0976-4368-858d-9d6002273f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9234f1b81c664024a55cb800a17cc1e5'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:04.278232 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c7c09db3-0976-4368-858d-9d6002273f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9234f1b81c664024a55cb800a17cc1e5'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:04.291037 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c7c09db3-0976-4368-858d-9d6002273f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9234f1b81c664024a55cb800a17cc1e5'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:04.302981 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c7c09db3-0976-4368-858d-9d6002273f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9234f1b81c664024a55cb800a17cc1e5'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:04.305531 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb895da-b32f-4dd8-b46b-26f3b00f395b service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:04.318798 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252713d-b917-4f8c-ab0f-ea256a75755c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:04.320213 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252713d-b917-4f8c-ab0f-ea256a75755c admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:04.320568 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252713d-b917-4f8c-ab0f-ea256a75755c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:04.320920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252713d-b917-4f8c-ab0f-ea256a75755c admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:04.321636 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252713d-b917-4f8c-ab0f-ea256a75755c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:04.324143 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252713d-b917-4f8c-ab0f-ea256a75755c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:04.331124 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c7c09db3-0976-4368-858d-9d6002273f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9234f1b81c664024a55cb800a17cc1e5'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:04.339898 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:04.354398 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1018/2052] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:17:03 2022] DELETE /identity/v3/users/9234f1b81c664024a55cb800a17cc1e5 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:04.407391 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1035/2053] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:17:04 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:17:04.413746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c09db3-0976-4368-858d-9d6002273f68 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:04.422446 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c7c09db3-0976-4368-858d-9d6002273f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:04.527624 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:04.556023 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c09db3-0976-4368-858d-9d6002273f68 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:04.691728 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c735b-c3a8-4565-b5f7-cffd4305092c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:04.692336 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c735b-c3a8-4565-b5f7-cffd4305092c admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:04.692790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c735b-c3a8-4565-b5f7-cffd4305092c admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:04.693041 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c735b-c3a8-4565-b5f7-cffd4305092c admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:04.693781 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c735b-c3a8-4565-b5f7-cffd4305092c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:04.696736 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c735b-c3a8-4565-b5f7-cffd4305092c admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:04.768404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1019/2054] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:17:04 2022] POST /identity/v3/users => generated 292 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:17:04.772233 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252713d-b917-4f8c-ab0f-ea256a75755c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:04.792473 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252713d-b917-4f8c-ab0f-ea256a75755c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:04.810176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51892141-b267-4565-b826-80bf1192daf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:04.810727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51892141-b267-4565-b826-80bf1192daf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:04.811644 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51892141-b267-4565-b826-80bf1192daf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:04.811644 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51892141-b267-4565-b826-80bf1192daf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:04.811973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51892141-b267-4565-b826-80bf1192daf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:04.813955 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51892141-b267-4565-b826-80bf1192daf5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:04.847653 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1036/2055] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:04.852150 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c735b-c3a8-4565-b5f7-cffd4305092c admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:04.878619 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c735b-c3a8-4565-b5f7-cffd4305092c admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:04.896021 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18f6d9-d6b2-4245-a8f4-67e7126da955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:04.898397 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18f6d9-d6b2-4245-a8f4-67e7126da955 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:04.898910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18f6d9-d6b2-4245-a8f4-67e7126da955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:04.899503 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18f6d9-d6b2-4245-a8f4-67e7126da955 admin admin] PATH_INFO: `/v3/projects/2366524f2db242da90ff45674afca8f9/users/9713a40cc05043bd87fc1d589dd132d9/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:04.998442 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18f6d9-d6b2-4245-a8f4-67e7126da955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2366524f2db242da90ff45674afca8f9, user_id=9713a40cc05043bd87fc1d589dd132d9, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:05.007427 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18f6d9-d6b2-4245-a8f4-67e7126da955 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:05.036770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1020/2056] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:17:04 2022] PUT /identity/v3/projects/2366524f2db242da90ff45674afca8f9/users/9713a40cc05043bd87fc1d589dd132d9/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:05.040798 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51892141-b267-4565-b826-80bf1192daf5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:05.064391 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51892141-b267-4565-b826-80bf1192daf5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:05.138782 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd10cf0-d94e-4838-881f-bb1fbf26fcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:05.152736 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd10cf0-d94e-4838-881f-bb1fbf26fcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:05.153115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd10cf0-d94e-4838-881f-bb1fbf26fcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:05.153402 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd10cf0-d94e-4838-881f-bb1fbf26fcd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:05.154091 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd10cf0-d94e-4838-881f-bb1fbf26fcd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:05.156720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd10cf0-d94e-4838-881f-bb1fbf26fcd8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:05.170710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1037/2057] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:05.175528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18f6d9-d6b2-4245-a8f4-67e7126da955 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:05.195941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18f6d9-d6b2-4245-a8f4-67e7126da955 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:05.208767 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c3a32-a124-467d-b895-b34903ef3204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:05.209562 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c3a32-a124-467d-b895-b34903ef3204 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:05.209888 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c3a32-a124-467d-b895-b34903ef3204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:05.210135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c3a32-a124-467d-b895-b34903ef3204 admin admin] PATH_INFO: `/v3/projects/2366524f2db242da90ff45674afca8f9/users/9713a40cc05043bd87fc1d589dd132d9/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:05.216775 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c3a32-a124-467d-b895-b34903ef3204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2366524f2db242da90ff45674afca8f9, user_id=9713a40cc05043bd87fc1d589dd132d9, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:05.225092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c3a32-a124-467d-b895-b34903ef3204 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:05.249632 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1021/2058] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:17:05 2022] PUT /identity/v3/projects/2366524f2db242da90ff45674afca8f9/users/9713a40cc05043bd87fc1d589dd132d9/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:05.380553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd10cf0-d94e-4838-881f-bb1fbf26fcd8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:05.382281 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9bd10cf0-d94e-4838-881f-bb1fbf26fcd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:05.437006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd10cf0-d94e-4838-881f-bb1fbf26fcd8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:05.541759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4bc78-bfee-4b65-a565-810109c3fb9b None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:05.542304 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4bc78-bfee-4b65-a565-810109c3fb9b None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:05.542304 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4bc78-bfee-4b65-a565-810109c3fb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:05.581616 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-0fd4bc78-bfee-4b65-a565-810109c3fb9b None None] MFA Rules not processed for user `970d298682ee42a19d2d425be202450e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:05.582852 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-0fd4bc78-bfee-4b65-a565-810109c3fb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:05.593884 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a64da5-5ad8-409f-9025-30267050111f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:05.594703 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a64da5-5ad8-409f-9025-30267050111f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:05.595346 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a64da5-5ad8-409f-9025-30267050111f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:05.595346 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a64da5-5ad8-409f-9025-30267050111f admin admin] PATH_INFO: `/v3/projects/7fe1a1726f6e4e9f9605e0382f3872dd` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:05.600049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a64da5-5ad8-409f-9025-30267050111f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fe1a1726f6e4e9f9605e0382f3872dd)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:05.602969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a64da5-5ad8-409f-9025-30267050111f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:05.714285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-15a64da5-5ad8-409f-9025-30267050111f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fe1a1726f6e4e9f9605e0382f3872dd', 'request_id': 'req-15a64da5-5ad8-409f-9025-30267050111f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:05.730822 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-15a64da5-5ad8-409f-9025-30267050111f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fe1a1726f6e4e9f9605e0382f3872dd', 'request_id': 'req-15a64da5-5ad8-409f-9025-30267050111f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:05.739460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-15a64da5-5ad8-409f-9025-30267050111f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fe1a1726f6e4e9f9605e0382f3872dd', 'request_id': 'req-15a64da5-5ad8-409f-9025-30267050111f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:05.753414 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-15a64da5-5ad8-409f-9025-30267050111f admin admin] The token cache is being invalidate because project 7fe1a1726f6e4e9f9605e0382f3872dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:17:05.753414 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-15a64da5-5ad8-409f-9025-30267050111f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:05.754051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-15a64da5-5ad8-409f-9025-30267050111f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:05.756248 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1038/2059] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:17:05 2022] DELETE /identity/v3/projects/7fe1a1726f6e4e9f9605e0382f3872dd => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:05.760549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a64da5-5ad8-409f-9025-30267050111f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:05.762231 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-15a64da5-5ad8-409f-9025-30267050111f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:05.766849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1022/2060] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 10 13:17:05.774075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:05.851402 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a64da5-5ad8-409f-9025-30267050111f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:05.856340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89669277-9620-4552-bd02-e9322687bb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:05.856973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89669277-9620-4552-bd02-e9322687bb16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:05.857250 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89669277-9620-4552-bd02-e9322687bb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:05.857521 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89669277-9620-4552-bd02-e9322687bb16 admin admin] PATH_INFO: `/v3/users/e995f3f3e4e1451d81021d51746d7bd6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:05.858822 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89669277-9620-4552-bd02-e9322687bb16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e995f3f3e4e1451d81021d51746d7bd6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:05.860947 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89669277-9620-4552-bd02-e9322687bb16 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:05.927784 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-89669277-9620-4552-bd02-e9322687bb16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e995f3f3e4e1451d81021d51746d7bd6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:05.928583 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-89669277-9620-4552-bd02-e9322687bb16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e995f3f3e4e1451d81021d51746d7bd6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:05.937074 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-89669277-9620-4552-bd02-e9322687bb16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e995f3f3e4e1451d81021d51746d7bd6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:05.947885 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-89669277-9620-4552-bd02-e9322687bb16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e995f3f3e4e1451d81021d51746d7bd6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:05.967191 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-89669277-9620-4552-bd02-e9322687bb16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e995f3f3e4e1451d81021d51746d7bd6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:05.976694 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1039/2061] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:17:05 2022] DELETE /identity/v3/users/e995f3f3e4e1451d81021d51746d7bd6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:06.817018 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4bc78-bfee-4b65-a565-810109c3fb9b None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:06.839920 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4bc78-bfee-4b65-a565-810109c3fb9b None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:06.851367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960a162-ced8-4abb-9d75-76439e7c729e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:06.851653 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960a162-ced8-4abb-9d75-76439e7c729e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:06.852377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960a162-ced8-4abb-9d75-76439e7c729e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:06.893143 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7960a162-ced8-4abb-9d75-76439e7c729e None None] MFA Rules not processed for user `9713a40cc05043bd87fc1d589dd132d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:06.895198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7960a162-ced8-4abb-9d75-76439e7c729e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:06.923973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:06.937046 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389b3a0-bc68-499e-94c6-83e5e717fbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:06.937694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389b3a0-bc68-499e-94c6-83e5e717fbb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:06.937972 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389b3a0-bc68-499e-94c6-83e5e717fbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:06.938246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389b3a0-bc68-499e-94c6-83e5e717fbb5 admin admin] PATH_INFO: `/v3/projects/974568937ea74aab8a038acef7bbdbc3` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:06.939425 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389b3a0-bc68-499e-94c6-83e5e717fbb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=974568937ea74aab8a038acef7bbdbc3)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:06.942434 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389b3a0-bc68-499e-94c6-83e5e717fbb5 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:07.038740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1040/2062] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:17:07.039147 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-5389b3a0-bc68-499e-94c6-83e5e717fbb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '974568937ea74aab8a038acef7bbdbc3', 'request_id': 'req-5389b3a0-bc68-499e-94c6-83e5e717fbb5'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:07.050315 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a481aa-1565-4d37-ac0a-bbdda1ed24f2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:07.051388 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a481aa-1565-4d37-ac0a-bbdda1ed24f2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:07.051845 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a481aa-1565-4d37-ac0a-bbdda1ed24f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:07.072958 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-5389b3a0-bc68-499e-94c6-83e5e717fbb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '974568937ea74aab8a038acef7bbdbc3', 'request_id': 'req-5389b3a0-bc68-499e-94c6-83e5e717fbb5'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:07.088045 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d8a481aa-1565-4d37-ac0a-bbdda1ed24f2 None None] MFA Rules not processed for user `3363adffb38d4747b21232375db2a3cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:07.089617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d8a481aa-1565-4d37-ac0a-bbdda1ed24f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:07.093223 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-5389b3a0-bc68-499e-94c6-83e5e717fbb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '974568937ea74aab8a038acef7bbdbc3', 'request_id': 'req-5389b3a0-bc68-499e-94c6-83e5e717fbb5'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:07.094735 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:07.119976 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-5389b3a0-bc68-499e-94c6-83e5e717fbb5 admin admin] The token cache is being invalidate because project 974568937ea74aab8a038acef7bbdbc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:17:07.120294 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-5389b3a0-bc68-499e-94c6-83e5e717fbb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:07.121003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-5389b3a0-bc68-499e-94c6-83e5e717fbb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:07.130129 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1023/2063] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:17:06 2022] DELETE /identity/v3/projects/974568937ea74aab8a038acef7bbdbc3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:07.132247 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832450eb-8cfc-4c86-b07c-778fe7b58cf8 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:07.132541 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832450eb-8cfc-4c86-b07c-778fe7b58cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:07.132810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832450eb-8cfc-4c86-b07c-778fe7b58cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:07.174936 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-832450eb-8cfc-4c86-b07c-778fe7b58cf8 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:07.176133 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-832450eb-8cfc-4c86-b07c-778fe7b58cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:07.238434 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1041/2064] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:07.239587 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a481aa-1565-4d37-ac0a-bbdda1ed24f2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:07.241421 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d8a481aa-1565-4d37-ac0a-bbdda1ed24f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:07.297259 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1024/2065] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:17:07.308891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6623a20-66d7-48f1-8169-c0e75b536541 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:07.309326 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6623a20-66d7-48f1-8169-c0e75b536541 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:07.309609 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6623a20-66d7-48f1-8169-c0e75b536541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:07.341972 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-f6623a20-66d7-48f1-8169-c0e75b536541 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:07.343521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-f6623a20-66d7-48f1-8169-c0e75b536541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:07.358434 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1025/2066] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:07.358660 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a481aa-1565-4d37-ac0a-bbdda1ed24f2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:07.359878 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6623a20-66d7-48f1-8169-c0e75b536541 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:07.366395 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd673c24-7d95-4e9c-8cec-e65264c298c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:07.367128 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd673c24-7d95-4e9c-8cec-e65264c298c5 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:07.367389 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd673c24-7d95-4e9c-8cec-e65264c298c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:07.367676 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd673c24-7d95-4e9c-8cec-e65264c298c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:07.369769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bd673c24-7d95-4e9c-8cec-e65264c298c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:07.371897 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6623a20-66d7-48f1-8169-c0e75b536541 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:07.377491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382e62a-e18f-4b0a-9645-931ad907564a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:07.379028 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382e62a-e18f-4b0a-9645-931ad907564a admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:07.379355 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382e62a-e18f-4b0a-9645-931ad907564a admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:07.380354 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382e62a-e18f-4b0a-9645-931ad907564a admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:07.381062 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382e62a-e18f-4b0a-9645-931ad907564a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:17:07.381663 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382e62a-e18f-4b0a-9645-931ad907564a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:07.382291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd673c24-7d95-4e9c-8cec-e65264c298c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:07.383346 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382e62a-e18f-4b0a-9645-931ad907564a admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:07.384387 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd673c24-7d95-4e9c-8cec-e65264c298c5 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:07.397308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1042/2067] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:17:07.414054 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1026/2068] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:17:07.415240 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd673c24-7d95-4e9c-8cec-e65264c298c5 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:07.431590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd673c24-7d95-4e9c-8cec-e65264c298c5 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:07.437867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3801a1-5d21-4b35-97d5-30fb5c98b854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:07.438491 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3801a1-5d21-4b35-97d5-30fb5c98b854 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:07.438816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3801a1-5d21-4b35-97d5-30fb5c98b854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:07.439123 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3801a1-5d21-4b35-97d5-30fb5c98b854 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:07.440017 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3801a1-5d21-4b35-97d5-30fb5c98b854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:07.442610 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3801a1-5d21-4b35-97d5-30fb5c98b854 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:07.494031 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1043/2069] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:17:07 2022] POST /identity/v3/projects => generated 365 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:17:07.498187 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382e62a-e18f-4b0a-9645-931ad907564a admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:07.514308 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382e62a-e18f-4b0a-9645-931ad907564a admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:07.583981 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2be99-e796-43d4-868a-ea722113a864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:07.584964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2be99-e796-43d4-868a-ea722113a864 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:07.585677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2be99-e796-43d4-868a-ea722113a864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:07.586150 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2be99-e796-43d4-868a-ea722113a864 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:07.586989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2be99-e796-43d4-868a-ea722113a864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:07.589898 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2be99-e796-43d4-868a-ea722113a864 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:07.605343 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:07.625411 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1027/2070] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:17:07 2022] POST /identity/v3/users => generated 283 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:17:07.629820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3801a1-5d21-4b35-97d5-30fb5c98b854 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:07.647140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3801a1-5d21-4b35-97d5-30fb5c98b854 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:07.653491 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d55bb-1fab-4cee-aa3b-a4c2f47a3386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:07.655530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d55bb-1fab-4cee-aa3b-a4c2f47a3386 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:07.655982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d55bb-1fab-4cee-aa3b-a4c2f47a3386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:07.656410 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d55bb-1fab-4cee-aa3b-a4c2f47a3386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:07.658954 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d55bb-1fab-4cee-aa3b-a4c2f47a3386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:07.660953 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d55bb-1fab-4cee-aa3b-a4c2f47a3386 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:07.673485 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1044/2071] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:07.677262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2be99-e796-43d4-868a-ea722113a864 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:07.687750 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2be99-e796-43d4-868a-ea722113a864 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:07.696530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097ff56-7f7e-4bf2-bba5-158cde5e7645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:07.697151 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097ff56-7f7e-4bf2-bba5-158cde5e7645 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:07.697434 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097ff56-7f7e-4bf2-bba5-158cde5e7645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:07.697707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097ff56-7f7e-4bf2-bba5-158cde5e7645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:07.698540 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097ff56-7f7e-4bf2-bba5-158cde5e7645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:07.700351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097ff56-7f7e-4bf2-bba5-158cde5e7645 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:07.722758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1028/2072] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:07.724607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d55bb-1fab-4cee-aa3b-a4c2f47a3386 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:07.738121 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d55bb-1fab-4cee-aa3b-a4c2f47a3386 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:07.754553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd34609-6b80-49f7-a53e-8444a40c8370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:07.755422 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd34609-6b80-49f7-a53e-8444a40c8370 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:07.755807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd34609-6b80-49f7-a53e-8444a40c8370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:07.756189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd34609-6b80-49f7-a53e-8444a40c8370 admin admin] PATH_INFO: `/v3/projects/d77fc537238847db8221ae170cf9b273/users/fca2e480291d4275a6cdc7899d8098bc/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:07.774491 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd34609-6b80-49f7-a53e-8444a40c8370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d77fc537238847db8221ae170cf9b273, user_id=fca2e480291d4275a6cdc7899d8098bc, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:07.777739 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd34609-6b80-49f7-a53e-8444a40c8370 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:07.799809 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1045/2073] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:17:07 2022] PUT /identity/v3/projects/d77fc537238847db8221ae170cf9b273/users/fca2e480291d4275a6cdc7899d8098bc/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:07.817994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c3a4e-6edc-4698-9cad-1759da91f3a7 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:07.817994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c3a4e-6edc-4698-9cad-1759da91f3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:07.817994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c3a4e-6edc-4698-9cad-1759da91f3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:07.857226 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-731c3a4e-6edc-4698-9cad-1759da91f3a7 None None] MFA Rules not processed for user `fca2e480291d4275a6cdc7899d8098bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:07.859910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-731c3a4e-6edc-4698-9cad-1759da91f3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:07.954868 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1029/2074] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:07.959688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd34609-6b80-49f7-a53e-8444a40c8370 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:08.033589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:08.065522 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd34609-6b80-49f7-a53e-8444a40c8370 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:08.070758 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7094b7-ab16-48b2-8c24-f50b5998c968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:08.071530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7094b7-ab16-48b2-8c24-f50b5998c968 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:08.071930 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7094b7-ab16-48b2-8c24-f50b5998c968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:08.072275 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7094b7-ab16-48b2-8c24-f50b5998c968 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:08.072976 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7094b7-ab16-48b2-8c24-f50b5998c968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:08.075060 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7094b7-ab16-48b2-8c24-f50b5998c968 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:08.112097 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1046/2075] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:17:07 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:17:08.116391 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c3a4e-6edc-4698-9cad-1759da91f3a7 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:08.130886 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c3a4e-6edc-4698-9cad-1759da91f3a7 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:08.207179 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075bc31-c021-4a7a-891b-d96874e320e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:08.207656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075bc31-c021-4a7a-891b-d96874e320e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:08.208040 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075bc31-c021-4a7a-891b-d96874e320e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:08.208204 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075bc31-c021-4a7a-891b-d96874e320e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:08.208821 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075bc31-c021-4a7a-891b-d96874e320e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:08.211033 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075bc31-c021-4a7a-891b-d96874e320e0 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:08.235874 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1030/2076] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:17:08 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:17:08.237624 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7094b7-ab16-48b2-8c24-f50b5998c968 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:08.248124 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7094b7-ab16-48b2-8c24-f50b5998c968 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:08.253221 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5a31f-44f9-4566-8943-d58b5c02d376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:08.253817 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5a31f-44f9-4566-8943-d58b5c02d376 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:08.254093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5a31f-44f9-4566-8943-d58b5c02d376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:08.254362 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5a31f-44f9-4566-8943-d58b5c02d376 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:08.255028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5a31f-44f9-4566-8943-d58b5c02d376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:08.256629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5a31f-44f9-4566-8943-d58b5c02d376 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:08.270937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1047/2077] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:08.275154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075bc31-c021-4a7a-891b-d96874e320e0 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:08.291782 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075bc31-c021-4a7a-891b-d96874e320e0 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:08.296988 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee213ac-eabd-4c33-b5be-9d38e4620a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:08.297652 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee213ac-eabd-4c33-b5be-9d38e4620a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:08.298072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee213ac-eabd-4c33-b5be-9d38e4620a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:08.298340 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee213ac-eabd-4c33-b5be-9d38e4620a36 admin admin] PATH_INFO: `/v3/projects/66b9b9e4c0694eba89bcb9e03002620b/users/528623c958ef45dc87b0301f32231809/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:08.316993 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee213ac-eabd-4c33-b5be-9d38e4620a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66b9b9e4c0694eba89bcb9e03002620b, user_id=528623c958ef45dc87b0301f32231809, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:08.321843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee213ac-eabd-4c33-b5be-9d38e4620a36 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:08.335708 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1031/2078] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:17:08 2022] PUT /identity/v3/projects/66b9b9e4c0694eba89bcb9e03002620b/users/528623c958ef45dc87b0301f32231809/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:08.339662 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5a31f-44f9-4566-8943-d58b5c02d376 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:08.350026 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5a31f-44f9-4566-8943-d58b5c02d376 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:08.410071 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95eb2d6-df85-42e1-a76b-e9fbf7aba442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:08.410679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eb2d6-df85-42e1-a76b-e9fbf7aba442 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:08.410950 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eb2d6-df85-42e1-a76b-e9fbf7aba442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:08.411248 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eb2d6-df85-42e1-a76b-e9fbf7aba442 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:08.411890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95eb2d6-df85-42e1-a76b-e9fbf7aba442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:08.413515 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95eb2d6-df85-42e1-a76b-e9fbf7aba442 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:08.424782 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1048/2079] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:08.428806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee213ac-eabd-4c33-b5be-9d38e4620a36 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:08.440098 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee213ac-eabd-4c33-b5be-9d38e4620a36 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:08.445063 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c1a93-bba3-41e7-a61a-5a3c03c1f3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:08.445720 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c1a93-bba3-41e7-a61a-5a3c03c1f3ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:08.446000 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c1a93-bba3-41e7-a61a-5a3c03c1f3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:08.446434 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c1a93-bba3-41e7-a61a-5a3c03c1f3ad admin admin] PATH_INFO: `/v3/projects/66b9b9e4c0694eba89bcb9e03002620b/users/528623c958ef45dc87b0301f32231809/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:08.448408 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c1a93-bba3-41e7-a61a-5a3c03c1f3ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=66b9b9e4c0694eba89bcb9e03002620b, user_id=528623c958ef45dc87b0301f32231809, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:08.451082 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c1a93-bba3-41e7-a61a-5a3c03c1f3ad admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:08.462805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1032/2080] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:17:08 2022] PUT /identity/v3/projects/66b9b9e4c0694eba89bcb9e03002620b/users/528623c958ef45dc87b0301f32231809/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:08.473810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dc7fa-6055-44d3-9a47-700b18902649 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:08.474475 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dc7fa-6055-44d3-9a47-700b18902649 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:08.474475 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dc7fa-6055-44d3-9a47-700b18902649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:08.506449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0c1dc7fa-6055-44d3-9a47-700b18902649 None None] MFA Rules not processed for user `528623c958ef45dc87b0301f32231809`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:08.509066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0c1dc7fa-6055-44d3-9a47-700b18902649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:08.628062 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1049/2081] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:08.630752 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c1a93-bba3-41e7-a61a-5a3c03c1f3ad admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:08.633359 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-ac0c1a93-bba3-41e7-a61a-5a3c03c1f3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:08.694155 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:08.772718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c1a93-bba3-41e7-a61a-5a3c03c1f3ad admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:08.786691 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283454fe-f578-449d-a5f4-653553cb97c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:08.787421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283454fe-f578-449d-a5f4-653553cb97c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:08.787705 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283454fe-f578-449d-a5f4-653553cb97c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:08.787977 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283454fe-f578-449d-a5f4-653553cb97c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:08.815049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283454fe-f578-449d-a5f4-653553cb97c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:08.816481 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283454fe-f578-449d-a5f4-653553cb97c5 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:08.838085 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1033/2082] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:17:08.983438 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dc7fa-6055-44d3-9a47-700b18902649 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:09.002259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dc7fa-6055-44d3-9a47-700b18902649 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:09.024676 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224c559-fec6-43bc-86d1-532b4ab9d36f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:09.025327 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224c559-fec6-43bc-86d1-532b4ab9d36f service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:09.026694 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224c559-fec6-43bc-86d1-532b4ab9d36f service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:09.026988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224c559-fec6-43bc-86d1-532b4ab9d36f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:09.135335 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:09.200566 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224c559-fec6-43bc-86d1-532b4ab9d36f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:09.202646 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224c559-fec6-43bc-86d1-532b4ab9d36f service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:09.243275 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1050/2083] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:17:09.622204 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283454fe-f578-449d-a5f4-653553cb97c5 service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:09.624029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-283454fe-f578-449d-a5f4-653553cb97c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:09.817692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283454fe-f578-449d-a5f4-653553cb97c5 service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:09.828762 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548e8f0-606a-4c70-b3be-9e0be6be1b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:09.833041 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548e8f0-606a-4c70-b3be-9e0be6be1b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:09.834726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548e8f0-606a-4c70-b3be-9e0be6be1b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:09.835211 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548e8f0-606a-4c70-b3be-9e0be6be1b67 admin admin] PATH_INFO: `/v3/users/25869d8a8903404a918bf9e31a137c8a` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:09.838751 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548e8f0-606a-4c70-b3be-9e0be6be1b67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25869d8a8903404a918bf9e31a137c8a)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:09.842923 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548e8f0-606a-4c70-b3be-9e0be6be1b67 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:09.997558 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-8548e8f0-606a-4c70-b3be-9e0be6be1b67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25869d8a8903404a918bf9e31a137c8a'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:10.000341 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-8548e8f0-606a-4c70-b3be-9e0be6be1b67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25869d8a8903404a918bf9e31a137c8a'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:10.027571 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-8548e8f0-606a-4c70-b3be-9e0be6be1b67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25869d8a8903404a918bf9e31a137c8a'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:10.049102 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-8548e8f0-606a-4c70-b3be-9e0be6be1b67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25869d8a8903404a918bf9e31a137c8a'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:10.075041 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-8548e8f0-606a-4c70-b3be-9e0be6be1b67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25869d8a8903404a918bf9e31a137c8a'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:10.086646 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1034/2084] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:17:09 2022] DELETE /identity/v3/users/25869d8a8903404a918bf9e31a137c8a => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:10.088933 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf82f5-fa49-4018-86df-e0393dc11a2a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:10.089765 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf82f5-fa49-4018-86df-e0393dc11a2a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:10.090215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf82f5-fa49-4018-86df-e0393dc11a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:10.115073 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7fcf82f5-fa49-4018-86df-e0393dc11a2a None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:10.117238 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7fcf82f5-fa49-4018-86df-e0393dc11a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:10.201470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1051/2085] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:10.239717 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548e8f0-606a-4c70-b3be-9e0be6be1b67 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:10.241810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-8548e8f0-606a-4c70-b3be-9e0be6be1b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:10.320867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:10.337100 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548e8f0-606a-4c70-b3be-9e0be6be1b67 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:10.342962 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f110bd-8d66-4348-81cd-6a4ab3456f5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:10.343697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f110bd-8d66-4348-81cd-6a4ab3456f5b service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:10.344068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f110bd-8d66-4348-81cd-6a4ab3456f5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:10.344411 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f110bd-8d66-4348-81cd-6a4ab3456f5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:10.355329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f110bd-8d66-4348-81cd-6a4ab3456f5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:10.357336 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f110bd-8d66-4348-81cd-6a4ab3456f5b service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:10.369458 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1035/2086] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:17:11.261636 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf82f5-fa49-4018-86df-e0393dc11a2a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:11.263220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7fcf82f5-fa49-4018-86df-e0393dc11a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:11.279562 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf82f5-fa49-4018-86df-e0393dc11a2a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:11.287907 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be6d78-99de-44ef-bbdb-639c618d363c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:11.288835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be6d78-99de-44ef-bbdb-639c618d363c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:11.289561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be6d78-99de-44ef-bbdb-639c618d363c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:11.289965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be6d78-99de-44ef-bbdb-639c618d363c admin admin] PATH_INFO: `/v3/projects/037a4cab7c6147338610deebed80d60f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:11.291815 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be6d78-99de-44ef-bbdb-639c618d363c admin admin] RBAC: Authorizing `identity:delete_project(project_id=037a4cab7c6147338610deebed80d60f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:11.294104 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be6d78-99de-44ef-bbdb-639c618d363c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:11.397518 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-49be6d78-99de-44ef-bbdb-639c618d363c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '037a4cab7c6147338610deebed80d60f', 'request_id': 'req-49be6d78-99de-44ef-bbdb-639c618d363c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:11.414531 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-49be6d78-99de-44ef-bbdb-639c618d363c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '037a4cab7c6147338610deebed80d60f', 'request_id': 'req-49be6d78-99de-44ef-bbdb-639c618d363c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:11.430598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-49be6d78-99de-44ef-bbdb-639c618d363c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '037a4cab7c6147338610deebed80d60f', 'request_id': 'req-49be6d78-99de-44ef-bbdb-639c618d363c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:11.464366 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-49be6d78-99de-44ef-bbdb-639c618d363c admin admin] The token cache is being invalidate because project 037a4cab7c6147338610deebed80d60f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:17:11.464659 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-49be6d78-99de-44ef-bbdb-639c618d363c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:11.465460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-49be6d78-99de-44ef-bbdb-639c618d363c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:11.479444 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1052/2087] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:17:11 2022] DELETE /identity/v3/projects/037a4cab7c6147338610deebed80d60f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:11.480888 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f110bd-8d66-4348-81cd-6a4ab3456f5b service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:11.504620 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f110bd-8d66-4348-81cd-6a4ab3456f5b service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:11.617934 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec27262-a478-4d31-9aaf-f472c7033a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:11.619234 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec27262-a478-4d31-9aaf-f472c7033a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:11.619234 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec27262-a478-4d31-9aaf-f472c7033a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:11.619234 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec27262-a478-4d31-9aaf-f472c7033a42 admin admin] PATH_INFO: `/v3/users/d284ee7320d141a990de00a4997ab7c1` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:11.620025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec27262-a478-4d31-9aaf-f472c7033a42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d284ee7320d141a990de00a4997ab7c1)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:11.622691 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec27262-a478-4d31-9aaf-f472c7033a42 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:11.764430 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-5ec27262-a478-4d31-9aaf-f472c7033a42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd284ee7320d141a990de00a4997ab7c1'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:11.766655 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-5ec27262-a478-4d31-9aaf-f472c7033a42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd284ee7320d141a990de00a4997ab7c1'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:11.782125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-5ec27262-a478-4d31-9aaf-f472c7033a42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd284ee7320d141a990de00a4997ab7c1'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:11.792420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-5ec27262-a478-4d31-9aaf-f472c7033a42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd284ee7320d141a990de00a4997ab7c1'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:11.821124 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-5ec27262-a478-4d31-9aaf-f472c7033a42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd284ee7320d141a990de00a4997ab7c1'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:11.880721 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1036/2088] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:17:11 2022] DELETE /identity/v3/users/d284ee7320d141a990de00a4997ab7c1 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:12.464214 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be6d78-99de-44ef-bbdb-639c618d363c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:12.465902 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-49be6d78-99de-44ef-bbdb-639c618d363c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:12.490785 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be6d78-99de-44ef-bbdb-639c618d363c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:12.558472 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53820748-9ef8-4683-970e-9298cbaa626b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:12.559141 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53820748-9ef8-4683-970e-9298cbaa626b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:12.559452 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53820748-9ef8-4683-970e-9298cbaa626b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:12.560199 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53820748-9ef8-4683-970e-9298cbaa626b admin admin] PATH_INFO: `/v3/projects/79ff321845424f78b88424a3fa237e4d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:12.560842 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53820748-9ef8-4683-970e-9298cbaa626b admin admin] RBAC: Authorizing `identity:delete_project(project_id=79ff321845424f78b88424a3fa237e4d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:12.562754 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53820748-9ef8-4683-970e-9298cbaa626b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:12.564348 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:12.615674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-53820748-9ef8-4683-970e-9298cbaa626b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79ff321845424f78b88424a3fa237e4d', 'request_id': 'req-53820748-9ef8-4683-970e-9298cbaa626b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:12.623643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-53820748-9ef8-4683-970e-9298cbaa626b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79ff321845424f78b88424a3fa237e4d', 'request_id': 'req-53820748-9ef8-4683-970e-9298cbaa626b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:12.630917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-53820748-9ef8-4683-970e-9298cbaa626b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79ff321845424f78b88424a3fa237e4d', 'request_id': 'req-53820748-9ef8-4683-970e-9298cbaa626b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:12.647575 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-53820748-9ef8-4683-970e-9298cbaa626b admin admin] The token cache is being invalidate because project 79ff321845424f78b88424a3fa237e4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:17:12.647870 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-53820748-9ef8-4683-970e-9298cbaa626b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:12.648538 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-53820748-9ef8-4683-970e-9298cbaa626b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:12.650026 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1053/2089] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:17:12 2022] DELETE /identity/v3/projects/79ff321845424f78b88424a3fa237e4d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:12.655823 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c4a93-01d4-4ec3-9efb-3a74e8abfa8d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:12.656331 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c4a93-01d4-4ec3-9efb-3a74e8abfa8d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:12.656413 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c4a93-01d4-4ec3-9efb-3a74e8abfa8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:12.679121 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-305c4a93-01d4-4ec3-9efb-3a74e8abfa8d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:12.680421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-305c4a93-01d4-4ec3-9efb-3a74e8abfa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:12.759442 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1037/2090] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:12.768490 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cd159-23e3-4921-80ab-7d4041dc8bc1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:12.768773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cd159-23e3-4921-80ab-7d4041dc8bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:12.769047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cd159-23e3-4921-80ab-7d4041dc8bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:12.790642 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d25cd159-23e3-4921-80ab-7d4041dc8bc1 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:12.791881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d25cd159-23e3-4921-80ab-7d4041dc8bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:12.801740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1054/2091] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:12.806052 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c4a93-01d4-4ec3-9efb-3a74e8abfa8d None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:12.821650 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c4a93-01d4-4ec3-9efb-3a74e8abfa8d None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:12.830375 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5a6d8-79e6-4c1a-bb34-ee7ecf1262e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:12.830987 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5a6d8-79e6-4c1a-bb34-ee7ecf1262e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:12.831295 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5a6d8-79e6-4c1a-bb34-ee7ecf1262e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:12.831563 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5a6d8-79e6-4c1a-bb34-ee7ecf1262e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:12.832442 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5a6d8-79e6-4c1a-bb34-ee7ecf1262e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:17:12.832781 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5a6d8-79e6-4c1a-bb34-ee7ecf1262e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:12.835046 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5a6d8-79e6-4c1a-bb34-ee7ecf1262e4 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:12.838476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:12.860223 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1038/2092] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:17:12.862120 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cd159-23e3-4921-80ab-7d4041dc8bc1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:12.872703 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cd159-23e3-4921-80ab-7d4041dc8bc1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:12.878615 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356a8a0-1a82-4cb1-828f-6175bc0d757a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:12.879751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356a8a0-1a82-4cb1-828f-6175bc0d757a admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:12.880215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356a8a0-1a82-4cb1-828f-6175bc0d757a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:12.880665 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356a8a0-1a82-4cb1-828f-6175bc0d757a admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:12.881775 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356a8a0-1a82-4cb1-828f-6175bc0d757a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:12.884201 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356a8a0-1a82-4cb1-828f-6175bc0d757a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:12.927060 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1055/2093] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:17:12 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:17:12.929516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5a6d8-79e6-4c1a-bb34-ee7ecf1262e4 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:12.942863 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5a6d8-79e6-4c1a-bb34-ee7ecf1262e4 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:13.087721 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd3fed-ed73-4362-a00c-d4978e032d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:13.089210 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd3fed-ed73-4362-a00c-d4978e032d94 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:13.089534 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd3fed-ed73-4362-a00c-d4978e032d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:13.089791 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd3fed-ed73-4362-a00c-d4978e032d94 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:13.090445 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd3fed-ed73-4362-a00c-d4978e032d94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:13.093916 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd3fed-ed73-4362-a00c-d4978e032d94 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:13.152772 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1039/2094] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:17:12 2022] POST /identity/v3/users => generated 288 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:17:13.158961 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356a8a0-1a82-4cb1-828f-6175bc0d757a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:13.171458 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356a8a0-1a82-4cb1-828f-6175bc0d757a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:13.177086 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5249ba-ee48-4eb2-841e-dfa28cbbe04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:13.177851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5249ba-ee48-4eb2-841e-dfa28cbbe04b admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:13.178136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5249ba-ee48-4eb2-841e-dfa28cbbe04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:13.178409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5249ba-ee48-4eb2-841e-dfa28cbbe04b admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:13.179095 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5249ba-ee48-4eb2-841e-dfa28cbbe04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:13.181458 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5249ba-ee48-4eb2-841e-dfa28cbbe04b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:13.193065 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1056/2095] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:13.197383 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd3fed-ed73-4362-a00c-d4978e032d94 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:13.209865 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd3fed-ed73-4362-a00c-d4978e032d94 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:13.223547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f5a8c-5e6b-4284-8e21-a7bfde9e0713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:13.225412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f5a8c-5e6b-4284-8e21-a7bfde9e0713 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:13.225872 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f5a8c-5e6b-4284-8e21-a7bfde9e0713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:13.226372 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f5a8c-5e6b-4284-8e21-a7bfde9e0713 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:13.227372 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f5a8c-5e6b-4284-8e21-a7bfde9e0713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:13.230946 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f5a8c-5e6b-4284-8e21-a7bfde9e0713 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:13.253441 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1040/2096] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:13.254992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5249ba-ee48-4eb2-841e-dfa28cbbe04b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:13.266215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5249ba-ee48-4eb2-841e-dfa28cbbe04b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:13.272487 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa23664-4c29-4556-96ec-5a0075411ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:13.273460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa23664-4c29-4556-96ec-5a0075411ee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:13.273812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa23664-4c29-4556-96ec-5a0075411ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:13.274149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa23664-4c29-4556-96ec-5a0075411ee9 admin admin] PATH_INFO: `/v3/projects/a438675cf2814f66b49d455296cc51f6/users/83f063a72ac341df9cd9eb1953fa62cd/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:13.300672 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa23664-4c29-4556-96ec-5a0075411ee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a438675cf2814f66b49d455296cc51f6, user_id=83f063a72ac341df9cd9eb1953fa62cd, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:13.303717 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa23664-4c29-4556-96ec-5a0075411ee9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:13.321726 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1057/2097] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:17:13 2022] PUT /identity/v3/projects/a438675cf2814f66b49d455296cc51f6/users/83f063a72ac341df9cd9eb1953fa62cd/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:13.332289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000db9b5-a678-4984-a5df-3895c5a92003 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:13.332579 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000db9b5-a678-4984-a5df-3895c5a92003 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:13.332834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000db9b5-a678-4984-a5df-3895c5a92003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:13.367189 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-000db9b5-a678-4984-a5df-3895c5a92003 None None] MFA Rules not processed for user `83f063a72ac341df9cd9eb1953fa62cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:13.368492 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-000db9b5-a678-4984-a5df-3895c5a92003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:13.448876 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1041/2098] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:13.453321 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa23664-4c29-4556-96ec-5a0075411ee9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:13.543866 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa23664-4c29-4556-96ec-5a0075411ee9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:13.551274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296837d3-40ee-4fc6-8985-3aceda4f0e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:13.551915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296837d3-40ee-4fc6-8985-3aceda4f0e19 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:13.552196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296837d3-40ee-4fc6-8985-3aceda4f0e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:13.552467 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296837d3-40ee-4fc6-8985-3aceda4f0e19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:13.553115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296837d3-40ee-4fc6-8985-3aceda4f0e19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:13.556157 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296837d3-40ee-4fc6-8985-3aceda4f0e19 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:13.601239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1058/2099] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:17:13 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:17:13.606855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000db9b5-a678-4984-a5df-3895c5a92003 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:13.618211 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000db9b5-a678-4984-a5df-3895c5a92003 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:13.717384 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8fd1d-6f49-4b0e-bd47-6b782d655dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:13.718056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8fd1d-6f49-4b0e-bd47-6b782d655dba admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:13.718492 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8fd1d-6f49-4b0e-bd47-6b782d655dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:13.719072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8fd1d-6f49-4b0e-bd47-6b782d655dba admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:13.719893 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8fd1d-6f49-4b0e-bd47-6b782d655dba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:13.725785 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8fd1d-6f49-4b0e-bd47-6b782d655dba admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:13.743580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:13.765668 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296837d3-40ee-4fc6-8985-3aceda4f0e19 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:13.776726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1042/2100] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:17:13 2022] POST /identity/v3/users => generated 294 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:17:13.783027 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296837d3-40ee-4fc6-8985-3aceda4f0e19 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:13.791531 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c359778-fe4b-4d53-88be-f33848fdfb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:13.792310 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c359778-fe4b-4d53-88be-f33848fdfb48 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:13.792632 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c359778-fe4b-4d53-88be-f33848fdfb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:13.792994 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c359778-fe4b-4d53-88be-f33848fdfb48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:13.794341 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c359778-fe4b-4d53-88be-f33848fdfb48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:13.796150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c359778-fe4b-4d53-88be-f33848fdfb48 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:13.805448 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:13.816341 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1059/2101] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:13.819552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8fd1d-6f49-4b0e-bd47-6b782d655dba admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:13.830475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8fd1d-6f49-4b0e-bd47-6b782d655dba admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:13.835821 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b82bd-b332-4b8d-b2da-cb1bed331488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:13.836726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b82bd-b332-4b8d-b2da-cb1bed331488 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:13.837008 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b82bd-b332-4b8d-b2da-cb1bed331488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:13.837547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b82bd-b332-4b8d-b2da-cb1bed331488 admin admin] PATH_INFO: `/v3/projects/23746a2413184aa2bbc1358f6103a542/users/8eceb9c5aeb3420e80240c8bb5b823ae/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:13.856440 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b82bd-b332-4b8d-b2da-cb1bed331488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23746a2413184aa2bbc1358f6103a542, user_id=8eceb9c5aeb3420e80240c8bb5b823ae, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:13.859715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b82bd-b332-4b8d-b2da-cb1bed331488 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:13.881029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1043/2102] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:17:13 2022] PUT /identity/v3/projects/23746a2413184aa2bbc1358f6103a542/users/8eceb9c5aeb3420e80240c8bb5b823ae/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:13.884696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c359778-fe4b-4d53-88be-f33848fdfb48 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:13.897744 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c359778-fe4b-4d53-88be-f33848fdfb48 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:14.000730 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3812128-38f4-4fa1-8ab6-18f89b1082ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:14.001687 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3812128-38f4-4fa1-8ab6-18f89b1082ab admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:14.002071 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3812128-38f4-4fa1-8ab6-18f89b1082ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:14.002435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3812128-38f4-4fa1-8ab6-18f89b1082ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:14.003203 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3812128-38f4-4fa1-8ab6-18f89b1082ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:14.005366 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3812128-38f4-4fa1-8ab6-18f89b1082ab admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:14.025547 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1060/2103] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:14.026695 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b82bd-b332-4b8d-b2da-cb1bed331488 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:14.039127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b82bd-b332-4b8d-b2da-cb1bed331488 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:14.044199 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70821325-408f-4200-8409-12e7498f4439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:14.044866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70821325-408f-4200-8409-12e7498f4439 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:14.045205 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70821325-408f-4200-8409-12e7498f4439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:14.045390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70821325-408f-4200-8409-12e7498f4439 admin admin] PATH_INFO: `/v3/projects/23746a2413184aa2bbc1358f6103a542/users/8eceb9c5aeb3420e80240c8bb5b823ae/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:14.047387 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70821325-408f-4200-8409-12e7498f4439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23746a2413184aa2bbc1358f6103a542, user_id=8eceb9c5aeb3420e80240c8bb5b823ae, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:14.050777 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70821325-408f-4200-8409-12e7498f4439 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:14.061496 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1044/2104] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:17:14 2022] PUT /identity/v3/projects/23746a2413184aa2bbc1358f6103a542/users/8eceb9c5aeb3420e80240c8bb5b823ae/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:14.073460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfb300-c15c-49be-8e49-6574496b3e2a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:14.073788 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfb300-c15c-49be-8e49-6574496b3e2a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:14.074131 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfb300-c15c-49be-8e49-6574496b3e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:14.108873 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a3bfb300-c15c-49be-8e49-6574496b3e2a None None] MFA Rules not processed for user `8eceb9c5aeb3420e80240c8bb5b823ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:14.110190 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a3bfb300-c15c-49be-8e49-6574496b3e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:14.218761 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1061/2105] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:14.230553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70821325-408f-4200-8409-12e7498f4439 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:14.232499 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-70821325-408f-4200-8409-12e7498f4439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:14.309750 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70821325-408f-4200-8409-12e7498f4439 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:14.315121 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9597a8-d16f-4b2b-a246-57b56ae1b951 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:14.315978 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9597a8-d16f-4b2b-a246-57b56ae1b951 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:14.316393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9597a8-d16f-4b2b-a246-57b56ae1b951 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:14.316673 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9597a8-d16f-4b2b-a246-57b56ae1b951 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:14.385860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9597a8-d16f-4b2b-a246-57b56ae1b951 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:14.387311 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9597a8-d16f-4b2b-a246-57b56ae1b951 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:14.397353 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1045/2106] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:17:15.367833 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfb300-c15c-49be-8e49-6574496b3e2a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:15.370319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a3bfb300-c15c-49be-8e49-6574496b3e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:15.469226 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfb300-c15c-49be-8e49-6574496b3e2a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:15.479031 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338d1ac-69b2-42c0-91ed-c92060c55448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:15.479829 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338d1ac-69b2-42c0-91ed-c92060c55448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:15.480620 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338d1ac-69b2-42c0-91ed-c92060c55448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:15.480903 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338d1ac-69b2-42c0-91ed-c92060c55448 admin admin] PATH_INFO: `/v3/users/fca2e480291d4275a6cdc7899d8098bc` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:15.482068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338d1ac-69b2-42c0-91ed-c92060c55448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fca2e480291d4275a6cdc7899d8098bc)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:15.484100 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338d1ac-69b2-42c0-91ed-c92060c55448 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:15.510734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:15.553249 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6338d1ac-69b2-42c0-91ed-c92060c55448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fca2e480291d4275a6cdc7899d8098bc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:15.553987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6338d1ac-69b2-42c0-91ed-c92060c55448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fca2e480291d4275a6cdc7899d8098bc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:15.563349 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6338d1ac-69b2-42c0-91ed-c92060c55448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fca2e480291d4275a6cdc7899d8098bc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:15.576559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6338d1ac-69b2-42c0-91ed-c92060c55448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fca2e480291d4275a6cdc7899d8098bc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:15.596568 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6338d1ac-69b2-42c0-91ed-c92060c55448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fca2e480291d4275a6cdc7899d8098bc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:15.604789 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1062/2107] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:17:15 2022] DELETE /identity/v3/users/fca2e480291d4275a6cdc7899d8098bc => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:15.609905 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5d74f-a7cb-434b-b743-a3db60a72aca None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:15.610453 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5d74f-a7cb-434b-b743-a3db60a72aca None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:15.610453 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5d74f-a7cb-434b-b743-a3db60a72aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:15.639747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-3bf5d74f-a7cb-434b-b743-a3db60a72aca None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:15.641537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3bf5d74f-a7cb-434b-b743-a3db60a72aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:15.738990 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1046/2108] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:15.749100 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338d1ac-69b2-42c0-91ed-c92060c55448 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:15.751085 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6338d1ac-69b2-42c0-91ed-c92060c55448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:15.874263 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338d1ac-69b2-42c0-91ed-c92060c55448 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:15.884898 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c2c2c-6f6b-4205-9a80-c9fd06b5d3c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:15.885534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c2c2c-6f6b-4205-9a80-c9fd06b5d3c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:15.885818 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c2c2c-6f6b-4205-9a80-c9fd06b5d3c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:15.886088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c2c2c-6f6b-4205-9a80-c9fd06b5d3c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:15.906342 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c2c2c-6f6b-4205-9a80-c9fd06b5d3c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:15.907852 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c2c2c-6f6b-4205-9a80-c9fd06b5d3c6 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:15.931527 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1063/2109] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:17:16.505846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5d74f-a7cb-434b-b743-a3db60a72aca None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:16.507585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3bf5d74f-a7cb-434b-b743-a3db60a72aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:16.523091 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5d74f-a7cb-434b-b743-a3db60a72aca None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:16.531652 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d78731-188d-4b04-a542-bab875e3233f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:16.532626 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d78731-188d-4b04-a542-bab875e3233f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:16.533536 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d78731-188d-4b04-a542-bab875e3233f admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:16.534024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d78731-188d-4b04-a542-bab875e3233f admin admin] PATH_INFO: `/v3/projects/d77fc537238847db8221ae170cf9b273` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:16.535396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d78731-188d-4b04-a542-bab875e3233f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d77fc537238847db8221ae170cf9b273)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:16.537808 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d78731-188d-4b04-a542-bab875e3233f admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:16.541466 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:16.614444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a6d78731-188d-4b04-a542-bab875e3233f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd77fc537238847db8221ae170cf9b273', 'request_id': 'req-a6d78731-188d-4b04-a542-bab875e3233f'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:16.621409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a6d78731-188d-4b04-a542-bab875e3233f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd77fc537238847db8221ae170cf9b273', 'request_id': 'req-a6d78731-188d-4b04-a542-bab875e3233f'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:16.632059 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a6d78731-188d-4b04-a542-bab875e3233f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd77fc537238847db8221ae170cf9b273', 'request_id': 'req-a6d78731-188d-4b04-a542-bab875e3233f'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:16.662911 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a6d78731-188d-4b04-a542-bab875e3233f admin admin] The token cache is being invalidate because project d77fc537238847db8221ae170cf9b273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:17:16.663489 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a6d78731-188d-4b04-a542-bab875e3233f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:16.664422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a6d78731-188d-4b04-a542-bab875e3233f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:16.666674 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1047/2110] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:17:16 2022] DELETE /identity/v3/projects/d77fc537238847db8221ae170cf9b273 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:16.670238 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c2c2c-6f6b-4205-9a80-c9fd06b5d3c6 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:16.680393 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c2c2c-6f6b-4205-9a80-c9fd06b5d3c6 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:16.753926 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb520cb-5043-4ca5-982b-e2bdd9254c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:16.754775 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb520cb-5043-4ca5-982b-e2bdd9254c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:16.755088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb520cb-5043-4ca5-982b-e2bdd9254c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:16.755399 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb520cb-5043-4ca5-982b-e2bdd9254c48 admin admin] PATH_INFO: `/v3/users/528623c958ef45dc87b0301f32231809` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:16.756890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb520cb-5043-4ca5-982b-e2bdd9254c48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=528623c958ef45dc87b0301f32231809)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:16.759732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb520cb-5043-4ca5-982b-e2bdd9254c48 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:16.813190 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:16.814218 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ecb520cb-5043-4ca5-982b-e2bdd9254c48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '528623c958ef45dc87b0301f32231809'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:16.815362 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ecb520cb-5043-4ca5-982b-e2bdd9254c48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '528623c958ef45dc87b0301f32231809'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:16.825853 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ecb520cb-5043-4ca5-982b-e2bdd9254c48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '528623c958ef45dc87b0301f32231809'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:16.834561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ecb520cb-5043-4ca5-982b-e2bdd9254c48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '528623c958ef45dc87b0301f32231809'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:16.848767 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ecb520cb-5043-4ca5-982b-e2bdd9254c48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '528623c958ef45dc87b0301f32231809'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:16.855738 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1064/2111] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:17:16 2022] DELETE /identity/v3/users/528623c958ef45dc87b0301f32231809 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:17.134959 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d78731-188d-4b04-a542-bab875e3233f admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:17.136549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-a6d78731-188d-4b04-a542-bab875e3233f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:17.152895 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d78731-188d-4b04-a542-bab875e3233f admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:17.220045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2d3d8-c130-49e3-b7aa-fbe1aec1be87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:17.220935 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2d3d8-c130-49e3-b7aa-fbe1aec1be87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:17.221217 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2d3d8-c130-49e3-b7aa-fbe1aec1be87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:17.221489 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2d3d8-c130-49e3-b7aa-fbe1aec1be87 admin admin] PATH_INFO: `/v3/users/83f063a72ac341df9cd9eb1953fa62cd` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:17.222751 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2d3d8-c130-49e3-b7aa-fbe1aec1be87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83f063a72ac341df9cd9eb1953fa62cd)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:17.224890 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2d3d8-c130-49e3-b7aa-fbe1aec1be87 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:17.293662 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-82a2d3d8-c130-49e3-b7aa-fbe1aec1be87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83f063a72ac341df9cd9eb1953fa62cd'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:17.294696 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-82a2d3d8-c130-49e3-b7aa-fbe1aec1be87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83f063a72ac341df9cd9eb1953fa62cd'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:17.306056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-82a2d3d8-c130-49e3-b7aa-fbe1aec1be87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83f063a72ac341df9cd9eb1953fa62cd'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:17.319084 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-82a2d3d8-c130-49e3-b7aa-fbe1aec1be87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83f063a72ac341df9cd9eb1953fa62cd'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:17.334735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-82a2d3d8-c130-49e3-b7aa-fbe1aec1be87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83f063a72ac341df9cd9eb1953fa62cd'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:17.342081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1048/2112] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:17:17 2022] DELETE /identity/v3/users/83f063a72ac341df9cd9eb1953fa62cd => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:17.347029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f1a12-2191-4341-b6d5-2a2912929602 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:17.347321 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f1a12-2191-4341-b6d5-2a2912929602 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:17.347599 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f1a12-2191-4341-b6d5-2a2912929602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:17.375899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-768f1a12-2191-4341-b6d5-2a2912929602 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:17.377743 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-768f1a12-2191-4341-b6d5-2a2912929602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:17.459435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1065/2113] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:17.473080 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2d3d8-c130-49e3-b7aa-fbe1aec1be87 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:17.474636 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-82a2d3d8-c130-49e3-b7aa-fbe1aec1be87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:17.491855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:17.566832 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2d3d8-c130-49e3-b7aa-fbe1aec1be87 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:17.572654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c771210-e290-421c-a8ca-5130172501f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:17.574868 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c771210-e290-421c-a8ca-5130172501f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:17.574868 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c771210-e290-421c-a8ca-5130172501f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:17.575122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c771210-e290-421c-a8ca-5130172501f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:17.587546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c771210-e290-421c-a8ca-5130172501f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:17.590173 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c771210-e290-421c-a8ca-5130172501f1 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:17.602501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1049/2114] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:17:17.614047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f1a12-2191-4341-b6d5-2a2912929602 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:17.617454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-768f1a12-2191-4341-b6d5-2a2912929602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:17.633905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f1a12-2191-4341-b6d5-2a2912929602 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:17.640206 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc5455-e709-49bb-a5a6-5dfe44fbe25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:17.641505 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5455-e709-49bb-a5a6-5dfe44fbe25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:17.641999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5455-e709-49bb-a5a6-5dfe44fbe25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:17.642423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5455-e709-49bb-a5a6-5dfe44fbe25e admin admin] PATH_INFO: `/v3/projects/66b9b9e4c0694eba89bcb9e03002620b` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:17.645562 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc5455-e709-49bb-a5a6-5dfe44fbe25e admin admin] RBAC: Authorizing `identity:delete_project(project_id=66b9b9e4c0694eba89bcb9e03002620b)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:17.648048 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc5455-e709-49bb-a5a6-5dfe44fbe25e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:17.726413 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-dadc5455-e709-49bb-a5a6-5dfe44fbe25e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66b9b9e4c0694eba89bcb9e03002620b', 'request_id': 'req-dadc5455-e709-49bb-a5a6-5dfe44fbe25e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:17.740274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-dadc5455-e709-49bb-a5a6-5dfe44fbe25e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66b9b9e4c0694eba89bcb9e03002620b', 'request_id': 'req-dadc5455-e709-49bb-a5a6-5dfe44fbe25e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:17.749148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-dadc5455-e709-49bb-a5a6-5dfe44fbe25e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66b9b9e4c0694eba89bcb9e03002620b', 'request_id': 'req-dadc5455-e709-49bb-a5a6-5dfe44fbe25e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:17.765325 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-dadc5455-e709-49bb-a5a6-5dfe44fbe25e admin admin] The token cache is being invalidate because project 66b9b9e4c0694eba89bcb9e03002620b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:17:17.765761 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-dadc5455-e709-49bb-a5a6-5dfe44fbe25e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:17.766546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-dadc5455-e709-49bb-a5a6-5dfe44fbe25e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:17.768763 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1066/2115] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:17:17 2022] DELETE /identity/v3/projects/66b9b9e4c0694eba89bcb9e03002620b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:17.774085 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdf154-760e-4f50-9695-dfc7f732361f None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:17.774677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdf154-760e-4f50-9695-dfc7f732361f None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:17.774677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdf154-760e-4f50-9695-dfc7f732361f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:17.804254 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-3fcdf154-760e-4f50-9695-dfc7f732361f None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:17.806392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3fcdf154-760e-4f50-9695-dfc7f732361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:17.899049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1050/2116] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:17.903415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd897fc7-ae6d-4d1f-a075-caacaf1c5766 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:17.903702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd897fc7-ae6d-4d1f-a075-caacaf1c5766 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:17.904009 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd897fc7-ae6d-4d1f-a075-caacaf1c5766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:17.931110 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-dd897fc7-ae6d-4d1f-a075-caacaf1c5766 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:17.932607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dd897fc7-ae6d-4d1f-a075-caacaf1c5766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:17.941846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1067/2117] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:17.945689 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdf154-760e-4f50-9695-dfc7f732361f None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:17.957257 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdf154-760e-4f50-9695-dfc7f732361f None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:17.963642 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869319b1-8cda-4c18-81c8-3d0b2a517574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:17.964268 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869319b1-8cda-4c18-81c8-3d0b2a517574 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:17.964811 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869319b1-8cda-4c18-81c8-3d0b2a517574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:17.965413 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869319b1-8cda-4c18-81c8-3d0b2a517574 admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:17.966375 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869319b1-8cda-4c18-81c8-3d0b2a517574 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:17:17.966864 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869319b1-8cda-4c18-81c8-3d0b2a517574 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:17.968659 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869319b1-8cda-4c18-81c8-3d0b2a517574 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:17.985283 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1051/2118] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:17:17.986676 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd897fc7-ae6d-4d1f-a075-caacaf1c5766 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:18.003785 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd897fc7-ae6d-4d1f-a075-caacaf1c5766 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:18.015732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf368ae-b431-49b8-aac7-5347c7b3a0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:18.016356 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf368ae-b431-49b8-aac7-5347c7b3a0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:18.016632 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf368ae-b431-49b8-aac7-5347c7b3a0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:18.016901 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf368ae-b431-49b8-aac7-5347c7b3a0a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:18.018114 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf368ae-b431-49b8-aac7-5347c7b3a0a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:18.020517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf368ae-b431-49b8-aac7-5347c7b3a0a5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:18.067051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1068/2119] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:17:17 2022] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:17:18.069345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869319b1-8cda-4c18-81c8-3d0b2a517574 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:18.084148 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869319b1-8cda-4c18-81c8-3d0b2a517574 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:18.201700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85316cc6-2607-4727-8240-dbf71768abb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:18.202422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85316cc6-2607-4727-8240-dbf71768abb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:18.203073 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85316cc6-2607-4727-8240-dbf71768abb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:18.203570 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85316cc6-2607-4727-8240-dbf71768abb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:18.204268 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85316cc6-2607-4727-8240-dbf71768abb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:18.206321 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85316cc6-2607-4727-8240-dbf71768abb8 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:18.245942 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf368ae-b431-49b8-aac7-5347c7b3a0a5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:18.254193 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1052/2120] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:17:18 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:17:18.259873 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf368ae-b431-49b8-aac7-5347c7b3a0a5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:18.264348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85316cc6-2607-4727-8240-dbf71768abb8 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:18.267713 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-85316cc6-2607-4727-8240-dbf71768abb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:18.280421 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c8e27-1a0d-4cfb-a833-2bcf6c02bc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:18.280421 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8e27-1a0d-4cfb-a833-2bcf6c02bc8a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:18.280421 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8e27-1a0d-4cfb-a833-2bcf6c02bc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:18.280421 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8e27-1a0d-4cfb-a833-2bcf6c02bc8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:18.284146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c8e27-1a0d-4cfb-a833-2bcf6c02bc8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:18.288380 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c8e27-1a0d-4cfb-a833-2bcf6c02bc8a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:18.301222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85316cc6-2607-4727-8240-dbf71768abb8 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:18.307244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad85a6-2490-431d-b21f-17c631784591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:18.308260 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad85a6-2490-431d-b21f-17c631784591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:18.308728 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad85a6-2490-431d-b21f-17c631784591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:18.309134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad85a6-2490-431d-b21f-17c631784591 admin admin] PATH_INFO: `/v3/projects/a438675cf2814f66b49d455296cc51f6` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:18.310615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad85a6-2490-431d-b21f-17c631784591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a438675cf2814f66b49d455296cc51f6)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:18.314646 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1069/2121] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:18.316558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c8e27-1a0d-4cfb-a833-2bcf6c02bc8a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:18.316683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad85a6-2490-431d-b21f-17c631784591 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:18.332049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c8e27-1a0d-4cfb-a833-2bcf6c02bc8a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:18.339328 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2aacb-4a72-430f-bb5d-3db0ed6d4322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:18.340084 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2aacb-4a72-430f-bb5d-3db0ed6d4322 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:18.340525 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2aacb-4a72-430f-bb5d-3db0ed6d4322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:18.341279 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2aacb-4a72-430f-bb5d-3db0ed6d4322 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:18.342158 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2aacb-4a72-430f-bb5d-3db0ed6d4322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:18.344930 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2aacb-4a72-430f-bb5d-3db0ed6d4322 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:18.347622 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:18.364132 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:18.369180 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1070/2122] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:18.374112 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2aacb-4a72-430f-bb5d-3db0ed6d4322 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:18.390159 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c2ad85a6-2490-431d-b21f-17c631784591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a438675cf2814f66b49d455296cc51f6', 'request_id': 'req-c2ad85a6-2490-431d-b21f-17c631784591'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:18.396579 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c2ad85a6-2490-431d-b21f-17c631784591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a438675cf2814f66b49d455296cc51f6', 'request_id': 'req-c2ad85a6-2490-431d-b21f-17c631784591'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:18.404480 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2aacb-4a72-430f-bb5d-3db0ed6d4322 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:18.407313 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c2ad85a6-2490-431d-b21f-17c631784591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a438675cf2814f66b49d455296cc51f6', 'request_id': 'req-c2ad85a6-2490-431d-b21f-17c631784591'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:18.439520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c2ad85a6-2490-431d-b21f-17c631784591 admin admin] The token cache is being invalidate because project a438675cf2814f66b49d455296cc51f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:17:18.440047 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c2ad85a6-2490-431d-b21f-17c631784591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:18.441390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c2ad85a6-2490-431d-b21f-17c631784591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:18.443284 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1053/2123] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:17:18 2022] DELETE /identity/v3/projects/a438675cf2814f66b49d455296cc51f6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:17:18.447551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad85a6-2490-431d-b21f-17c631784591 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:18.449528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c2ad85a6-2490-431d-b21f-17c631784591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:18.547404 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b8905-232f-44d9-b919-7c1e4d2afb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:18.548096 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b8905-232f-44d9-b919-7c1e4d2afb33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:18.548393 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b8905-232f-44d9-b919-7c1e4d2afb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:18.550920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b8905-232f-44d9-b919-7c1e4d2afb33 admin admin] PATH_INFO: `/v3/projects/0e532c938b5b404aad96c11a7552dd92/users/59541f67ed50414fa12d0a66c12cd297/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:18.590641 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b8905-232f-44d9-b919-7c1e4d2afb33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e532c938b5b404aad96c11a7552dd92, user_id=59541f67ed50414fa12d0a66c12cd297, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:18.595286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b8905-232f-44d9-b919-7c1e4d2afb33 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:18.615509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1071/2124] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:17:18 2022] PUT /identity/v3/projects/0e532c938b5b404aad96c11a7552dd92/users/59541f67ed50414fa12d0a66c12cd297/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:18.629321 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99062a9b-7104-4d9d-bcf6-4677467cdd7d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:18.629594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99062a9b-7104-4d9d-bcf6-4677467cdd7d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:18.629854 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99062a9b-7104-4d9d-bcf6-4677467cdd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:18.630237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad85a6-2490-431d-b21f-17c631784591 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:18.691050 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-99062a9b-7104-4d9d-bcf6-4677467cdd7d None None] MFA Rules not processed for user `59541f67ed50414fa12d0a66c12cd297`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:18.692277 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-99062a9b-7104-4d9d-bcf6-4677467cdd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:18.744601 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65f9cd-dabc-4f39-ba76-4cb741eae83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:18.745254 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65f9cd-dabc-4f39-ba76-4cb741eae83b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:18.745643 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65f9cd-dabc-4f39-ba76-4cb741eae83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:18.746015 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65f9cd-dabc-4f39-ba76-4cb741eae83b admin admin] PATH_INFO: `/v3/users/8eceb9c5aeb3420e80240c8bb5b823ae` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:18.747757 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65f9cd-dabc-4f39-ba76-4cb741eae83b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eceb9c5aeb3420e80240c8bb5b823ae)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:18.749974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65f9cd-dabc-4f39-ba76-4cb741eae83b admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:18.847744 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1072/2125] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:18.855310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7d65f9cd-dabc-4f39-ba76-4cb741eae83b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eceb9c5aeb3420e80240c8bb5b823ae'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:18.856160 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7d65f9cd-dabc-4f39-ba76-4cb741eae83b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eceb9c5aeb3420e80240c8bb5b823ae'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:18.860922 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99062a9b-7104-4d9d-bcf6-4677467cdd7d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:18.863368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-99062a9b-7104-4d9d-bcf6-4677467cdd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:18.865412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7d65f9cd-dabc-4f39-ba76-4cb741eae83b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eceb9c5aeb3420e80240c8bb5b823ae'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:18.878654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7d65f9cd-dabc-4f39-ba76-4cb741eae83b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eceb9c5aeb3420e80240c8bb5b823ae'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:18.880514 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:18.894860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7d65f9cd-dabc-4f39-ba76-4cb741eae83b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eceb9c5aeb3420e80240c8bb5b823ae'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:18.901926 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1054/2126] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:17:18 2022] DELETE /identity/v3/users/8eceb9c5aeb3420e80240c8bb5b823ae => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:18.959331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:18.964327 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99062a9b-7104-4d9d-bcf6-4677467cdd7d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:19.030137 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f8622-a615-4404-bee7-1fc0a4caf344 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5979be13ad31421b886069faf0dcc915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:19.030897 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f8622-a615-4404-bee7-1fc0a4caf344 service glance] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:19.031217 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f8622-a615-4404-bee7-1fc0a4caf344 service glance] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:19.031511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f8622-a615-4404-bee7-1fc0a4caf344 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:19.033331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ea3f8622-a615-4404-bee7-1fc0a4caf344 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:19.117130 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f8622-a615-4404-bee7-1fc0a4caf344 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:19.118744 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f8622-a615-4404-bee7-1fc0a4caf344 service glance] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:19.132749 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1073/2127] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:17:19.161032 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05c9c3-4f40-4ea6-8f1c-7c49b6e8893a None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:19.161327 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05c9c3-4f40-4ea6-8f1c-7c49b6e8893a None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:19.161604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05c9c3-4f40-4ea6-8f1c-7c49b6e8893a None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:19.163123 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1055/2128] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 10 13:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:17:19.197870 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f8622-a615-4404-bee7-1fc0a4caf344 service glance] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:19.199822 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a63c40-2a2e-430a-8628-4815ea5bde3d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:19.200113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a63c40-2a2e-430a-8628-4815ea5bde3d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:19.200366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a63c40-2a2e-430a-8628-4815ea5bde3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:19.203989 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ea3f8622-a615-4404-bee7-1fc0a4caf344 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:19.255404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-75a63c40-2a2e-430a-8628-4815ea5bde3d None None] MFA Rules not processed for user `15780b69faa745e9b99f1fffb6abe231`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:19.257063 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-75a63c40-2a2e-430a-8628-4815ea5bde3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:19.326001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f8622-a615-4404-bee7-1fc0a4caf344 service glance] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:19.333024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67070429-59b2-4014-9045-4a0c5e6a9d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:19.333667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67070429-59b2-4014-9045-4a0c5e6a9d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:19.333952 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67070429-59b2-4014-9045-4a0c5e6a9d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:19.334276 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67070429-59b2-4014-9045-4a0c5e6a9d97 admin admin] PATH_INFO: `/v3/projects/23746a2413184aa2bbc1358f6103a542` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:19.335474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67070429-59b2-4014-9045-4a0c5e6a9d97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23746a2413184aa2bbc1358f6103a542)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:19.338193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67070429-59b2-4014-9045-4a0c5e6a9d97 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:19.348918 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1056/2129] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 10 13:17:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:19.349565 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a63c40-2a2e-430a-8628-4815ea5bde3d None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:19.350987 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-75a63c40-2a2e-430a-8628-4815ea5bde3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:19.366310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a63c40-2a2e-430a-8628-4815ea5bde3d None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:19.370889 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af556c-8978-45bb-8c7f-1cc05651cbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:19.371552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af556c-8978-45bb-8c7f-1cc05651cbcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:19.371835 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af556c-8978-45bb-8c7f-1cc05651cbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:19.372112 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af556c-8978-45bb-8c7f-1cc05651cbcf admin admin] PATH_INFO: `/v3/users/92795f97c5e04b32a74aab762332cbea` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:19.373268 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af556c-8978-45bb-8c7f-1cc05651cbcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=92795f97c5e04b32a74aab762332cbea)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:19.375604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af556c-8978-45bb-8c7f-1cc05651cbcf admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:19.399653 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-67070429-59b2-4014-9045-4a0c5e6a9d97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23746a2413184aa2bbc1358f6103a542', 'request_id': 'req-67070429-59b2-4014-9045-4a0c5e6a9d97'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:19.409752 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-67070429-59b2-4014-9045-4a0c5e6a9d97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23746a2413184aa2bbc1358f6103a542', 'request_id': 'req-67070429-59b2-4014-9045-4a0c5e6a9d97'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:19.417477 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-67070429-59b2-4014-9045-4a0c5e6a9d97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23746a2413184aa2bbc1358f6103a542', 'request_id': 'req-67070429-59b2-4014-9045-4a0c5e6a9d97'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:19.419020 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:19.431590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-67070429-59b2-4014-9045-4a0c5e6a9d97 admin admin] The token cache is being invalidate because project 23746a2413184aa2bbc1358f6103a542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:17:19.432136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-67070429-59b2-4014-9045-4a0c5e6a9d97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:19.433054 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-67070429-59b2-4014-9045-4a0c5e6a9d97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:19.434713 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1074/2130] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:17:19 2022] DELETE /identity/v3/projects/23746a2413184aa2bbc1358f6103a542 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:19.435521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d5af556c-8978-45bb-8c7f-1cc05651cbcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92795f97c5e04b32a74aab762332cbea'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:19.435934 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67070429-59b2-4014-9045-4a0c5e6a9d97 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:19.455039 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d5af556c-8978-45bb-8c7f-1cc05651cbcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92795f97c5e04b32a74aab762332cbea'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:19.455267 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-67070429-59b2-4014-9045-4a0c5e6a9d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:19.465667 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d5af556c-8978-45bb-8c7f-1cc05651cbcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92795f97c5e04b32a74aab762332cbea'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:19.476859 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d5af556c-8978-45bb-8c7f-1cc05651cbcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92795f97c5e04b32a74aab762332cbea'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:19.494969 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d5af556c-8978-45bb-8c7f-1cc05651cbcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92795f97c5e04b32a74aab762332cbea'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:19.504359 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1057/2131] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:17:19 2022] DELETE /identity/v3/users/92795f97c5e04b32a74aab762332cbea => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:19.581177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67070429-59b2-4014-9045-4a0c5e6a9d97 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:19.713393 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364185c-b123-432b-9f66-4f00273d6686 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15780b69faa745e9b99f1fffb6abe231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:19.714401 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364185c-b123-432b-9f66-4f00273d6686 service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:19.718508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364185c-b123-432b-9f66-4f00273d6686 service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:19.724546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364185c-b123-432b-9f66-4f00273d6686 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:19.729317 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a364185c-b123-432b-9f66-4f00273d6686 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:19.758811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364185c-b123-432b-9f66-4f00273d6686 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:19.761314 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364185c-b123-432b-9f66-4f00273d6686 service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:19.808972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1075/2132] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:17:19.836174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af556c-8978-45bb-8c7f-1cc05651cbcf admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:19.838137 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d5af556c-8978-45bb-8c7f-1cc05651cbcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:19.936164 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:19.967588 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af556c-8978-45bb-8c7f-1cc05651cbcf admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:19.974973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b502c-a4d6-43a2-95d9-dd5395fb5d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:19.975655 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b502c-a4d6-43a2-95d9-dd5395fb5d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:19.975936 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b502c-a4d6-43a2-95d9-dd5395fb5d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:19.976204 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b502c-a4d6-43a2-95d9-dd5395fb5d2e admin admin] PATH_INFO: `/v3/projects/eb78c1e20a224de69589c22996e16a83` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:19.977339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b502c-a4d6-43a2-95d9-dd5395fb5d2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb78c1e20a224de69589c22996e16a83)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:19.979328 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b502c-a4d6-43a2-95d9-dd5395fb5d2e admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:20.052641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-ed6b502c-a4d6-43a2-95d9-dd5395fb5d2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb78c1e20a224de69589c22996e16a83', 'request_id': 'req-ed6b502c-a4d6-43a2-95d9-dd5395fb5d2e'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:20.059217 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-ed6b502c-a4d6-43a2-95d9-dd5395fb5d2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb78c1e20a224de69589c22996e16a83', 'request_id': 'req-ed6b502c-a4d6-43a2-95d9-dd5395fb5d2e'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:20.068182 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-ed6b502c-a4d6-43a2-95d9-dd5395fb5d2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb78c1e20a224de69589c22996e16a83', 'request_id': 'req-ed6b502c-a4d6-43a2-95d9-dd5395fb5d2e'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:20.086753 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-ed6b502c-a4d6-43a2-95d9-dd5395fb5d2e admin admin] The token cache is being invalidate because project eb78c1e20a224de69589c22996e16a83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:17:20.087624 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-ed6b502c-a4d6-43a2-95d9-dd5395fb5d2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:20.088601 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-ed6b502c-a4d6-43a2-95d9-dd5395fb5d2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:20.090298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1058/2133] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:17:19 2022] DELETE /identity/v3/projects/eb78c1e20a224de69589c22996e16a83 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:20.097784 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfa55c-fd8b-4842-96b1-30004a3c27a2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:20.098302 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfa55c-fd8b-4842-96b1-30004a3c27a2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:20.098302 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfa55c-fd8b-4842-96b1-30004a3c27a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:20.118605 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7bdfa55c-fd8b-4842-96b1-30004a3c27a2 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:20.119859 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7bdfa55c-fd8b-4842-96b1-30004a3c27a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:20.181734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1076/2134] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:20.190668 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cf6b7-6a27-41e9-8d3d-99392307728f None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:20.191078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cf6b7-6a27-41e9-8d3d-99392307728f None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:20.191360 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cf6b7-6a27-41e9-8d3d-99392307728f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:20.216059 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-b92cf6b7-6a27-41e9-8d3d-99392307728f None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:20.217418 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-b92cf6b7-6a27-41e9-8d3d-99392307728f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:20.227428 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1059/2135] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:20.232471 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfa55c-fd8b-4842-96b1-30004a3c27a2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:20.245806 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfa55c-fd8b-4842-96b1-30004a3c27a2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:20.250737 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827698a-2d2b-4689-b8d1-8883f8d68aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:20.251354 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827698a-2d2b-4689-b8d1-8883f8d68aad admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:20.251635 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827698a-2d2b-4689-b8d1-8883f8d68aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:20.251905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827698a-2d2b-4689-b8d1-8883f8d68aad admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:20.252598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827698a-2d2b-4689-b8d1-8883f8d68aad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:17:20.252898 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827698a-2d2b-4689-b8d1-8883f8d68aad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:20.254496 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827698a-2d2b-4689-b8d1-8883f8d68aad admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:20.272926 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1077/2136] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:17:20.274611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92cf6b7-6a27-41e9-8d3d-99392307728f None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:20.284951 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92cf6b7-6a27-41e9-8d3d-99392307728f None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:20.290090 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b98db7-e3f0-4113-91e4-2dc55900bd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:20.290778 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b98db7-e3f0-4113-91e4-2dc55900bd85 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:20.291159 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b98db7-e3f0-4113-91e4-2dc55900bd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:20.291498 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b98db7-e3f0-4113-91e4-2dc55900bd85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:20.292267 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b98db7-e3f0-4113-91e4-2dc55900bd85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:20.294228 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b98db7-e3f0-4113-91e4-2dc55900bd85 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:20.327064 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1060/2137] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:17:20 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:17:20.328836 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827698a-2d2b-4689-b8d1-8883f8d68aad admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:20.342103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827698a-2d2b-4689-b8d1-8883f8d68aad admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:20.347517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:20.415853 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05c873-6ba0-4e1b-9101-ce0a1024d644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:20.416987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05c873-6ba0-4e1b-9101-ce0a1024d644 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:20.417434 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05c873-6ba0-4e1b-9101-ce0a1024d644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:20.417922 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05c873-6ba0-4e1b-9101-ce0a1024d644 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:20.419028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05c873-6ba0-4e1b-9101-ce0a1024d644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:20.421473 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05c873-6ba0-4e1b-9101-ce0a1024d644 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:20.443339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1078/2138] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:17:20 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:17:20.447545 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b98db7-e3f0-4113-91e4-2dc55900bd85 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:20.458162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b98db7-e3f0-4113-91e4-2dc55900bd85 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:20.463325 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc593012-5929-405d-98d1-de17737e33e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:20.464037 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc593012-5929-405d-98d1-de17737e33e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:20.464913 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc593012-5929-405d-98d1-de17737e33e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:20.464913 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc593012-5929-405d-98d1-de17737e33e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:20.465524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc593012-5929-405d-98d1-de17737e33e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:20.467541 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc593012-5929-405d-98d1-de17737e33e8 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:20.481929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1061/2139] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:20.486581 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05c873-6ba0-4e1b-9101-ce0a1024d644 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:20.497510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05c873-6ba0-4e1b-9101-ce0a1024d644 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:20.503439 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970f774-4445-42ef-a0c4-100cbbdbca9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:20.504058 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970f774-4445-42ef-a0c4-100cbbdbca9e admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:20.504337 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970f774-4445-42ef-a0c4-100cbbdbca9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:20.504610 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970f774-4445-42ef-a0c4-100cbbdbca9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:20.505264 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970f774-4445-42ef-a0c4-100cbbdbca9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:20.506991 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970f774-4445-42ef-a0c4-100cbbdbca9e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:20.519336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1079/2140] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:20.524012 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc593012-5929-405d-98d1-de17737e33e8 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:20.535055 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc593012-5929-405d-98d1-de17737e33e8 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:20.539819 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00607ac7-18d3-46a7-b8ba-9852fb22459a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:20.540706 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00607ac7-18d3-46a7-b8ba-9852fb22459a admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:20.541020 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00607ac7-18d3-46a7-b8ba-9852fb22459a admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:20.541322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00607ac7-18d3-46a7-b8ba-9852fb22459a admin admin] PATH_INFO: `/v3/projects/29cbccfdddfa4d08882cf5854af047d2/users/db000fc481df44009c205493eb80eae2/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:20.558444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00607ac7-18d3-46a7-b8ba-9852fb22459a admin admin] RBAC: Authorizing `identity:create_grant(project_id=29cbccfdddfa4d08882cf5854af047d2, user_id=db000fc481df44009c205493eb80eae2, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:20.561269 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00607ac7-18d3-46a7-b8ba-9852fb22459a admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:20.577149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1062/2141] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:17:20 2022] PUT /identity/v3/projects/29cbccfdddfa4d08882cf5854af047d2/users/db000fc481df44009c205493eb80eae2/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:20.582347 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89fe44-0294-4d7a-bd3c-015f6cde4937 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:20.582689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89fe44-0294-4d7a-bd3c-015f6cde4937 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:20.583055 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89fe44-0294-4d7a-bd3c-015f6cde4937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:20.608395 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5b89fe44-0294-4d7a-bd3c-015f6cde4937 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:20.609598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5b89fe44-0294-4d7a-bd3c-015f6cde4937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:20.687034 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1080/2142] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:20.700683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00607ac7-18d3-46a7-b8ba-9852fb22459a admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:20.702429 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-00607ac7-18d3-46a7-b8ba-9852fb22459a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:20.764333 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00607ac7-18d3-46a7-b8ba-9852fb22459a admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:20.768075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972f27d-84ba-4d47-85c3-f1e4abaf1640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:20.768683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972f27d-84ba-4d47-85c3-f1e4abaf1640 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:20.768959 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972f27d-84ba-4d47-85c3-f1e4abaf1640 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:20.769334 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972f27d-84ba-4d47-85c3-f1e4abaf1640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:20.778727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972f27d-84ba-4d47-85c3-f1e4abaf1640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:20.780255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972f27d-84ba-4d47-85c3-f1e4abaf1640 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:20.789952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1063/2143] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:17:26.247718 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fa2d5-7ffc-40fe-a219-b17c4f28af87 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:26.248469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fa2d5-7ffc-40fe-a219-b17c4f28af87 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:26.248469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fa2d5-7ffc-40fe-a219-b17c4f28af87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:26.291190 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b54fa2d5-7ffc-40fe-a219-b17c4f28af87 None None] MFA Rules not processed for user `db000fc481df44009c205493eb80eae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:26.292423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b54fa2d5-7ffc-40fe-a219-b17c4f28af87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:26.383154 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1081/2144] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:26.395025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972f27d-84ba-4d47-85c3-f1e4abaf1640 service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:26.396949 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-8972f27d-84ba-4d47-85c3-f1e4abaf1640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:26.422692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:26.497822 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972f27d-84ba-4d47-85c3-f1e4abaf1640 service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:26.507719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e462c-25b9-4cb0-8be9-19f8c23073fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:26.508443 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e462c-25b9-4cb0-8be9-19f8c23073fd service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:26.508730 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e462c-25b9-4cb0-8be9-19f8c23073fd service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:26.509004 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e462c-25b9-4cb0-8be9-19f8c23073fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:26.519027 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e462c-25b9-4cb0-8be9-19f8c23073fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:26.520702 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e462c-25b9-4cb0-8be9-19f8c23073fd service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:26.531287 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1064/2145] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:17:26.655772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa0788-d912-4251-a2ad-167a9e7981d8 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:26.656209 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa0788-d912-4251-a2ad-167a9e7981d8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:26.656399 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa0788-d912-4251-a2ad-167a9e7981d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:26.687536 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3baa0788-d912-4251-a2ad-167a9e7981d8 None None] MFA Rules not processed for user `970d298682ee42a19d2d425be202450e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:26.688860 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3baa0788-d912-4251-a2ad-167a9e7981d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:26.710900 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:26.821570 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1082/2146] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:28.628148 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201404f-7eab-4967-838b-898e7bda952a None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:28.628990 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201404f-7eab-4967-838b-898e7bda952a None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:28.628990 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201404f-7eab-4967-838b-898e7bda952a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:28.651258 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-b201404f-7eab-4967-838b-898e7bda952a None None] MFA Rules not processed for user `db000fc481df44009c205493eb80eae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:28.652601 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-b201404f-7eab-4967-838b-898e7bda952a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:28.674798 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1065/2147] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:29.164074 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa0788-d912-4251-a2ad-167a9e7981d8 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:29.165736 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3baa0788-d912-4251-a2ad-167a9e7981d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:29.244865 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa0788-d912-4251-a2ad-167a9e7981d8 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:29.249580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5be6b-218b-4fa7-81ee-710bff410bf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:29.250374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5be6b-218b-4fa7-81ee-710bff410bf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:29.250818 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5be6b-218b-4fa7-81ee-710bff410bf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:29.251581 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5be6b-218b-4fa7-81ee-710bff410bf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:29.254319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3dd5be6b-218b-4fa7-81ee-710bff410bf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:29.380365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5be6b-218b-4fa7-81ee-710bff410bf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:29.382481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5be6b-218b-4fa7-81ee-710bff410bf5 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:29.408643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1083/2148] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:17:38.649444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=29 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:39.390807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=67 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:39.722165 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201404f-7eab-4967-838b-898e7bda952a None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:39.723649 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-b201404f-7eab-4967-838b-898e7bda952a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:39.737770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201404f-7eab-4967-838b-898e7bda952a None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:39.742405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1dbb45-bac4-41a1-8a0f-22f7f2e03399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:39.743068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dbb45-bac4-41a1-8a0f-22f7f2e03399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:39.743376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dbb45-bac4-41a1-8a0f-22f7f2e03399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:39.743653 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dbb45-bac4-41a1-8a0f-22f7f2e03399 admin admin] PATH_INFO: `/v3/users/59541f67ed50414fa12d0a66c12cd297` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:39.744837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1dbb45-bac4-41a1-8a0f-22f7f2e03399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59541f67ed50414fa12d0a66c12cd297)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:39.747475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1dbb45-bac4-41a1-8a0f-22f7f2e03399 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:39.801964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-df1dbb45-bac4-41a1-8a0f-22f7f2e03399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59541f67ed50414fa12d0a66c12cd297'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:39.803604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-df1dbb45-bac4-41a1-8a0f-22f7f2e03399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59541f67ed50414fa12d0a66c12cd297'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:39.814770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-df1dbb45-bac4-41a1-8a0f-22f7f2e03399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59541f67ed50414fa12d0a66c12cd297'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:39.824970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-df1dbb45-bac4-41a1-8a0f-22f7f2e03399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59541f67ed50414fa12d0a66c12cd297'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:39.839832 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-df1dbb45-bac4-41a1-8a0f-22f7f2e03399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59541f67ed50414fa12d0a66c12cd297'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:39.846347 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1066/2149] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:17:39 2022] DELETE /identity/v3/users/59541f67ed50414fa12d0a66c12cd297 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:39.850770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b8cef-c17e-4e50-97d9-b70f2091d17b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:39.851355 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b8cef-c17e-4e50-97d9-b70f2091d17b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:39.852412 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b8cef-c17e-4e50-97d9-b70f2091d17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:39.878210 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ac7b8cef-c17e-4e50-97d9-b70f2091d17b None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:39.879790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ac7b8cef-c17e-4e50-97d9-b70f2091d17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:39.950351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1084/2150] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:39.961624 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1dbb45-bac4-41a1-8a0f-22f7f2e03399 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:39.963852 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-df1dbb45-bac4-41a1-8a0f-22f7f2e03399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:40.067646 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1dbb45-bac4-41a1-8a0f-22f7f2e03399 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:40.071656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522f4e7-9a70-45d5-8314-5b7b82a32a43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:40.072278 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522f4e7-9a70-45d5-8314-5b7b82a32a43 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:40.072609 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522f4e7-9a70-45d5-8314-5b7b82a32a43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:40.072888 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522f4e7-9a70-45d5-8314-5b7b82a32a43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:40.084156 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522f4e7-9a70-45d5-8314-5b7b82a32a43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:40.085687 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522f4e7-9a70-45d5-8314-5b7b82a32a43 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:40.100002 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1067/2151] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:17:40.749831 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b8cef-c17e-4e50-97d9-b70f2091d17b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:40.753738 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ac7b8cef-c17e-4e50-97d9-b70f2091d17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:40.780161 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b8cef-c17e-4e50-97d9-b70f2091d17b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:40.787555 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999d7b2-4891-4815-b032-c8193676589b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:40.788308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999d7b2-4891-4815-b032-c8193676589b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:40.788657 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999d7b2-4891-4815-b032-c8193676589b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:40.789060 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999d7b2-4891-4815-b032-c8193676589b admin admin] PATH_INFO: `/v3/projects/0e532c938b5b404aad96c11a7552dd92` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:40.790381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999d7b2-4891-4815-b032-c8193676589b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e532c938b5b404aad96c11a7552dd92)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:40.792461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999d7b2-4891-4815-b032-c8193676589b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:40.861657 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e999d7b2-4891-4815-b032-c8193676589b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e532c938b5b404aad96c11a7552dd92', 'request_id': 'req-e999d7b2-4891-4815-b032-c8193676589b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:40.871802 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e999d7b2-4891-4815-b032-c8193676589b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e532c938b5b404aad96c11a7552dd92', 'request_id': 'req-e999d7b2-4891-4815-b032-c8193676589b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:40.880291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e999d7b2-4891-4815-b032-c8193676589b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e532c938b5b404aad96c11a7552dd92', 'request_id': 'req-e999d7b2-4891-4815-b032-c8193676589b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:40.896484 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e999d7b2-4891-4815-b032-c8193676589b admin admin] The token cache is being invalidate because project 0e532c938b5b404aad96c11a7552dd92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:17:40.896779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e999d7b2-4891-4815-b032-c8193676589b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:40.897532 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e999d7b2-4891-4815-b032-c8193676589b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:40.899179 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1085/2152] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:17:40 2022] DELETE /identity/v3/projects/0e532c938b5b404aad96c11a7552dd92 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:17:40.906781 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab396f76-4000-444a-b22e-189c1d845dc3 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:40.908129 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab396f76-4000-444a-b22e-189c1d845dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:40.908899 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab396f76-4000-444a-b22e-189c1d845dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:40.946117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-ab396f76-4000-444a-b22e-189c1d845dc3 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:40.948358 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-ab396f76-4000-444a-b22e-189c1d845dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:41.030688 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1068/2153] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:41.039051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993e697-4fa1-418c-aa5e-3f1f0c82c588 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:41.039614 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993e697-4fa1-418c-aa5e-3f1f0c82c588 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:41.039895 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993e697-4fa1-418c-aa5e-3f1f0c82c588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:41.061428 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0993e697-4fa1-418c-aa5e-3f1f0c82c588 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:41.062665 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0993e697-4fa1-418c-aa5e-3f1f0c82c588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:41.072060 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1086/2154] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:41.076557 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab396f76-4000-444a-b22e-189c1d845dc3 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:41.087469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab396f76-4000-444a-b22e-189c1d845dc3 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:41.093058 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3962c-231f-47bc-b02b-58ace1bac0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:41.093684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3962c-231f-47bc-b02b-58ace1bac0de admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:41.093968 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3962c-231f-47bc-b02b-58ace1bac0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:41.094241 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3962c-231f-47bc-b02b-58ace1bac0de admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:41.095131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d3962c-231f-47bc-b02b-58ace1bac0de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:17:41.095501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d3962c-231f-47bc-b02b-58ace1bac0de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:41.097422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d3962c-231f-47bc-b02b-58ace1bac0de admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:41.113512 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1069/2155] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:17:41.117877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993e697-4fa1-418c-aa5e-3f1f0c82c588 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:41.128352 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993e697-4fa1-418c-aa5e-3f1f0c82c588 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:41.133507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32555658-96a6-4891-91cd-cfe4b84a4a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:41.134133 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32555658-96a6-4891-91cd-cfe4b84a4a8d admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:41.134410 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32555658-96a6-4891-91cd-cfe4b84a4a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:41.134680 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32555658-96a6-4891-91cd-cfe4b84a4a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:41.135413 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32555658-96a6-4891-91cd-cfe4b84a4a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:41.137507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32555658-96a6-4891-91cd-cfe4b84a4a8d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:41.173415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1087/2156] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:17:41 2022] POST /identity/v3/projects => generated 397 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:17:41.176889 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3962c-231f-47bc-b02b-58ace1bac0de admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:41.182572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:41.190146 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3962c-231f-47bc-b02b-58ace1bac0de admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:41.287753 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1e419-e257-4f14-93cd-742bf1820091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:41.288773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1e419-e257-4f14-93cd-742bf1820091 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:41.289232 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1e419-e257-4f14-93cd-742bf1820091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:41.289702 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1e419-e257-4f14-93cd-742bf1820091 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:41.290847 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1e419-e257-4f14-93cd-742bf1820091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:41.294249 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1e419-e257-4f14-93cd-742bf1820091 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:41.335306 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1070/2157] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:17:41 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:17:41.336648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32555658-96a6-4891-91cd-cfe4b84a4a8d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:41.378541 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32555658-96a6-4891-91cd-cfe4b84a4a8d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:41.400476 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623f013-99b9-4fdc-b5d0-8fde70ea3d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:41.401520 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623f013-99b9-4fdc-b5d0-8fde70ea3d0c admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:41.403239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623f013-99b9-4fdc-b5d0-8fde70ea3d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:41.403762 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623f013-99b9-4fdc-b5d0-8fde70ea3d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:41.406095 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623f013-99b9-4fdc-b5d0-8fde70ea3d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:41.409457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623f013-99b9-4fdc-b5d0-8fde70ea3d0c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:41.431373 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1088/2158] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:41.437530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1e419-e257-4f14-93cd-742bf1820091 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:41.457074 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1e419-e257-4f14-93cd-742bf1820091 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:41.464097 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23beddf-fa91-4d9a-87a5-f7ba9d3dfcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:41.467906 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23beddf-fa91-4d9a-87a5-f7ba9d3dfcbc admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:41.468133 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23beddf-fa91-4d9a-87a5-f7ba9d3dfcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:41.468355 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23beddf-fa91-4d9a-87a5-f7ba9d3dfcbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:41.469037 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23beddf-fa91-4d9a-87a5-f7ba9d3dfcbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:41.470708 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23beddf-fa91-4d9a-87a5-f7ba9d3dfcbc admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:41.488928 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1071/2159] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:41.494159 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623f013-99b9-4fdc-b5d0-8fde70ea3d0c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:41.505850 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623f013-99b9-4fdc-b5d0-8fde70ea3d0c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:41.511143 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc407f-7eb7-4f2a-bdbc-a732de0c5a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:41.511822 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc407f-7eb7-4f2a-bdbc-a732de0c5a2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:41.512259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc407f-7eb7-4f2a-bdbc-a732de0c5a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:41.512541 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc407f-7eb7-4f2a-bdbc-a732de0c5a2f admin admin] PATH_INFO: `/v3/projects/858e8dd9dd3c484897d16cabce5f0ebe/users/f6e308bcdf1b42668049f45023bb7629/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:41.530154 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc407f-7eb7-4f2a-bdbc-a732de0c5a2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=858e8dd9dd3c484897d16cabce5f0ebe, user_id=f6e308bcdf1b42668049f45023bb7629, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:41.533497 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc407f-7eb7-4f2a-bdbc-a732de0c5a2f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:41.562681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1089/2160] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:17:41 2022] PUT /identity/v3/projects/858e8dd9dd3c484897d16cabce5f0ebe/users/f6e308bcdf1b42668049f45023bb7629/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:17:41.576513 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c35ea9-2b3b-40e1-af0c-28462b8f745f None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:41.577008 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c35ea9-2b3b-40e1-af0c-28462b8f745f None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:41.577449 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c35ea9-2b3b-40e1-af0c-28462b8f745f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:41.627624 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-d2c35ea9-2b3b-40e1-af0c-28462b8f745f None None] MFA Rules not processed for user `f6e308bcdf1b42668049f45023bb7629`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:41.628930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d2c35ea9-2b3b-40e1-af0c-28462b8f745f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:41.737646 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1072/2161] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:41 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:41.757264 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc407f-7eb7-4f2a-bdbc-a732de0c5a2f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:41.759350 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9bfc407f-7eb7-4f2a-bdbc-a732de0c5a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:41.791902 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:41.851093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc407f-7eb7-4f2a-bdbc-a732de0c5a2f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:41.854964 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db912d04-e05c-47d9-bad4-182c11f5aceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:41.855626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db912d04-e05c-47d9-bad4-182c11f5aceb service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:41.855901 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db912d04-e05c-47d9-bad4-182c11f5aceb service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:41.856177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db912d04-e05c-47d9-bad4-182c11f5aceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:41.867456 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db912d04-e05c-47d9-bad4-182c11f5aceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:41.869123 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db912d04-e05c-47d9-bad4-182c11f5aceb service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:41.880759 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1090/2162] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:41 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:17:47.195024 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c35ea9-2b3b-40e1-af0c-28462b8f745f None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:47.273832 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c35ea9-2b3b-40e1-af0c-28462b8f745f None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:47.280092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e90e5-de7c-41eb-b795-9ba1d79e142c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:47.280514 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e90e5-de7c-41eb-b795-9ba1d79e142c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:47.280796 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e90e5-de7c-41eb-b795-9ba1d79e142c admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:47.281069 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e90e5-de7c-41eb-b795-9ba1d79e142c admin admin] PATH_INFO: `/v3/users/f6e308bcdf1b42668049f45023bb7629` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:47.282833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e90e5-de7c-41eb-b795-9ba1d79e142c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e308bcdf1b42668049f45023bb7629)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:47.284831 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e90e5-de7c-41eb-b795-9ba1d79e142c admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:47.301943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:47.352779 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3f2e90e5-de7c-41eb-b795-9ba1d79e142c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e308bcdf1b42668049f45023bb7629'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:47.353885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3f2e90e5-de7c-41eb-b795-9ba1d79e142c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e308bcdf1b42668049f45023bb7629'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:47.372648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3f2e90e5-de7c-41eb-b795-9ba1d79e142c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e308bcdf1b42668049f45023bb7629'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:47.386406 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3f2e90e5-de7c-41eb-b795-9ba1d79e142c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e308bcdf1b42668049f45023bb7629'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:47.402318 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3f2e90e5-de7c-41eb-b795-9ba1d79e142c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e308bcdf1b42668049f45023bb7629'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:47.413668 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1073/2163] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:17:47 2022] DELETE /identity/v3/users/f6e308bcdf1b42668049f45023bb7629 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:47.415786 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f4f6b-8fcd-492d-9b29-107e1b11d89e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:47.415786 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f4f6b-8fcd-492d-9b29-107e1b11d89e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:47.416414 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f4f6b-8fcd-492d-9b29-107e1b11d89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:47.436631 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-439f4f6b-8fcd-492d-9b29-107e1b11d89e None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:47.439723 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-439f4f6b-8fcd-492d-9b29-107e1b11d89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:47.512972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1091/2164] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:47.523567 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e90e5-de7c-41eb-b795-9ba1d79e142c admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:47.525118 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3f2e90e5-de7c-41eb-b795-9ba1d79e142c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:47.597429 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e90e5-de7c-41eb-b795-9ba1d79e142c admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:47.604321 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521de0b-b095-4bab-a3f5-8191b7e55f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:47.604940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521de0b-b095-4bab-a3f5-8191b7e55f72 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:47.605209 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521de0b-b095-4bab-a3f5-8191b7e55f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:47.605483 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521de0b-b095-4bab-a3f5-8191b7e55f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:47.622342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521de0b-b095-4bab-a3f5-8191b7e55f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:47.622829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521de0b-b095-4bab-a3f5-8191b7e55f72 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:47.636031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1074/2165] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:17:48.167783 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f4f6b-8fcd-492d-9b29-107e1b11d89e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:48.169464 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-439f4f6b-8fcd-492d-9b29-107e1b11d89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:48.185296 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f4f6b-8fcd-492d-9b29-107e1b11d89e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:48.192770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cb2a9-5a31-48a8-9942-b4f5a3178f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:48.193751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cb2a9-5a31-48a8-9942-b4f5a3178f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:48.194205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cb2a9-5a31-48a8-9942-b4f5a3178f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:48.194472 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cb2a9-5a31-48a8-9942-b4f5a3178f49 admin admin] PATH_INFO: `/v3/projects/858e8dd9dd3c484897d16cabce5f0ebe` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:48.196214 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cb2a9-5a31-48a8-9942-b4f5a3178f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=858e8dd9dd3c484897d16cabce5f0ebe)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:48.198810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cb2a9-5a31-48a8-9942-b4f5a3178f49 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:48.283672 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-123cb2a9-5a31-48a8-9942-b4f5a3178f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '858e8dd9dd3c484897d16cabce5f0ebe', 'request_id': 'req-123cb2a9-5a31-48a8-9942-b4f5a3178f49'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:48.296313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-123cb2a9-5a31-48a8-9942-b4f5a3178f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '858e8dd9dd3c484897d16cabce5f0ebe', 'request_id': 'req-123cb2a9-5a31-48a8-9942-b4f5a3178f49'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:48.305653 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-123cb2a9-5a31-48a8-9942-b4f5a3178f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '858e8dd9dd3c484897d16cabce5f0ebe', 'request_id': 'req-123cb2a9-5a31-48a8-9942-b4f5a3178f49'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:48.320183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-123cb2a9-5a31-48a8-9942-b4f5a3178f49 admin admin] The token cache is being invalidate because project 858e8dd9dd3c484897d16cabce5f0ebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:17:48.320518 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-123cb2a9-5a31-48a8-9942-b4f5a3178f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:48.321240 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-123cb2a9-5a31-48a8-9942-b4f5a3178f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:48.322965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1092/2166] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:17:48 2022] DELETE /identity/v3/projects/858e8dd9dd3c484897d16cabce5f0ebe => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:17:52.523395 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02089335-f36c-48d7-9307-d6afd619480d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:52.524038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02089335-f36c-48d7-9307-d6afd619480d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:52.524038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02089335-f36c-48d7-9307-d6afd619480d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:52.546175 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-02089335-f36c-48d7-9307-d6afd619480d None None] MFA Rules not processed for user `182eec86daa44cd48d6ef1c38f58e89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:52.547257 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-02089335-f36c-48d7-9307-d6afd619480d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:52.618698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1075/2167] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 10 13:17:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:17:52.683798 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cb2a9-5a31-48a8-9942-b4f5a3178f49 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:52.686728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-123cb2a9-5a31-48a8-9942-b4f5a3178f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:52.765515 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:52.800190 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cb2a9-5a31-48a8-9942-b4f5a3178f49 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:52.807752 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd451b-36cb-4e15-ba5a-d12f96c43487 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c86ef66c9564e0395c325a84ca9c4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:52.808265 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd451b-36cb-4e15-ba5a-d12f96c43487 service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:52.808579 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd451b-36cb-4e15-ba5a-d12f96c43487 service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:52.809010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd451b-36cb-4e15-ba5a-d12f96c43487 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:52.821848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd451b-36cb-4e15-ba5a-d12f96c43487 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:52.824042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd451b-36cb-4e15-ba5a-d12f96c43487 service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:52.835039 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1093/2168] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 10 13:17:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 13:17:54.204396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b6875-ae8f-421b-a3b7-d19973b995fc None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:54.206612 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b6875-ae8f-421b-a3b7-d19973b995fc None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:54.207162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b6875-ae8f-421b-a3b7-d19973b995fc None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:54.209264 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1076/2169] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 10 13:17:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:17:54.274036 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0086d7-f80d-4592-9953-326de7c747d6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:54.274628 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0086d7-f80d-4592-9953-326de7c747d6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:54.274733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0086d7-f80d-4592-9953-326de7c747d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:54.366564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2a0086d7-f80d-4592-9953-326de7c747d6 None None] MFA Rules not processed for user `15780b69faa745e9b99f1fffb6abe231`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:54.372502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2a0086d7-f80d-4592-9953-326de7c747d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:54.533943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1094/2170] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 10 13:17:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:54.548598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b6875-ae8f-421b-a3b7-d19973b995fc None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:54.551312 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-547b6875-ae8f-421b-a3b7-d19973b995fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:54.589309 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b6875-ae8f-421b-a3b7-d19973b995fc None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:54.624437 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904a8db-c9ca-421b-b3f9-b581d5c8abd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15780b69faa745e9b99f1fffb6abe231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:54.625939 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904a8db-c9ca-421b-b3f9-b581d5c8abd0 service placement] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:54.626203 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904a8db-c9ca-421b-b3f9-b581d5c8abd0 service placement] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:54.626691 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904a8db-c9ca-421b-b3f9-b581d5c8abd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:54.693302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904a8db-c9ca-421b-b3f9-b581d5c8abd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:54.703829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904a8db-c9ca-421b-b3f9-b581d5c8abd0 service placement] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:54.730813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1077/2171] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:17:55.671476 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0086d7-f80d-4592-9953-326de7c747d6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:55.675510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2a0086d7-f80d-4592-9953-326de7c747d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:55.801192 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0086d7-f80d-4592-9953-326de7c747d6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:55.806603 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e5ff6-adda-4ed1-aead-35ed72844039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:55.807285 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e5ff6-adda-4ed1-aead-35ed72844039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:55.807751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e5ff6-adda-4ed1-aead-35ed72844039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:55.808203 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e5ff6-adda-4ed1-aead-35ed72844039 admin admin] PATH_INFO: `/v3/users/3363adffb38d4747b21232375db2a3cb` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:55.809593 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e5ff6-adda-4ed1-aead-35ed72844039 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3363adffb38d4747b21232375db2a3cb)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:55.811623 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e5ff6-adda-4ed1-aead-35ed72844039 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:55.882846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2b6e5ff6-adda-4ed1-aead-35ed72844039 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3363adffb38d4747b21232375db2a3cb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:55.883591 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2b6e5ff6-adda-4ed1-aead-35ed72844039 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3363adffb38d4747b21232375db2a3cb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:55.896085 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2b6e5ff6-adda-4ed1-aead-35ed72844039 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3363adffb38d4747b21232375db2a3cb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:55.911459 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2b6e5ff6-adda-4ed1-aead-35ed72844039 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3363adffb38d4747b21232375db2a3cb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:55.924291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:55.932089 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2b6e5ff6-adda-4ed1-aead-35ed72844039 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3363adffb38d4747b21232375db2a3cb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:55.941062 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1095/2172] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:17:55 2022] DELETE /identity/v3/users/3363adffb38d4747b21232375db2a3cb => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:56.210313 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904a8db-c9ca-421b-b3f9-b581d5c8abd0 service placement] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:56.225872 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904a8db-c9ca-421b-b3f9-b581d5c8abd0 service placement] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:56.275963 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:56.353159 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2364c-497c-49a1-8d95-88741256cf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:56.354763 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2364c-497c-49a1-8d95-88741256cf40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:56.355078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2364c-497c-49a1-8d95-88741256cf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:56.357811 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2364c-497c-49a1-8d95-88741256cf40 admin admin] PATH_INFO: `/v3/projects/74451ede8ce748b691fbc1ef9a471914` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:56.364837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2364c-497c-49a1-8d95-88741256cf40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74451ede8ce748b691fbc1ef9a471914)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:56.368725 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2364c-497c-49a1-8d95-88741256cf40 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:56.541738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f8c2364c-497c-49a1-8d95-88741256cf40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74451ede8ce748b691fbc1ef9a471914', 'request_id': 'req-f8c2364c-497c-49a1-8d95-88741256cf40'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:56.552785 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f8c2364c-497c-49a1-8d95-88741256cf40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74451ede8ce748b691fbc1ef9a471914', 'request_id': 'req-f8c2364c-497c-49a1-8d95-88741256cf40'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:56.563916 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f8c2364c-497c-49a1-8d95-88741256cf40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74451ede8ce748b691fbc1ef9a471914', 'request_id': 'req-f8c2364c-497c-49a1-8d95-88741256cf40'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:56.599416 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f8c2364c-497c-49a1-8d95-88741256cf40 admin admin] The token cache is being invalidate because project 74451ede8ce748b691fbc1ef9a471914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:17:56.600786 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f8c2364c-497c-49a1-8d95-88741256cf40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:56.604745 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f8c2364c-497c-49a1-8d95-88741256cf40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:56.609345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1078/2173] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:17:56 2022] DELETE /identity/v3/projects/74451ede8ce748b691fbc1ef9a471914 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:56.613661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e5ff6-adda-4ed1-aead-35ed72844039 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:56.615419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2b6e5ff6-adda-4ed1-aead-35ed72844039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:56.635949 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e5ff6-adda-4ed1-aead-35ed72844039 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:56.730830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6925265-bc62-4c48-9ccf-646e8340a15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:56.732200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6925265-bc62-4c48-9ccf-646e8340a15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:56.732595 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6925265-bc62-4c48-9ccf-646e8340a15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:56.732945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6925265-bc62-4c48-9ccf-646e8340a15f admin admin] PATH_INFO: `/v3/users/9713a40cc05043bd87fc1d589dd132d9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:56.734608 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6925265-bc62-4c48-9ccf-646e8340a15f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9713a40cc05043bd87fc1d589dd132d9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:56.736872 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6925265-bc62-4c48-9ccf-646e8340a15f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:56.831087 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c6925265-bc62-4c48-9ccf-646e8340a15f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9713a40cc05043bd87fc1d589dd132d9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:56.832278 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c6925265-bc62-4c48-9ccf-646e8340a15f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9713a40cc05043bd87fc1d589dd132d9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:56.842328 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c6925265-bc62-4c48-9ccf-646e8340a15f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9713a40cc05043bd87fc1d589dd132d9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:56.854344 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c6925265-bc62-4c48-9ccf-646e8340a15f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9713a40cc05043bd87fc1d589dd132d9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:56.890373 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c6925265-bc62-4c48-9ccf-646e8340a15f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9713a40cc05043bd87fc1d589dd132d9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:56.906766 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1096/2174] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:17:56 2022] DELETE /identity/v3/users/9713a40cc05043bd87fc1d589dd132d9 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:57.144148 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2364c-497c-49a1-8d95-88741256cf40 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:57.145940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-f8c2364c-497c-49a1-8d95-88741256cf40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:57.162073 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2364c-497c-49a1-8d95-88741256cf40 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:57.241522 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed504c-8521-4f7e-9348-f5fda00e3f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:57.242724 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed504c-8521-4f7e-9348-f5fda00e3f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:57.242724 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed504c-8521-4f7e-9348-f5fda00e3f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:57.243148 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed504c-8521-4f7e-9348-f5fda00e3f21 admin admin] PATH_INFO: `/v3/projects/2366524f2db242da90ff45674afca8f9` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:57.245339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed504c-8521-4f7e-9348-f5fda00e3f21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2366524f2db242da90ff45674afca8f9)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:57.246592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed504c-8521-4f7e-9348-f5fda00e3f21 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:57.344117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-daed504c-8521-4f7e-9348-f5fda00e3f21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2366524f2db242da90ff45674afca8f9', 'request_id': 'req-daed504c-8521-4f7e-9348-f5fda00e3f21'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:57.354782 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:57.356293 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-daed504c-8521-4f7e-9348-f5fda00e3f21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2366524f2db242da90ff45674afca8f9', 'request_id': 'req-daed504c-8521-4f7e-9348-f5fda00e3f21'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:57.373142 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-daed504c-8521-4f7e-9348-f5fda00e3f21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2366524f2db242da90ff45674afca8f9', 'request_id': 'req-daed504c-8521-4f7e-9348-f5fda00e3f21'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:57.412716 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-daed504c-8521-4f7e-9348-f5fda00e3f21 admin admin] The token cache is being invalidate because project 2366524f2db242da90ff45674afca8f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:17:57.413250 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-daed504c-8521-4f7e-9348-f5fda00e3f21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:57.414558 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-daed504c-8521-4f7e-9348-f5fda00e3f21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:57.417870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1079/2175] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:17:57 2022] DELETE /identity/v3/projects/2366524f2db242da90ff45674afca8f9 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:57.424756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d7988-bfd4-4e22-9df1-8f8303140fe4 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:57.425510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d7988-bfd4-4e22-9df1-8f8303140fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:57.426241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d7988-bfd4-4e22-9df1-8f8303140fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:57.463309 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-730d7988-bfd4-4e22-9df1-8f8303140fe4 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:57.466299 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-730d7988-bfd4-4e22-9df1-8f8303140fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:57.613700 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1097/2176] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:57.615487 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cca98-ed95-46db-aaa1-4b0e86be364c None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:57.615970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cca98-ed95-46db-aaa1-4b0e86be364c None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:57.616444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cca98-ed95-46db-aaa1-4b0e86be364c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:57.640269 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-c40cca98-ed95-46db-aaa1-4b0e86be364c None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:57.642235 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c40cca98-ed95-46db-aaa1-4b0e86be364c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:57.654208 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1080/2177] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:57.655637 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d7988-bfd4-4e22-9df1-8f8303140fe4 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:57.681279 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d7988-bfd4-4e22-9df1-8f8303140fe4 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:57.700582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c95c9-acfd-47d8-8806-9bc2b34639fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:57.701329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c95c9-acfd-47d8-8806-9bc2b34639fe admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:57.701682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c95c9-acfd-47d8-8806-9bc2b34639fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:57.702030 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c95c9-acfd-47d8-8806-9bc2b34639fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:57.702780 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c95c9-acfd-47d8-8806-9bc2b34639fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:17:57.704047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c95c9-acfd-47d8-8806-9bc2b34639fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:57.712500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c95c9-acfd-47d8-8806-9bc2b34639fe admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:57.724520 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:57.751843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1098/2178] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:17:57.760876 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cca98-ed95-46db-aaa1-4b0e86be364c None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:57.775579 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cca98-ed95-46db-aaa1-4b0e86be364c None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:57.793637 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bbc7e-265a-4e90-a32b-2ccc31d0f2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:57.795166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bbc7e-265a-4e90-a32b-2ccc31d0f2de admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:57.810879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bbc7e-265a-4e90-a32b-2ccc31d0f2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:57.813075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bbc7e-265a-4e90-a32b-2ccc31d0f2de admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:57.814782 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441bbc7e-265a-4e90-a32b-2ccc31d0f2de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:57.820149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441bbc7e-265a-4e90-a32b-2ccc31d0f2de admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:57.974713 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1081/2179] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:17:57 2022] POST /identity/v3/projects => generated 383 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:17:57.983813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c95c9-acfd-47d8-8806-9bc2b34639fe admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:58.002001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c95c9-acfd-47d8-8806-9bc2b34639fe admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:58.110004 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7db8c-d908-49d2-888b-692146d9304e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:58.110832 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7db8c-d908-49d2-888b-692146d9304e admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:58.111235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7db8c-d908-49d2-888b-692146d9304e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:58.111578 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7db8c-d908-49d2-888b-692146d9304e admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:58.112424 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7db8c-d908-49d2-888b-692146d9304e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:58.118157 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7db8c-d908-49d2-888b-692146d9304e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:58.148752 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1099/2180] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:17:57 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:17:58.158919 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bbc7e-265a-4e90-a32b-2ccc31d0f2de admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:58.204808 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bbc7e-265a-4e90-a32b-2ccc31d0f2de admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:58.228298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae3545-8702-4562-a651-3c99d91238ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:58.229260 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae3545-8702-4562-a651-3c99d91238ab admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:58.229736 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae3545-8702-4562-a651-3c99d91238ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:58.230273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae3545-8702-4562-a651-3c99d91238ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:58.231438 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae3545-8702-4562-a651-3c99d91238ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:58.234883 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae3545-8702-4562-a651-3c99d91238ab admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:58.256896 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1082/2181] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:58.261113 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7db8c-d908-49d2-888b-692146d9304e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:58.310770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7db8c-d908-49d2-888b-692146d9304e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:58.330424 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745fe60-2789-41bd-ace5-10745274c813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:58.331897 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745fe60-2789-41bd-ace5-10745274c813 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:58.332530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745fe60-2789-41bd-ace5-10745274c813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:58.332898 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745fe60-2789-41bd-ace5-10745274c813 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:58.334084 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745fe60-2789-41bd-ace5-10745274c813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:58.337296 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745fe60-2789-41bd-ace5-10745274c813 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:58.385312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1100/2182] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:17:58.392246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae3545-8702-4562-a651-3c99d91238ab admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:58.414638 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae3545-8702-4562-a651-3c99d91238ab admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:58.425604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166a97f-15f2-43f0-a247-af1321f36abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:58.426766 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166a97f-15f2-43f0-a247-af1321f36abb admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:58.427159 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166a97f-15f2-43f0-a247-af1321f36abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:58.427530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166a97f-15f2-43f0-a247-af1321f36abb admin admin] PATH_INFO: `/v3/projects/5de8989e9576495da7e56152d790e70c/users/ee4568a941a64e0ab832d1ec8a8a4e48/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:58.479940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166a97f-15f2-43f0-a247-af1321f36abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de8989e9576495da7e56152d790e70c, user_id=ee4568a941a64e0ab832d1ec8a8a4e48, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:58.504464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166a97f-15f2-43f0-a247-af1321f36abb admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:58.533987 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1083/2183] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:17:58 2022] PUT /identity/v3/projects/5de8989e9576495da7e56152d790e70c/users/ee4568a941a64e0ab832d1ec8a8a4e48/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:58.554927 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fe610-0df2-425d-bc6a-78fb215e3d26 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:58.556005 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fe610-0df2-425d-bc6a-78fb215e3d26 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:58.556709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fe610-0df2-425d-bc6a-78fb215e3d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:58.622265 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-909fe610-0df2-425d-bc6a-78fb215e3d26 None None] MFA Rules not processed for user `ee4568a941a64e0ab832d1ec8a8a4e48`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:58.625320 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-909fe610-0df2-425d-bc6a-78fb215e3d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:58.731970 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1101/2184] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:58.744661 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166a97f-15f2-43f0-a247-af1321f36abb admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:58.746418 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3166a97f-15f2-43f0-a247-af1321f36abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:58.830541 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166a97f-15f2-43f0-a247-af1321f36abb admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:58.837653 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce45b3-2198-4265-9067-10b6de09fde6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:58.838289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce45b3-2198-4265-9067-10b6de09fde6 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:58.838599 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce45b3-2198-4265-9067-10b6de09fde6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:58.838928 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce45b3-2198-4265-9067-10b6de09fde6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:58.850157 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce45b3-2198-4265-9067-10b6de09fde6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:58.851686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce45b3-2198-4265-9067-10b6de09fde6 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:58.874269 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1084/2185] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:17:58.892082 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fe610-0df2-425d-bc6a-78fb215e3d26 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:59.029110 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fe610-0df2-425d-bc6a-78fb215e3d26 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:59.035435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609098ca-cdbd-443c-ab0f-ff8f74902d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:59.036253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609098ca-cdbd-443c-ab0f-ff8f74902d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:59.036894 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609098ca-cdbd-443c-ab0f-ff8f74902d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:59.037274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609098ca-cdbd-443c-ab0f-ff8f74902d8d admin admin] PATH_INFO: `/v3/users/ee4568a941a64e0ab832d1ec8a8a4e48` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:59.038965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609098ca-cdbd-443c-ab0f-ff8f74902d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee4568a941a64e0ab832d1ec8a8a4e48)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:59.041979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609098ca-cdbd-443c-ab0f-ff8f74902d8d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:59.054845 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:59.125134 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-609098ca-cdbd-443c-ab0f-ff8f74902d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee4568a941a64e0ab832d1ec8a8a4e48'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:59.126448 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-609098ca-cdbd-443c-ab0f-ff8f74902d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee4568a941a64e0ab832d1ec8a8a4e48'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:59.143840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-609098ca-cdbd-443c-ab0f-ff8f74902d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee4568a941a64e0ab832d1ec8a8a4e48'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:59.156082 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-609098ca-cdbd-443c-ab0f-ff8f74902d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee4568a941a64e0ab832d1ec8a8a4e48'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:59.186449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-609098ca-cdbd-443c-ab0f-ff8f74902d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee4568a941a64e0ab832d1ec8a8a4e48'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:17:59.197961 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1102/2186] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:17:58 2022] DELETE /identity/v3/users/ee4568a941a64e0ab832d1ec8a8a4e48 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:17:59.202521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e48307-93ee-4713-a8fd-6826d6c9b7de None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:59.202873 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e48307-93ee-4713-a8fd-6826d6c9b7de None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:59.203764 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e48307-93ee-4713-a8fd-6826d6c9b7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:59.230492 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-60e48307-93ee-4713-a8fd-6826d6c9b7de None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:17:59.231842 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-60e48307-93ee-4713-a8fd-6826d6c9b7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:59.317135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1085/2187] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:17:59.331434 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609098ca-cdbd-443c-ab0f-ff8f74902d8d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:17:59.332901 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-609098ca-cdbd-443c-ab0f-ff8f74902d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:17:59.424385 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609098ca-cdbd-443c-ab0f-ff8f74902d8d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:17:59.430371 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676e3b0-81e1-4e4c-82f5-39614ab66d4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:17:59.431366 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676e3b0-81e1-4e4c-82f5-39614ab66d4b service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:17:59.431863 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676e3b0-81e1-4e4c-82f5-39614ab66d4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:17:59.432352 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676e3b0-81e1-4e4c-82f5-39614ab66d4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:17:59.446939 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676e3b0-81e1-4e4c-82f5-39614ab66d4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:17:59.448452 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676e3b0-81e1-4e4c-82f5-39614ab66d4b service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:17:59.464367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1103/2188] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:17:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:18:00.116979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e48307-93ee-4713-a8fd-6826d6c9b7de None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:00.118555 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-60e48307-93ee-4713-a8fd-6826d6c9b7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:00.139279 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e48307-93ee-4713-a8fd-6826d6c9b7de None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:00.144513 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06191068-f2c4-4738-b6b4-9762a57409cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:00.145302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06191068-f2c4-4738-b6b4-9762a57409cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:00.145589 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06191068-f2c4-4738-b6b4-9762a57409cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:00.145868 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06191068-f2c4-4738-b6b4-9762a57409cd admin admin] PATH_INFO: `/v3/projects/5de8989e9576495da7e56152d790e70c` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:00.147159 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06191068-f2c4-4738-b6b4-9762a57409cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5de8989e9576495da7e56152d790e70c)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:00.149138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06191068-f2c4-4738-b6b4-9762a57409cd admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:00.208317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:00.312216 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-06191068-f2c4-4738-b6b4-9762a57409cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5de8989e9576495da7e56152d790e70c', 'request_id': 'req-06191068-f2c4-4738-b6b4-9762a57409cd'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:00.327788 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-06191068-f2c4-4738-b6b4-9762a57409cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5de8989e9576495da7e56152d790e70c', 'request_id': 'req-06191068-f2c4-4738-b6b4-9762a57409cd'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:00.344941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-06191068-f2c4-4738-b6b4-9762a57409cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5de8989e9576495da7e56152d790e70c', 'request_id': 'req-06191068-f2c4-4738-b6b4-9762a57409cd'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:00.360949 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-06191068-f2c4-4738-b6b4-9762a57409cd admin admin] The token cache is being invalidate because project 5de8989e9576495da7e56152d790e70c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:18:00.361346 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-06191068-f2c4-4738-b6b4-9762a57409cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:00.362126 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-06191068-f2c4-4738-b6b4-9762a57409cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:00.367415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1086/2189] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:18:00 2022] DELETE /identity/v3/projects/5de8989e9576495da7e56152d790e70c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:18:00.370193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07cb92-9397-4cc8-9cbf-bf739c540236 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:00.370766 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07cb92-9397-4cc8-9cbf-bf739c540236 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:00.371607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07cb92-9397-4cc8-9cbf-bf739c540236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:00.401653 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8a07cb92-9397-4cc8-9cbf-bf739c540236 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:00.403561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8a07cb92-9397-4cc8-9cbf-bf739c540236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:00.503686 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1104/2190] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:18:00.517822 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be417f-a928-4f71-b9e0-f87ed8bb4ad0 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:00.518143 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be417f-a928-4f71-b9e0-f87ed8bb4ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:00.518549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be417f-a928-4f71-b9e0-f87ed8bb4ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:00.584026 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-87be417f-a928-4f71-b9e0-f87ed8bb4ad0 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:00.585388 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-87be417f-a928-4f71-b9e0-f87ed8bb4ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:00.595992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1087/2191] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:18:00.599942 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07cb92-9397-4cc8-9cbf-bf739c540236 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:00.620816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07cb92-9397-4cc8-9cbf-bf739c540236 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:00.635712 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3eb84-bb31-47ff-879e-4d5a9bbfc75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:00.637360 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3eb84-bb31-47ff-879e-4d5a9bbfc75a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:00.638100 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3eb84-bb31-47ff-879e-4d5a9bbfc75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:00.638705 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3eb84-bb31-47ff-879e-4d5a9bbfc75a admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:00.640240 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3eb84-bb31-47ff-879e-4d5a9bbfc75a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:18:00.641516 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3eb84-bb31-47ff-879e-4d5a9bbfc75a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:00.645051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3eb84-bb31-47ff-879e-4d5a9bbfc75a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:00.661813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1105/2192] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:18:00.667324 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be417f-a928-4f71-b9e0-f87ed8bb4ad0 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:00.686251 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be417f-a928-4f71-b9e0-f87ed8bb4ad0 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:00.696120 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b385ac-c338-4437-b506-c0f6031bc31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:00.697028 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b385ac-c338-4437-b506-c0f6031bc31a admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:00.697185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b385ac-c338-4437-b506-c0f6031bc31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:00.697588 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b385ac-c338-4437-b506-c0f6031bc31a admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:00.698736 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b385ac-c338-4437-b506-c0f6031bc31a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:00.702475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b385ac-c338-4437-b506-c0f6031bc31a admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:00.778902 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1088/2193] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:18:00 2022] POST /identity/v3/projects => generated 361 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:18:00.782865 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3eb84-bb31-47ff-879e-4d5a9bbfc75a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:00.799952 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3eb84-bb31-47ff-879e-4d5a9bbfc75a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:00.824416 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:00.908416 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947f4b4-66e6-4877-8f2f-136ea32ffd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:00.909791 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947f4b4-66e6-4877-8f2f-136ea32ffd71 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:00.910078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947f4b4-66e6-4877-8f2f-136ea32ffd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:00.910357 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947f4b4-66e6-4877-8f2f-136ea32ffd71 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:00.912150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947f4b4-66e6-4877-8f2f-136ea32ffd71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:00.915143 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947f4b4-66e6-4877-8f2f-136ea32ffd71 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:00.965851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1106/2194] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:18:00 2022] POST /identity/v3/users => generated 281 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:18:00.972981 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b385ac-c338-4437-b506-c0f6031bc31a admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:01.006235 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b385ac-c338-4437-b506-c0f6031bc31a admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:01.013497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec50b9-46cc-4259-938a-64d4afe063c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:01.014258 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec50b9-46cc-4259-938a-64d4afe063c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:01.015294 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec50b9-46cc-4259-938a-64d4afe063c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:01.016205 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec50b9-46cc-4259-938a-64d4afe063c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:01.016966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec50b9-46cc-4259-938a-64d4afe063c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:01.019286 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec50b9-46cc-4259-938a-64d4afe063c5 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:01.034491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1089/2195] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:18:01.040398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947f4b4-66e6-4877-8f2f-136ea32ffd71 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:01.054248 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947f4b4-66e6-4877-8f2f-136ea32ffd71 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:01.084206 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c69cee-aa15-435c-9c8e-ceb3cc237b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:01.099327 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c69cee-aa15-435c-9c8e-ceb3cc237b15 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:01.099327 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c69cee-aa15-435c-9c8e-ceb3cc237b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:01.099327 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c69cee-aa15-435c-9c8e-ceb3cc237b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:01.099327 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c69cee-aa15-435c-9c8e-ceb3cc237b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:01.101513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c69cee-aa15-435c-9c8e-ceb3cc237b15 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:01.145427 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1107/2196] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:18:01.151277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec50b9-46cc-4259-938a-64d4afe063c5 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:01.169154 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec50b9-46cc-4259-938a-64d4afe063c5 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:01.223245 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3f28f-5028-4aee-a7fd-6ae722463d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:01.224776 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3f28f-5028-4aee-a7fd-6ae722463d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:01.225624 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3f28f-5028-4aee-a7fd-6ae722463d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:01.227343 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3f28f-5028-4aee-a7fd-6ae722463d84 admin admin] PATH_INFO: `/v3/projects/52dc5c47bfb6409095f532e7db019318/users/da91d934eac5454080c0de277b6b748a/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:01.351787 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3f28f-5028-4aee-a7fd-6ae722463d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52dc5c47bfb6409095f532e7db019318, user_id=da91d934eac5454080c0de277b6b748a, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:01.354716 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3f28f-5028-4aee-a7fd-6ae722463d84 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:01.402855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1090/2197] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:18:01 2022] PUT /identity/v3/projects/52dc5c47bfb6409095f532e7db019318/users/da91d934eac5454080c0de277b6b748a/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:18:01.416906 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfa802-a521-4c39-bdc1-a1879dfad091 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:01.417767 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfa802-a521-4c39-bdc1-a1879dfad091 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:01.418223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfa802-a521-4c39-bdc1-a1879dfad091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:01.616868 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-17dfa802-a521-4c39-bdc1-a1879dfad091 None None] MFA Rules not processed for user `da91d934eac5454080c0de277b6b748a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:01.623848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-17dfa802-a521-4c39-bdc1-a1879dfad091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:01.830172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1108/2198] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:18:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:18:01.885192 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3f28f-5028-4aee-a7fd-6ae722463d84 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:01.888616 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-0de3f28f-5028-4aee-a7fd-6ae722463d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:02.056730 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3f28f-5028-4aee-a7fd-6ae722463d84 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:02.065085 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f39a22-35e0-4c86-89b9-885b22c517b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:02.065781 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f39a22-35e0-4c86-89b9-885b22c517b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:02.066585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f39a22-35e0-4c86-89b9-885b22c517b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:02.066910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f39a22-35e0-4c86-89b9-885b22c517b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:02.078261 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f39a22-35e0-4c86-89b9-885b22c517b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:02.079799 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f39a22-35e0-4c86-89b9-885b22c517b4 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:02.095557 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1091/2199] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:18:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:18:02.139658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfa802-a521-4c39-bdc1-a1879dfad091 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:02.289750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfa802-a521-4c39-bdc1-a1879dfad091 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:02.294686 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466501d-eb9c-4ddf-9e08-b15382edfcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:02.295387 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466501d-eb9c-4ddf-9e08-b15382edfcee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:02.295669 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466501d-eb9c-4ddf-9e08-b15382edfcee admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:02.295944 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466501d-eb9c-4ddf-9e08-b15382edfcee admin admin] PATH_INFO: `/v3/users/da91d934eac5454080c0de277b6b748a` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:02.297197 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466501d-eb9c-4ddf-9e08-b15382edfcee admin admin] RBAC: Authorizing `identity:delete_user(user_id=da91d934eac5454080c0de277b6b748a)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:02.299303 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466501d-eb9c-4ddf-9e08-b15382edfcee admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:02.354163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:02.436265 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6466501d-eb9c-4ddf-9e08-b15382edfcee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da91d934eac5454080c0de277b6b748a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:02.438560 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6466501d-eb9c-4ddf-9e08-b15382edfcee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da91d934eac5454080c0de277b6b748a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:02.459107 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6466501d-eb9c-4ddf-9e08-b15382edfcee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da91d934eac5454080c0de277b6b748a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:02.476762 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6466501d-eb9c-4ddf-9e08-b15382edfcee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da91d934eac5454080c0de277b6b748a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:02.507697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6466501d-eb9c-4ddf-9e08-b15382edfcee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da91d934eac5454080c0de277b6b748a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:02.527170 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1109/2200] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:18:02 2022] DELETE /identity/v3/users/da91d934eac5454080c0de277b6b748a => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:18:02.534117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05f0b1-bc15-4803-bde5-15c61fd9ded7 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:02.534844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05f0b1-bc15-4803-bde5-15c61fd9ded7 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:02.535360 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05f0b1-bc15-4803-bde5-15c61fd9ded7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:02.584018 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-7d05f0b1-bc15-4803-bde5-15c61fd9ded7 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:02.596599 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7d05f0b1-bc15-4803-bde5-15c61fd9ded7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:02.719293 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:02.773864 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1092/2201] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:18:02.788375 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466501d-eb9c-4ddf-9e08-b15382edfcee admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:02.789872 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6466501d-eb9c-4ddf-9e08-b15382edfcee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:02.907237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466501d-eb9c-4ddf-9e08-b15382edfcee admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:02.914968 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f5153-dd13-4c8b-acb6-4a39fcdc821c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:02.916449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f5153-dd13-4c8b-acb6-4a39fcdc821c service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:02.917078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f5153-dd13-4c8b-acb6-4a39fcdc821c service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:02.918375 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f5153-dd13-4c8b-acb6-4a39fcdc821c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:02.940622 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f5153-dd13-4c8b-acb6-4a39fcdc821c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:02.943969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f5153-dd13-4c8b-acb6-4a39fcdc821c service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:02.962818 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1110/2202] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:18:03.911956 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05f0b1-bc15-4803-bde5-15c61fd9ded7 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:03.915411 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7d05f0b1-bc15-4803-bde5-15c61fd9ded7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:03.957013 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05f0b1-bc15-4803-bde5-15c61fd9ded7 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:03.976206 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c68a77-199a-4287-9bef-c7f69b887111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:03.977333 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c68a77-199a-4287-9bef-c7f69b887111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:03.977827 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c68a77-199a-4287-9bef-c7f69b887111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:03.978306 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c68a77-199a-4287-9bef-c7f69b887111 admin admin] PATH_INFO: `/v3/projects/52dc5c47bfb6409095f532e7db019318` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:03.984334 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c68a77-199a-4287-9bef-c7f69b887111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52dc5c47bfb6409095f532e7db019318)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:03.988701 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c68a77-199a-4287-9bef-c7f69b887111 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:04.172762 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e3c68a77-199a-4287-9bef-c7f69b887111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52dc5c47bfb6409095f532e7db019318', 'request_id': 'req-e3c68a77-199a-4287-9bef-c7f69b887111'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:04.191033 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e3c68a77-199a-4287-9bef-c7f69b887111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52dc5c47bfb6409095f532e7db019318', 'request_id': 'req-e3c68a77-199a-4287-9bef-c7f69b887111'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:04.205009 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e3c68a77-199a-4287-9bef-c7f69b887111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52dc5c47bfb6409095f532e7db019318', 'request_id': 'req-e3c68a77-199a-4287-9bef-c7f69b887111'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:04.256564 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e3c68a77-199a-4287-9bef-c7f69b887111 admin admin] The token cache is being invalidate because project 52dc5c47bfb6409095f532e7db019318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:18:04.256849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e3c68a77-199a-4287-9bef-c7f69b887111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:04.259972 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e3c68a77-199a-4287-9bef-c7f69b887111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:04.266269 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1093/2203] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:18:03 2022] DELETE /identity/v3/projects/52dc5c47bfb6409095f532e7db019318 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:18:04.268614 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e456d5-bef5-496c-93f7-b52c20930982 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:04.268614 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e456d5-bef5-496c-93f7-b52c20930982 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:04.268614 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e456d5-bef5-496c-93f7-b52c20930982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:04.303740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a2e456d5-bef5-496c-93f7-b52c20930982 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:04.305039 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a2e456d5-bef5-496c-93f7-b52c20930982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:04.445472 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8a65c-97d9-4986-9f39-4b0630474346 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:04.446036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8a65c-97d9-4986-9f39-4b0630474346 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:04.446599 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8a65c-97d9-4986-9f39-4b0630474346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:04.485916 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-a3c8a65c-97d9-4986-9f39-4b0630474346 None None] MFA Rules not processed for user `0ed48747fc084496ba252279614be4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:04.487278 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-a3c8a65c-97d9-4986-9f39-4b0630474346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:04.501148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1111/2204] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:18:04.502735 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb2d73-1cba-4a37-92a1-55260bdf125e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:04.503091 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb2d73-1cba-4a37-92a1-55260bdf125e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:04.503438 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb2d73-1cba-4a37-92a1-55260bdf125e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:04.550908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6ffb2d73-1cba-4a37-92a1-55260bdf125e None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:04.552639 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6ffb2d73-1cba-4a37-92a1-55260bdf125e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:04.576224 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1112/2205] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:18:04.580523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb2d73-1cba-4a37-92a1-55260bdf125e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:04.590082 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1094/2206] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:18:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:18:04.595791 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb2d73-1cba-4a37-92a1-55260bdf125e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:04.601771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fe855-4f5b-404c-92a2-eaa364e7260a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:04.603300 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fe855-4f5b-404c-92a2-eaa364e7260a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:04.603985 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fe855-4f5b-404c-92a2-eaa364e7260a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:04.603985 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fe855-4f5b-404c-92a2-eaa364e7260a admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:04.604561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fe855-4f5b-404c-92a2-eaa364e7260a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:18:04.604871 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fe855-4f5b-404c-92a2-eaa364e7260a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:04.609229 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fe855-4f5b-404c-92a2-eaa364e7260a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:04.646329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1113/2207] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:18:04.650808 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8a65c-97d9-4986-9f39-4b0630474346 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:04.685538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8a65c-97d9-4986-9f39-4b0630474346 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:04.694280 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21e8eb-cd4a-4ed6-b211-f62d9ad54216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:04.695129 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21e8eb-cd4a-4ed6-b211-f62d9ad54216 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:04.695529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21e8eb-cd4a-4ed6-b211-f62d9ad54216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:04.695891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21e8eb-cd4a-4ed6-b211-f62d9ad54216 admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:04.696639 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21e8eb-cd4a-4ed6-b211-f62d9ad54216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:04.699795 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21e8eb-cd4a-4ed6-b211-f62d9ad54216 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:04.816110 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1095/2208] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:18:04 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:18:04.817311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fe855-4f5b-404c-92a2-eaa364e7260a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:04.833196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fe855-4f5b-404c-92a2-eaa364e7260a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:04.934881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:05.171613 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7904d8-5742-47d8-a324-ff2d3692a533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:05.172621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7904d8-5742-47d8-a324-ff2d3692a533 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:05.174949 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7904d8-5742-47d8-a324-ff2d3692a533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:05.175441 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7904d8-5742-47d8-a324-ff2d3692a533 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:05.176900 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7904d8-5742-47d8-a324-ff2d3692a533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:05.182665 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7904d8-5742-47d8-a324-ff2d3692a533 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:05.318229 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1114/2209] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:18:04 2022] POST /identity/v3/users => generated 288 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:18:05.319039 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21e8eb-cd4a-4ed6-b211-f62d9ad54216 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:05.348909 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21e8eb-cd4a-4ed6-b211-f62d9ad54216 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:05.361107 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760ab85-c803-44dd-be0c-857bd1bbb62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:05.361876 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760ab85-c803-44dd-be0c-857bd1bbb62e admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:05.362267 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760ab85-c803-44dd-be0c-857bd1bbb62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:05.362596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760ab85-c803-44dd-be0c-857bd1bbb62e admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:05.363521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760ab85-c803-44dd-be0c-857bd1bbb62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:05.365419 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760ab85-c803-44dd-be0c-857bd1bbb62e admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:05.396221 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1096/2210] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:18:05.401303 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7904d8-5742-47d8-a324-ff2d3692a533 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:05.422460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7904d8-5742-47d8-a324-ff2d3692a533 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:05.434646 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b59aec-2a38-48cf-9e65-9a47cdb13096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:05.435399 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b59aec-2a38-48cf-9e65-9a47cdb13096 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:05.436528 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b59aec-2a38-48cf-9e65-9a47cdb13096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:05.436835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b59aec-2a38-48cf-9e65-9a47cdb13096 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:05.438220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b59aec-2a38-48cf-9e65-9a47cdb13096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:05.442956 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b59aec-2a38-48cf-9e65-9a47cdb13096 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:05.479154 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1115/2211] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:18:05.484307 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760ab85-c803-44dd-be0c-857bd1bbb62e admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:05.501248 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760ab85-c803-44dd-be0c-857bd1bbb62e admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:05.509496 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8372e-dc71-43f3-946d-3d435df9501f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:05.510367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8372e-dc71-43f3-946d-3d435df9501f admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:05.510695 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8372e-dc71-43f3-946d-3d435df9501f admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:05.511072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8372e-dc71-43f3-946d-3d435df9501f admin admin] PATH_INFO: `/v3/projects/45e5cf01d082461a94e9600c5a7f732c/users/e6b2d6ebd404417dbd478a436015bcd5/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:05.539127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8372e-dc71-43f3-946d-3d435df9501f admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e5cf01d082461a94e9600c5a7f732c, user_id=e6b2d6ebd404417dbd478a436015bcd5, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:05.543257 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8372e-dc71-43f3-946d-3d435df9501f admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:05.589930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1097/2212] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:18:05 2022] PUT /identity/v3/projects/45e5cf01d082461a94e9600c5a7f732c/users/e6b2d6ebd404417dbd478a436015bcd5/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:18:05.606502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5984634-3bed-4437-9755-557ac4a7d1be None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:05.608635 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5984634-3bed-4437-9755-557ac4a7d1be None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:05.609267 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5984634-3bed-4437-9755-557ac4a7d1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:05.664604 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c5984634-3bed-4437-9755-557ac4a7d1be None None] MFA Rules not processed for user `e6b2d6ebd404417dbd478a436015bcd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:05.665974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c5984634-3bed-4437-9755-557ac4a7d1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:05.808806 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1116/2213] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:18:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:18:05.822635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8372e-dc71-43f3-946d-3d435df9501f admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:05.825312 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-0be8372e-dc71-43f3-946d-3d435df9501f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:05.862113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:05.980511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8372e-dc71-43f3-946d-3d435df9501f admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:06.005833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fedbba-1f5a-46de-8fb7-35172c916b5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:06.007045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fedbba-1f5a-46de-8fb7-35172c916b5d service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:06.008470 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fedbba-1f5a-46de-8fb7-35172c916b5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:06.011474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fedbba-1f5a-46de-8fb7-35172c916b5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:06.046257 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fedbba-1f5a-46de-8fb7-35172c916b5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:06.057901 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fedbba-1f5a-46de-8fb7-35172c916b5d service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:06.082591 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1098/2214] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:18:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:18:13.626052 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2e6eb-b5fc-4517-a31e-c8928ef52f57 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:13.627124 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2e6eb-b5fc-4517-a31e-c8928ef52f57 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:13.627748 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2e6eb-b5fc-4517-a31e-c8928ef52f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:13.665704 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-49c2e6eb-b5fc-4517-a31e-c8928ef52f57 None None] MFA Rules not processed for user `182eec86daa44cd48d6ef1c38f58e89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:13.667370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-49c2e6eb-b5fc-4517-a31e-c8928ef52f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:13.830368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1117/2215] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 10 13:18:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:18:13.853871 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fedbba-1f5a-46de-8fb7-35172c916b5d service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:13.856666 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-98fedbba-1f5a-46de-8fb7-35172c916b5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:14.119668 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fedbba-1f5a-46de-8fb7-35172c916b5d service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:14.137168 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f24f01-44a8-4e6d-bd40-c56f752d5ea3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c86ef66c9564e0395c325a84ca9c4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:14.137751 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f24f01-44a8-4e6d-bd40-c56f752d5ea3 service swift] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:14.138032 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f24f01-44a8-4e6d-bd40-c56f752d5ea3 service swift] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:14.138306 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f24f01-44a8-4e6d-bd40-c56f752d5ea3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:14.169128 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f24f01-44a8-4e6d-bd40-c56f752d5ea3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:14.170760 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f24f01-44a8-4e6d-bd40-c56f752d5ea3 service swift] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:14.213723 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1099/2216] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 10 13:18:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 13:18:14.492974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25b6e2-7300-423d-b712-e5ba2d4e6174 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:14.493626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25b6e2-7300-423d-b712-e5ba2d4e6174 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:14.494089 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25b6e2-7300-423d-b712-e5ba2d4e6174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:14.521366 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6c25b6e2-7300-423d-b712-e5ba2d4e6174 None None] MFA Rules not processed for user `c851345eb1c8444e957b1dae85776695`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:14.522918 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6c25b6e2-7300-423d-b712-e5ba2d4e6174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:14.567296 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:14.593945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1118/2217] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:18:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:18:17.117717 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e6f4a-607a-47ad-91fc-a4d4112a464d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:17.119092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e6f4a-607a-47ad-91fc-a4d4112a464d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:17.121626 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e6f4a-607a-47ad-91fc-a4d4112a464d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:17.190792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-4d7e6f4a-607a-47ad-91fc-a4d4112a464d None None] MFA Rules not processed for user `182eec86daa44cd48d6ef1c38f58e89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:17.192177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-4d7e6f4a-607a-47ad-91fc-a4d4112a464d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:17.203492 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1100/2218] 10.222.0.46 () {58 vars in 967 bytes} [Wed Aug 10 13:18:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:18:17.250249 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25b6e2-7300-423d-b712-e5ba2d4e6174 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:17.279956 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25b6e2-7300-423d-b712-e5ba2d4e6174 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:17.293569 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fe2c5-16c7-44b6-b90a-fcc55bac1d03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c86ef66c9564e0395c325a84ca9c4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:17.296217 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fe2c5-16c7-44b6-b90a-fcc55bac1d03 service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:17.297178 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fe2c5-16c7-44b6-b90a-fcc55bac1d03 service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:17.297997 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fe2c5-16c7-44b6-b90a-fcc55bac1d03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:17.316093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fe2c5-16c7-44b6-b90a-fcc55bac1d03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:17.319916 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fe2c5-16c7-44b6-b90a-fcc55bac1d03 service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:17.340359 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1119/2219] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 10 13:18:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 13:18:19.279464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e6f4a-607a-47ad-91fc-a4d4112a464d None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:19.377518 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e6f4a-607a-47ad-91fc-a4d4112a464d None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:19.385421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd3862-c819-41de-b489-0fd1f5e8dcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:19.386308 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd3862-c819-41de-b489-0fd1f5e8dcab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:19.386749 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd3862-c819-41de-b489-0fd1f5e8dcab admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:19.387216 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd3862-c819-41de-b489-0fd1f5e8dcab admin admin] PATH_INFO: `/v3/users/e6b2d6ebd404417dbd478a436015bcd5` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:19.388737 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd3862-c819-41de-b489-0fd1f5e8dcab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6b2d6ebd404417dbd478a436015bcd5)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:19.391631 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd3862-c819-41de-b489-0fd1f5e8dcab admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:19.491804 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:19.494498 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3ffd3862-c819-41de-b489-0fd1f5e8dcab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6b2d6ebd404417dbd478a436015bcd5'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:19.497878 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3ffd3862-c819-41de-b489-0fd1f5e8dcab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6b2d6ebd404417dbd478a436015bcd5'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:19.509580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3ffd3862-c819-41de-b489-0fd1f5e8dcab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6b2d6ebd404417dbd478a436015bcd5'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:19.519838 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3ffd3862-c819-41de-b489-0fd1f5e8dcab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6b2d6ebd404417dbd478a436015bcd5'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:19.540612 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3ffd3862-c819-41de-b489-0fd1f5e8dcab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6b2d6ebd404417dbd478a436015bcd5'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:19.552546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1101/2220] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:18:19 2022] DELETE /identity/v3/users/e6b2d6ebd404417dbd478a436015bcd5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:18:19.554505 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3b555-f463-4cbf-b635-06891d1c10e9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:19.555029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3b555-f463-4cbf-b635-06891d1c10e9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:19.555136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3b555-f463-4cbf-b635-06891d1c10e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:19.595153 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-adf3b555-f463-4cbf-b635-06891d1c10e9 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:19.599416 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-adf3b555-f463-4cbf-b635-06891d1c10e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:19.722083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1120/2221] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:18:19.742629 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd3862-c819-41de-b489-0fd1f5e8dcab admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:19.744324 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3ffd3862-c819-41de-b489-0fd1f5e8dcab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:19.844074 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd3862-c819-41de-b489-0fd1f5e8dcab admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:19.853237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb193ab1-8936-4bff-8365-de8ce602e5b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:19.855221 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb193ab1-8936-4bff-8365-de8ce602e5b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:19.855836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb193ab1-8936-4bff-8365-de8ce602e5b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:19.856309 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb193ab1-8936-4bff-8365-de8ce602e5b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:19.875288 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb193ab1-8936-4bff-8365-de8ce602e5b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:19.876871 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb193ab1-8936-4bff-8365-de8ce602e5b6 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:19.899570 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1102/2222] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:18:20.589908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3b555-f463-4cbf-b635-06891d1c10e9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:20.591458 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-adf3b555-f463-4cbf-b635-06891d1c10e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:20.612183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3b555-f463-4cbf-b635-06891d1c10e9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:20.630513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74edf3-4e62-4a35-94d5-a46f6cec2bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:20.631215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74edf3-4e62-4a35-94d5-a46f6cec2bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:20.631489 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74edf3-4e62-4a35-94d5-a46f6cec2bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:20.631758 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74edf3-4e62-4a35-94d5-a46f6cec2bbb admin admin] PATH_INFO: `/v3/users/970d298682ee42a19d2d425be202450e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:20.633426 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74edf3-4e62-4a35-94d5-a46f6cec2bbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=970d298682ee42a19d2d425be202450e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:20.635486 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74edf3-4e62-4a35-94d5-a46f6cec2bbb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:20.746196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3a74edf3-4e62-4a35-94d5-a46f6cec2bbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '970d298682ee42a19d2d425be202450e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:20.748106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3a74edf3-4e62-4a35-94d5-a46f6cec2bbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '970d298682ee42a19d2d425be202450e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:20.757692 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3a74edf3-4e62-4a35-94d5-a46f6cec2bbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '970d298682ee42a19d2d425be202450e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:20.783800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3a74edf3-4e62-4a35-94d5-a46f6cec2bbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '970d298682ee42a19d2d425be202450e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:20.802784 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3a74edf3-4e62-4a35-94d5-a46f6cec2bbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '970d298682ee42a19d2d425be202450e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:20.810625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1121/2223] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:18:20 2022] DELETE /identity/v3/users/970d298682ee42a19d2d425be202450e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:18:21.094173 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb193ab1-8936-4bff-8365-de8ce602e5b6 service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:21.096834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-cb193ab1-8936-4bff-8365-de8ce602e5b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:21.136826 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb193ab1-8936-4bff-8365-de8ce602e5b6 service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:21.166660 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74edf3-4e62-4a35-94d5-a46f6cec2bbb admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:21.168200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3a74edf3-4e62-4a35-94d5-a46f6cec2bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:21.256083 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029abc10-1855-4d02-8230-cb660d8d7cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:21.256735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029abc10-1855-4d02-8230-cb660d8d7cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:21.257010 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029abc10-1855-4d02-8230-cb660d8d7cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:21.257291 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029abc10-1855-4d02-8230-cb660d8d7cb3 admin admin] PATH_INFO: `/v3/projects/45e5cf01d082461a94e9600c5a7f732c` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:21.259766 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029abc10-1855-4d02-8230-cb660d8d7cb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45e5cf01d082461a94e9600c5a7f732c)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:21.262777 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029abc10-1855-4d02-8230-cb660d8d7cb3 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:21.270212 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:21.314918 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74edf3-4e62-4a35-94d5-a46f6cec2bbb admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:21.323103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f346f53-547f-438c-9fac-5bfc022ab100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:21.323857 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f346f53-547f-438c-9fac-5bfc022ab100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:21.324027 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f346f53-547f-438c-9fac-5bfc022ab100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:21.324292 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f346f53-547f-438c-9fac-5bfc022ab100 admin admin] PATH_INFO: `/v3/projects/2799e25e35df428d98bfb3a310e660ae` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:21.329400 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f346f53-547f-438c-9fac-5bfc022ab100 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2799e25e35df428d98bfb3a310e660ae)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:21.331651 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f346f53-547f-438c-9fac-5bfc022ab100 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:21.373565 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-029abc10-1855-4d02-8230-cb660d8d7cb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45e5cf01d082461a94e9600c5a7f732c', 'request_id': 'req-029abc10-1855-4d02-8230-cb660d8d7cb3'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:21.383817 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-029abc10-1855-4d02-8230-cb660d8d7cb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45e5cf01d082461a94e9600c5a7f732c', 'request_id': 'req-029abc10-1855-4d02-8230-cb660d8d7cb3'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:21.394707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-029abc10-1855-4d02-8230-cb660d8d7cb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45e5cf01d082461a94e9600c5a7f732c', 'request_id': 'req-029abc10-1855-4d02-8230-cb660d8d7cb3'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:21.397465 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:21.412854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-029abc10-1855-4d02-8230-cb660d8d7cb3 admin admin] The token cache is being invalidate because project 45e5cf01d082461a94e9600c5a7f732c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:18:21.414418 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-029abc10-1855-4d02-8230-cb660d8d7cb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:21.415129 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-029abc10-1855-4d02-8230-cb660d8d7cb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:21.416649 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1103/2224] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:18:21 2022] DELETE /identity/v3/projects/45e5cf01d082461a94e9600c5a7f732c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:18:21.422418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7f346f53-547f-438c-9fac-5bfc022ab100 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2799e25e35df428d98bfb3a310e660ae', 'request_id': 'req-7f346f53-547f-438c-9fac-5bfc022ab100'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:21.433866 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7f346f53-547f-438c-9fac-5bfc022ab100 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2799e25e35df428d98bfb3a310e660ae', 'request_id': 'req-7f346f53-547f-438c-9fac-5bfc022ab100'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:21.442918 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7f346f53-547f-438c-9fac-5bfc022ab100 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2799e25e35df428d98bfb3a310e660ae', 'request_id': 'req-7f346f53-547f-438c-9fac-5bfc022ab100'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:21.457935 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7f346f53-547f-438c-9fac-5bfc022ab100 admin admin] The token cache is being invalidate because project 2799e25e35df428d98bfb3a310e660ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:18:21.458320 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7f346f53-547f-438c-9fac-5bfc022ab100 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:21.458933 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7f346f53-547f-438c-9fac-5bfc022ab100 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:21.465235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1122/2225] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:18:21 2022] DELETE /identity/v3/projects/2799e25e35df428d98bfb3a310e660ae => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:18:21.468984 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06223afd-afe5-4a4b-a288-3bec8a9496d3 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:21.469549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06223afd-afe5-4a4b-a288-3bec8a9496d3 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:21.470045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06223afd-afe5-4a4b-a288-3bec8a9496d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:21.498834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-06223afd-afe5-4a4b-a288-3bec8a9496d3 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:21.501400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-06223afd-afe5-4a4b-a288-3bec8a9496d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:21.591724 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1104/2226] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:18:21.599245 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290076a0-cb6c-465b-957d-65cdcfd1350b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:21.599797 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290076a0-cb6c-465b-957d-65cdcfd1350b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:21.599797 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290076a0-cb6c-465b-957d-65cdcfd1350b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:21.628805 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-290076a0-cb6c-465b-957d-65cdcfd1350b None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:21.630091 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-290076a0-cb6c-465b-957d-65cdcfd1350b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:21.642683 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1123/2227] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:18:21.643997 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06223afd-afe5-4a4b-a288-3bec8a9496d3 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:21.654277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06223afd-afe5-4a4b-a288-3bec8a9496d3 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:21.659665 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4036dcc-fc9e-4a2a-bcde-b31872ee8588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:21.660294 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4036dcc-fc9e-4a2a-bcde-b31872ee8588 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:21.660571 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4036dcc-fc9e-4a2a-bcde-b31872ee8588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:21.660843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4036dcc-fc9e-4a2a-bcde-b31872ee8588 admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:21.661499 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4036dcc-fc9e-4a2a-bcde-b31872ee8588 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:18:21.661801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4036dcc-fc9e-4a2a-bcde-b31872ee8588 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:21.663445 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4036dcc-fc9e-4a2a-bcde-b31872ee8588 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:21.679056 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1105/2228] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:18:21.683770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290076a0-cb6c-465b-957d-65cdcfd1350b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:21.695328 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290076a0-cb6c-465b-957d-65cdcfd1350b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:21.702266 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7569ea-268e-41de-af85-1e39f630d8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:21.702963 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7569ea-268e-41de-af85-1e39f630d8ab admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:21.703353 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7569ea-268e-41de-af85-1e39f630d8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:21.703679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7569ea-268e-41de-af85-1e39f630d8ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:21.704867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7569ea-268e-41de-af85-1e39f630d8ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:21.706755 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7569ea-268e-41de-af85-1e39f630d8ab admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:21.753419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1124/2229] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:18:21 2022] POST /identity/v3/projects => generated 363 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:18:21.757976 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4036dcc-fc9e-4a2a-bcde-b31872ee8588 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:21.775682 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4036dcc-fc9e-4a2a-bcde-b31872ee8588 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:21.899042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590aca01-2457-4b0a-a922-d380b7ab0d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:21.899682 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590aca01-2457-4b0a-a922-d380b7ab0d8d admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:21.899964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590aca01-2457-4b0a-a922-d380b7ab0d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:21.900234 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590aca01-2457-4b0a-a922-d380b7ab0d8d admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:21.900866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590aca01-2457-4b0a-a922-d380b7ab0d8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:21.902794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590aca01-2457-4b0a-a922-d380b7ab0d8d admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:21.959319 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1106/2230] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:18:21 2022] POST /identity/v3/users => generated 282 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:18:21.971885 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7569ea-268e-41de-af85-1e39f630d8ab admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:21.984326 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7569ea-268e-41de-af85-1e39f630d8ab admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:21.995537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509ea43-2bfa-4008-8235-e334f07ba4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:21.995537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509ea43-2bfa-4008-8235-e334f07ba4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:21.995537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509ea43-2bfa-4008-8235-e334f07ba4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:21.995537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509ea43-2bfa-4008-8235-e334f07ba4f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:21.996016 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509ea43-2bfa-4008-8235-e334f07ba4f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:21.999425 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509ea43-2bfa-4008-8235-e334f07ba4f9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:22.014511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1125/2231] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:18:22.018364 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590aca01-2457-4b0a-a922-d380b7ab0d8d admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:22.033874 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590aca01-2457-4b0a-a922-d380b7ab0d8d admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:22.038943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49445d6-1ea2-47e1-882b-64aa32443aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:22.039583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49445d6-1ea2-47e1-882b-64aa32443aae admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:22.041869 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49445d6-1ea2-47e1-882b-64aa32443aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:22.041869 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49445d6-1ea2-47e1-882b-64aa32443aae admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:22.041869 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49445d6-1ea2-47e1-882b-64aa32443aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:22.042520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49445d6-1ea2-47e1-882b-64aa32443aae admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:22.059272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509ea43-2bfa-4008-8235-e334f07ba4f9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:22.065062 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1107/2232] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:18:22.072572 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509ea43-2bfa-4008-8235-e334f07ba4f9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:22.077429 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413eec0-225e-4ed9-a0a3-3d05783e1e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:22.078143 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413eec0-225e-4ed9-a0a3-3d05783e1e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:22.078423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413eec0-225e-4ed9-a0a3-3d05783e1e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:22.078701 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413eec0-225e-4ed9-a0a3-3d05783e1e5b admin admin] PATH_INFO: `/v3/projects/47644a9cb6ac412bae21ff92576dd3b4/users/fe9b94c3768e43a08c66456c365f790f/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:22.096984 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413eec0-225e-4ed9-a0a3-3d05783e1e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=47644a9cb6ac412bae21ff92576dd3b4, user_id=fe9b94c3768e43a08c66456c365f790f, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:22.099715 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413eec0-225e-4ed9-a0a3-3d05783e1e5b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:22.119900 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1126/2233] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:18:22 2022] PUT /identity/v3/projects/47644a9cb6ac412bae21ff92576dd3b4/users/fe9b94c3768e43a08c66456c365f790f/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:18:22.130257 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad312af-2fe3-4da5-b473-4fdf48b6f06b None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:22.130815 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad312af-2fe3-4da5-b473-4fdf48b6f06b None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:22.130815 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad312af-2fe3-4da5-b473-4fdf48b6f06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:22.165815 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-6ad312af-2fe3-4da5-b473-4fdf48b6f06b None None] MFA Rules not processed for user `fe9b94c3768e43a08c66456c365f790f`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:22.167248 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-6ad312af-2fe3-4da5-b473-4fdf48b6f06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:22.230576 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:22.257696 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1108/2234] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:18:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:18:22.272805 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413eec0-225e-4ed9-a0a3-3d05783e1e5b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:22.274563 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b413eec0-225e-4ed9-a0a3-3d05783e1e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:22.387305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413eec0-225e-4ed9-a0a3-3d05783e1e5b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:22.396298 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b847a-1961-4b30-a18a-1408466458f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:22.396975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b847a-1961-4b30-a18a-1408466458f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:22.397262 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b847a-1961-4b30-a18a-1408466458f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:22.397537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b847a-1961-4b30-a18a-1408466458f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:22.409533 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b847a-1961-4b30-a18a-1408466458f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:22.415068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b847a-1961-4b30-a18a-1408466458f0 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:22.429472 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1127/2235] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:18:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:18:31.925866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85f04c-ae0f-4564-a13c-57df805d2e9b None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:31.926501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85f04c-ae0f-4564-a13c-57df805d2e9b None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:31.926851 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85f04c-ae0f-4564-a13c-57df805d2e9b None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:31.928779 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1109/2236] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 10 13:18:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:18:31.935720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbc954-f04b-428e-acf8-69def1d80aaa None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:31.936830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbc954-f04b-428e-acf8-69def1d80aaa None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:31.937117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbc954-f04b-428e-acf8-69def1d80aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:31.957756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7fbbc954-f04b-428e-acf8-69def1d80aaa None None] MFA Rules not processed for user `7fd0f76f24ea481191dfd65fff2376af`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:31.958985 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7fbbc954-f04b-428e-acf8-69def1d80aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:31.970124 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:32.053208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1128/2237] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 10 13:18:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:18:32.067197 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85f04c-ae0f-4564-a13c-57df805d2e9b None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:32.070910 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-ef85f04c-ae0f-4564-a13c-57df805d2e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:32.151299 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85f04c-ae0f-4564-a13c-57df805d2e9b None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:32.156285 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644eb510-9e4c-4636-aa48-d16fbd7919e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5979be13ad31421b886069faf0dcc915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:32.157114 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644eb510-9e4c-4636-aa48-d16fbd7919e7 service glance] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:32.157393 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644eb510-9e4c-4636-aa48-d16fbd7919e7 service glance] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:32.157755 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644eb510-9e4c-4636-aa48-d16fbd7919e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:32.171136 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644eb510-9e4c-4636-aa48-d16fbd7919e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:32.172661 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644eb510-9e4c-4636-aa48-d16fbd7919e7 service glance] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:32.185484 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1110/2238] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:18:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:18:32.272958 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571a0e9-1025-41b1-b225-dd7d95d9382e None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:32.273249 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571a0e9-1025-41b1-b225-dd7d95d9382e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:32.273586 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571a0e9-1025-41b1-b225-dd7d95d9382e None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:32.274988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1129/2239] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 10 13:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:18:32.280285 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758d3bd-8a61-4a2b-9050-c4ca87ca86dd None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:32.280643 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758d3bd-8a61-4a2b-9050-c4ca87ca86dd None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:32.281339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758d3bd-8a61-4a2b-9050-c4ca87ca86dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:32.301263 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-7758d3bd-8a61-4a2b-9050-c4ca87ca86dd None None] MFA Rules not processed for user `49b69dad00934ce78cbede99f976439f`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:32.302581 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7758d3bd-8a61-4a2b-9050-c4ca87ca86dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:32.355572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1111/2240] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 10 13:18:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:18:32.367658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571a0e9-1025-41b1-b225-dd7d95d9382e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:32.369388 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d571a0e9-1025-41b1-b225-dd7d95d9382e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:32.388003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571a0e9-1025-41b1-b225-dd7d95d9382e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:32.392624 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea55777-ac83-48a3-99fc-964a8e74cd9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:32.393338 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea55777-ac83-48a3-99fc-964a8e74cd9d service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:32.393619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea55777-ac83-48a3-99fc-964a8e74cd9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:32.393973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea55777-ac83-48a3-99fc-964a8e74cd9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:32.402243 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea55777-ac83-48a3-99fc-964a8e74cd9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:32.403815 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea55777-ac83-48a3-99fc-964a8e74cd9d service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:32.413335 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1130/2241] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:18:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:18:32.501869 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cc690-776a-465f-9a96-64e424376104 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:32.502156 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cc690-776a-465f-9a96-64e424376104 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:32.502420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cc690-776a-465f-9a96-64e424376104 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:32.503965 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1112/2242] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 10 13:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:18:32.509708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7ad84-36a6-4389-8a96-d0c7a9a5eb8f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:32.509997 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7ad84-36a6-4389-8a96-d0c7a9a5eb8f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:32.510274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7ad84-36a6-4389-8a96-d0c7a9a5eb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:32.531811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-29f7ad84-36a6-4389-8a96-d0c7a9a5eb8f None None] MFA Rules not processed for user `7fd0f76f24ea481191dfd65fff2376af`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:32.533042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-29f7ad84-36a6-4389-8a96-d0c7a9a5eb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:32.542681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1131/2243] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 10 13:18:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:18:32.554624 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cc690-776a-465f-9a96-64e424376104 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:32.556364 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-f90cc690-776a-465f-9a96-64e424376104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:32.570447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cc690-776a-465f-9a96-64e424376104 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:32.574161 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724e4bb-0536-4034-80d7-1e205ef882b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:32.574796 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724e4bb-0536-4034-80d7-1e205ef882b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:32.575122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724e4bb-0536-4034-80d7-1e205ef882b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:32.575390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724e4bb-0536-4034-80d7-1e205ef882b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:32.586780 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724e4bb-0536-4034-80d7-1e205ef882b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:32.588278 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724e4bb-0536-4034-80d7-1e205ef882b5 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:32.599162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1113/2244] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:18:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:18:35.760981 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068e792-bf6b-4259-9955-68a8acc2498c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:35.761494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068e792-bf6b-4259-9955-68a8acc2498c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:35.761807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068e792-bf6b-4259-9955-68a8acc2498c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:35.783698 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3068e792-bf6b-4259-9955-68a8acc2498c None None] MFA Rules not processed for user `182eec86daa44cd48d6ef1c38f58e89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:35.785000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3068e792-bf6b-4259-9955-68a8acc2498c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:35.849948 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1132/2245] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 10 13:18:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:18:35.863078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724e4bb-0536-4034-80d7-1e205ef882b5 service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:35.867700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d724e4bb-0536-4034-80d7-1e205ef882b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:35.939794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724e4bb-0536-4034-80d7-1e205ef882b5 service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:35.944607 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e025b8-b429-43a9-b8e0-5d9249df46ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c86ef66c9564e0395c325a84ca9c4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:35.945195 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e025b8-b429-43a9-b8e0-5d9249df46ed service swift] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:35.945493 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e025b8-b429-43a9-b8e0-5d9249df46ed service swift] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:35.945733 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e025b8-b429-43a9-b8e0-5d9249df46ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:35.954665 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e025b8-b429-43a9-b8e0-5d9249df46ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:35.961264 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e025b8-b429-43a9-b8e0-5d9249df46ed service swift] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:35.969981 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1114/2246] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 10 13:18:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 13:18:45.843295 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=59 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:45.966184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=91 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:55.432098 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047babe-ee19-447b-bb7a-b04a7c32bb7d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:55.432600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047babe-ee19-447b-bb7a-b04a7c32bb7d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:55.432795 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047babe-ee19-447b-bb7a-b04a7c32bb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:55.452872 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a047babe-ee19-447b-bb7a-b04a7c32bb7d None None] MFA Rules not processed for user `182eec86daa44cd48d6ef1c38f58e89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:55.454096 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a047babe-ee19-447b-bb7a-b04a7c32bb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:55.462445 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1133/2247] 10.222.0.46 () {58 vars in 967 bytes} [Wed Aug 10 13:18:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:18:55.492464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e025b8-b429-43a9-b8e0-5d9249df46ed service swift] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:55.506309 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e025b8-b429-43a9-b8e0-5d9249df46ed service swift] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:55.512073 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355f904-83fd-4f34-82d2-cf69727bacdd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c86ef66c9564e0395c325a84ca9c4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:55.512834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355f904-83fd-4f34-82d2-cf69727bacdd service swift] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:55.513250 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355f904-83fd-4f34-82d2-cf69727bacdd service swift] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:55.513687 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355f904-83fd-4f34-82d2-cf69727bacdd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:55.524378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355f904-83fd-4f34-82d2-cf69727bacdd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:55.526077 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355f904-83fd-4f34-82d2-cf69727bacdd service swift] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:55.535754 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1115/2248] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 10 13:18:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 13:18:56.559313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047babe-ee19-447b-bb7a-b04a7c32bb7d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:56.628555 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047babe-ee19-447b-bb7a-b04a7c32bb7d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:56.633105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45503f7-005a-45b4-8041-be1304a273aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:56.633730 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45503f7-005a-45b4-8041-be1304a273aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:56.634012 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45503f7-005a-45b4-8041-be1304a273aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:56.634287 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45503f7-005a-45b4-8041-be1304a273aa admin admin] PATH_INFO: `/v3/users/fe9b94c3768e43a08c66456c365f790f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:56.635454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45503f7-005a-45b4-8041-be1304a273aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe9b94c3768e43a08c66456c365f790f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:56.637375 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45503f7-005a-45b4-8041-be1304a273aa admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:56.684190 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f45503f7-005a-45b4-8041-be1304a273aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe9b94c3768e43a08c66456c365f790f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:56.685447 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f45503f7-005a-45b4-8041-be1304a273aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe9b94c3768e43a08c66456c365f790f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:56.692148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f45503f7-005a-45b4-8041-be1304a273aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe9b94c3768e43a08c66456c365f790f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:56.699342 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f45503f7-005a-45b4-8041-be1304a273aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe9b94c3768e43a08c66456c365f790f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:56.711651 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f45503f7-005a-45b4-8041-be1304a273aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe9b94c3768e43a08c66456c365f790f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:56.718013 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1134/2249] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:18:56 2022] DELETE /identity/v3/users/fe9b94c3768e43a08c66456c365f790f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:18:56.722382 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ece642-558f-4ead-8de5-5b9f312cac85 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:56.722855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ece642-558f-4ead-8de5-5b9f312cac85 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:56.723025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ece642-558f-4ead-8de5-5b9f312cac85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:56.744417 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-00ece642-558f-4ead-8de5-5b9f312cac85 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:56.745618 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-00ece642-558f-4ead-8de5-5b9f312cac85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:56.807201 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1116/2250] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:18:56.817723 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45503f7-005a-45b4-8041-be1304a273aa admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:56.819183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f45503f7-005a-45b4-8041-be1304a273aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:56.877969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45503f7-005a-45b4-8041-be1304a273aa admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:56.881769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cb4a0-9129-43a5-9a10-fd865aad21c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:56.882392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cb4a0-9129-43a5-9a10-fd865aad21c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:56.882646 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cb4a0-9129-43a5-9a10-fd865aad21c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:56.882912 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cb4a0-9129-43a5-9a10-fd865aad21c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:56.892449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cb4a0-9129-43a5-9a10-fd865aad21c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:56.894045 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cb4a0-9129-43a5-9a10-fd865aad21c4 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:56.903745 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1135/2251] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:18:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:18:57.170295 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ece642-558f-4ead-8de5-5b9f312cac85 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:57.171827 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-00ece642-558f-4ead-8de5-5b9f312cac85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:57.189725 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ece642-558f-4ead-8de5-5b9f312cac85 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:57.194981 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315b336-3ff6-4788-aae6-847cb4b5812e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:57.195739 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315b336-3ff6-4788-aae6-847cb4b5812e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:57.196091 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315b336-3ff6-4788-aae6-847cb4b5812e admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:57.196437 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315b336-3ff6-4788-aae6-847cb4b5812e admin admin] PATH_INFO: `/v3/projects/47644a9cb6ac412bae21ff92576dd3b4` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:57.198246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315b336-3ff6-4788-aae6-847cb4b5812e admin admin] RBAC: Authorizing `identity:delete_project(project_id=47644a9cb6ac412bae21ff92576dd3b4)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:57.201223 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315b336-3ff6-4788-aae6-847cb4b5812e admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:57.252837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e315b336-3ff6-4788-aae6-847cb4b5812e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47644a9cb6ac412bae21ff92576dd3b4', 'request_id': 'req-e315b336-3ff6-4788-aae6-847cb4b5812e'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:57.259344 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e315b336-3ff6-4788-aae6-847cb4b5812e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47644a9cb6ac412bae21ff92576dd3b4', 'request_id': 'req-e315b336-3ff6-4788-aae6-847cb4b5812e'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:57.268773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e315b336-3ff6-4788-aae6-847cb4b5812e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47644a9cb6ac412bae21ff92576dd3b4', 'request_id': 'req-e315b336-3ff6-4788-aae6-847cb4b5812e'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:57.285839 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e315b336-3ff6-4788-aae6-847cb4b5812e admin admin] The token cache is being invalidate because project 47644a9cb6ac412bae21ff92576dd3b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:18:57.286124 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e315b336-3ff6-4788-aae6-847cb4b5812e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:57.286765 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e315b336-3ff6-4788-aae6-847cb4b5812e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:18:57.288353 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1117/2252] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:18:57 2022] DELETE /identity/v3/projects/47644a9cb6ac412bae21ff92576dd3b4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:18:57.293205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819e02d-9af9-4492-8384-1a68fd41425c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:57.293488 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819e02d-9af9-4492-8384-1a68fd41425c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:57.293767 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819e02d-9af9-4492-8384-1a68fd41425c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:57.313541 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d819e02d-9af9-4492-8384-1a68fd41425c None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:57.314735 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d819e02d-9af9-4492-8384-1a68fd41425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:57.324122 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:57.376203 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1136/2253] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:18:57.387686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb50fc-7d80-40d2-bbf9-f7a3a3ecf67b None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:57.388506 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb50fc-7d80-40d2-bbf9-f7a3a3ecf67b None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:57.388759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb50fc-7d80-40d2-bbf9-f7a3a3ecf67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:57.408234 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-70eb50fc-7d80-40d2-bbf9-f7a3a3ecf67b None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:57.409431 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-70eb50fc-7d80-40d2-bbf9-f7a3a3ecf67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:57.419717 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1118/2254] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:18:57.424149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819e02d-9af9-4492-8384-1a68fd41425c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:57.434028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819e02d-9af9-4492-8384-1a68fd41425c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:57.439470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e25ed0-9414-45dd-b8b2-589367e9008d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:57.440093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e25ed0-9414-45dd-b8b2-589367e9008d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:57.440377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e25ed0-9414-45dd-b8b2-589367e9008d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:57.440683 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e25ed0-9414-45dd-b8b2-589367e9008d admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:57.441333 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e25ed0-9414-45dd-b8b2-589367e9008d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:18:57.441637 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e25ed0-9414-45dd-b8b2-589367e9008d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:57.443346 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e25ed0-9414-45dd-b8b2-589367e9008d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:57.454875 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1137/2255] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:18:57.459434 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb50fc-7d80-40d2-bbf9-f7a3a3ecf67b None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:57.468907 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb50fc-7d80-40d2-bbf9-f7a3a3ecf67b None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:57.473569 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd66db-00cc-4ab4-8457-bc7d7a6d07bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:57.474162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd66db-00cc-4ab4-8457-bc7d7a6d07bc admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:57.474440 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd66db-00cc-4ab4-8457-bc7d7a6d07bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:57.474717 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd66db-00cc-4ab4-8457-bc7d7a6d07bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:57.475368 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd66db-00cc-4ab4-8457-bc7d7a6d07bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:57.477239 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd66db-00cc-4ab4-8457-bc7d7a6d07bc admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:57.505260 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1119/2256] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:18:57 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:18:57.509426 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e25ed0-9414-45dd-b8b2-589367e9008d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:57.520234 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e25ed0-9414-45dd-b8b2-589367e9008d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:57.574826 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f3037-b04c-4f28-82d8-396feab63558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:57.575605 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f3037-b04c-4f28-82d8-396feab63558 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:57.575735 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f3037-b04c-4f28-82d8-396feab63558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:57.575999 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f3037-b04c-4f28-82d8-396feab63558 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:57.576616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f3037-b04c-4f28-82d8-396feab63558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:57.578527 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f3037-b04c-4f28-82d8-396feab63558 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:57.599183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1138/2257] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:18:57 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:18:57.603243 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd66db-00cc-4ab4-8457-bc7d7a6d07bc admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:57.614279 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd66db-00cc-4ab4-8457-bc7d7a6d07bc admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:57.619074 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56858be0-0daa-468d-a901-3d4d0965b232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:57.619704 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56858be0-0daa-468d-a901-3d4d0965b232 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:57.619988 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56858be0-0daa-468d-a901-3d4d0965b232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:57.620262 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56858be0-0daa-468d-a901-3d4d0965b232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:57.620906 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56858be0-0daa-468d-a901-3d4d0965b232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:57.623172 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56858be0-0daa-468d-a901-3d4d0965b232 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:57.633504 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1120/2258] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:18:57.637774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f3037-b04c-4f28-82d8-396feab63558 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:57.648009 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f3037-b04c-4f28-82d8-396feab63558 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:57.652741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8673543-e19c-4b1e-ae14-f3d5f262f13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:57.653338 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8673543-e19c-4b1e-ae14-f3d5f262f13e admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:57.653620 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8673543-e19c-4b1e-ae14-f3d5f262f13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:57.653894 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8673543-e19c-4b1e-ae14-f3d5f262f13e admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:57.654535 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8673543-e19c-4b1e-ae14-f3d5f262f13e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:57.656165 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8673543-e19c-4b1e-ae14-f3d5f262f13e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:57.667050 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1139/2259] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:18:57.671722 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56858be0-0daa-468d-a901-3d4d0965b232 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:57.681621 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56858be0-0daa-468d-a901-3d4d0965b232 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:57.686978 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce4c91-2675-4b5c-81fa-961e5d403722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:57.687666 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce4c91-2675-4b5c-81fa-961e5d403722 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:57.687929 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce4c91-2675-4b5c-81fa-961e5d403722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:57.688207 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce4c91-2675-4b5c-81fa-961e5d403722 admin admin] PATH_INFO: `/v3/projects/8ed7eb572211446999983d3e7bcb4ff0/users/3bc0709bc9914f9aa091c7fb6cc8d5de/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:57.703506 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce4c91-2675-4b5c-81fa-961e5d403722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ed7eb572211446999983d3e7bcb4ff0, user_id=3bc0709bc9914f9aa091c7fb6cc8d5de, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:57.706194 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce4c91-2675-4b5c-81fa-961e5d403722 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:57.723920 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1121/2260] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:18:57 2022] PUT /identity/v3/projects/8ed7eb572211446999983d3e7bcb4ff0/users/3bc0709bc9914f9aa091c7fb6cc8d5de/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:18:57.734673 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ad315-52b2-4415-9625-10f5eafd02e5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:57.734987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ad315-52b2-4415-9625-10f5eafd02e5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:57.735375 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ad315-52b2-4415-9625-10f5eafd02e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:57.768218 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a30ad315-52b2-4415-9625-10f5eafd02e5 None None] MFA Rules not processed for user `3bc0709bc9914f9aa091c7fb6cc8d5de`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:18:57.769450 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a30ad315-52b2-4415-9625-10f5eafd02e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:57.837848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1140/2261] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:18:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:18:57.849203 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce4c91-2675-4b5c-81fa-961e5d403722 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:18:57.850888 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-f8ce4c91-2675-4b5c-81fa-961e5d403722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:18:57.861789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:57.916968 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce4c91-2675-4b5c-81fa-961e5d403722 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:18:57.921804 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a97bf-b5fc-4d24-9166-77a1b6792c5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:18:57.922289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a97bf-b5fc-4d24-9166-77a1b6792c5c service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:18:57.922705 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a97bf-b5fc-4d24-9166-77a1b6792c5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:18:57.923021 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a97bf-b5fc-4d24-9166-77a1b6792c5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:18:57.931895 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a97bf-b5fc-4d24-9166-77a1b6792c5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:18:57.933414 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a97bf-b5fc-4d24-9166-77a1b6792c5c service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:18:57.942885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1122/2262] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:18:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:19:07.834759 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:19:07.938583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=23 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:19:08.097485 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ad315-52b2-4415-9625-10f5eafd02e5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:19:08.161260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ad315-52b2-4415-9625-10f5eafd02e5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:19:08.165650 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23473b20-8b64-4f09-ac9a-974f8b08916f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:19:08.166261 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23473b20-8b64-4f09-ac9a-974f8b08916f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:19:08.166535 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23473b20-8b64-4f09-ac9a-974f8b08916f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:19:08.166803 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23473b20-8b64-4f09-ac9a-974f8b08916f admin admin] PATH_INFO: `/v3/users/3bc0709bc9914f9aa091c7fb6cc8d5de` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:19:08.167955 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23473b20-8b64-4f09-ac9a-974f8b08916f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bc0709bc9914f9aa091c7fb6cc8d5de)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:19:08.169917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23473b20-8b64-4f09-ac9a-974f8b08916f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:19:08.215436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-23473b20-8b64-4f09-ac9a-974f8b08916f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bc0709bc9914f9aa091c7fb6cc8d5de'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:19:08.216715 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-23473b20-8b64-4f09-ac9a-974f8b08916f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bc0709bc9914f9aa091c7fb6cc8d5de'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:19:08.223588 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-23473b20-8b64-4f09-ac9a-974f8b08916f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bc0709bc9914f9aa091c7fb6cc8d5de'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:19:08.231108 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-23473b20-8b64-4f09-ac9a-974f8b08916f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bc0709bc9914f9aa091c7fb6cc8d5de'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:19:08.245073 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-23473b20-8b64-4f09-ac9a-974f8b08916f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bc0709bc9914f9aa091c7fb6cc8d5de'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:19:08.250928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1141/2263] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:19:08 2022] DELETE /identity/v3/users/3bc0709bc9914f9aa091c7fb6cc8d5de => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:19:08.255464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb622d-8fd2-479f-a752-c8501229a218 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:19:08.255746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb622d-8fd2-479f-a752-c8501229a218 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:19:08.256016 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb622d-8fd2-479f-a752-c8501229a218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:19:08.275051 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-7bbb622d-8fd2-479f-a752-c8501229a218 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:19:08.276230 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7bbb622d-8fd2-479f-a752-c8501229a218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:19:08.333711 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1123/2264] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:19:08.343759 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23473b20-8b64-4f09-ac9a-974f8b08916f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:19:08.345094 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-23473b20-8b64-4f09-ac9a-974f8b08916f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:19:08.400537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23473b20-8b64-4f09-ac9a-974f8b08916f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:19:08.404482 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434f04d-f677-49d7-b8e8-585a9e741285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:19:08.405076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434f04d-f677-49d7-b8e8-585a9e741285 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:19:08.405350 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434f04d-f677-49d7-b8e8-585a9e741285 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:19:08.405620 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434f04d-f677-49d7-b8e8-585a9e741285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:19:08.414452 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434f04d-f677-49d7-b8e8-585a9e741285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:19:08.415990 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434f04d-f677-49d7-b8e8-585a9e741285 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:19:08.425444 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1142/2265] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:19:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:19:08.702880 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb622d-8fd2-479f-a752-c8501229a218 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:19:08.704344 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7bbb622d-8fd2-479f-a752-c8501229a218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:19:08.716669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb622d-8fd2-479f-a752-c8501229a218 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:19:08.721438 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc5788-f75e-4e7e-87b7-15d431f9ad51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:19:08.722358 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc5788-f75e-4e7e-87b7-15d431f9ad51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:19:08.722358 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc5788-f75e-4e7e-87b7-15d431f9ad51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:19:08.722603 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc5788-f75e-4e7e-87b7-15d431f9ad51 admin admin] PATH_INFO: `/v3/projects/8ed7eb572211446999983d3e7bcb4ff0` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:19:08.723750 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc5788-f75e-4e7e-87b7-15d431f9ad51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ed7eb572211446999983d3e7bcb4ff0)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:19:08.725669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc5788-f75e-4e7e-87b7-15d431f9ad51 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:19:08.774599 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-bacc5788-f75e-4e7e-87b7-15d431f9ad51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ed7eb572211446999983d3e7bcb4ff0', 'request_id': 'req-bacc5788-f75e-4e7e-87b7-15d431f9ad51'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:19:08.780593 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-bacc5788-f75e-4e7e-87b7-15d431f9ad51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ed7eb572211446999983d3e7bcb4ff0', 'request_id': 'req-bacc5788-f75e-4e7e-87b7-15d431f9ad51'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:19:08.787815 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-bacc5788-f75e-4e7e-87b7-15d431f9ad51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ed7eb572211446999983d3e7bcb4ff0', 'request_id': 'req-bacc5788-f75e-4e7e-87b7-15d431f9ad51'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:19:08.799739 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-bacc5788-f75e-4e7e-87b7-15d431f9ad51 admin admin] The token cache is being invalidate because project 8ed7eb572211446999983d3e7bcb4ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:19:08.800057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-bacc5788-f75e-4e7e-87b7-15d431f9ad51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:19:08.800678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-bacc5788-f75e-4e7e-87b7-15d431f9ad51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:19:08.802165 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1124/2266] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:19:08 2022] DELETE /identity/v3/projects/8ed7eb572211446999983d3e7bcb4ff0 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:19:16.434465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434f04d-f677-49d7-b8e8-585a9e741285 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:19:16.435916 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8434f04d-f677-49d7-b8e8-585a9e741285 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:19:16.464920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:19:16.515562 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434f04d-f677-49d7-b8e8-585a9e741285 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:19:16.583196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db9abc-d600-4f86-b7e8-b9a6818cec69 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15780b69faa745e9b99f1fffb6abe231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:19:16.583835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db9abc-d600-4f86-b7e8-b9a6818cec69 service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:19:16.584111 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db9abc-d600-4f86-b7e8-b9a6818cec69 service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:19:16.584386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db9abc-d600-4f86-b7e8-b9a6818cec69 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:19:16.586394 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-00db9abc-d600-4f86-b7e8-b9a6818cec69 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:19:16.599734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db9abc-d600-4f86-b7e8-b9a6818cec69 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:19:16.601331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db9abc-d600-4f86-b7e8-b9a6818cec69 service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:19:16.613203 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1143/2267] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:19:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:19:18.796657 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:19:26.609024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=48 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:19:28.030530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641e93f-fa3a-4eee-99c9-9208ceddef18 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:19:28.031103 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641e93f-fa3a-4eee-99c9-9208ceddef18 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:19:28.031103 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641e93f-fa3a-4eee-99c9-9208ceddef18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:19:28.050382 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-6641e93f-fa3a-4eee-99c9-9208ceddef18 None None] MFA Rules not processed for user `0ed48747fc084496ba252279614be4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:19:28.051625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-6641e93f-fa3a-4eee-99c9-9208ceddef18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:19:28.106960 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1125/2268] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:19:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:19:38.099394 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=25 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:19:46.425042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340013c7-42df-4816-8951-b4707242cae6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:19:46.425641 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340013c7-42df-4816-8951-b4707242cae6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:19:46.425641 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340013c7-42df-4816-8951-b4707242cae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:19:46.445854 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-340013c7-42df-4816-8951-b4707242cae6 None None] MFA Rules not processed for user `c851345eb1c8444e957b1dae85776695`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:19:46.447279 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-340013c7-42df-4816-8951-b4707242cae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:19:46.508393 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1144/2269] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:19:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:19:49.069485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7de886-f160-4076-847a-5ecf33e7083e None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:19:49.070081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7de886-f160-4076-847a-5ecf33e7083e None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:19:49.070081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7de886-f160-4076-847a-5ecf33e7083e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:19:49.095724 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-5f7de886-f160-4076-847a-5ecf33e7083e None None] MFA Rules not processed for user `9c02f3fe4aa64e97b8172369816a9584`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:19:49.096976 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-5f7de886-f160-4076-847a-5ecf33e7083e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:19:49.158974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1126/2270] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:19:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:19:56.501426 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=25 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:19:59.150493 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=25 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:20:40.797856 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f13c5-7c51-428c-8a13-071b92253fc5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:20:40.798682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f13c5-7c51-428c-8a13-071b92253fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:20:40.798682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f13c5-7c51-428c-8a13-071b92253fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:20:40.820102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-1f3f13c5-7c51-428c-8a13-071b92253fc5 None None] MFA Rules not processed for user `0ed48747fc084496ba252279614be4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:20:40.822094 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1f3f13c5-7c51-428c-8a13-071b92253fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:20:40.830689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1145/2271] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:20:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:20:48.029695 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ff6a6-76e8-4e4d-ad4c-bc8e24b65730 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:20:48.030260 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ff6a6-76e8-4e4d-ad4c-bc8e24b65730 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:20:48.030260 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ff6a6-76e8-4e4d-ad4c-bc8e24b65730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:20:48.048902 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-5d7ff6a6-76e8-4e4d-ad4c-bc8e24b65730 None None] MFA Rules not processed for user `db000fc481df44009c205493eb80eae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:20:48.050074 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-5d7ff6a6-76e8-4e4d-ad4c-bc8e24b65730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:20:48.107128 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1127/2272] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:20:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:20:50.814058 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:20:56.567976 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f13c5-7c51-428c-8a13-071b92253fc5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:20:56.570197 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1f3f13c5-7c51-428c-8a13-071b92253fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:20:56.658003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f13c5-7c51-428c-8a13-071b92253fc5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:20:56.662949 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd82462-ae1a-4247-a733-cdc92bcc1ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:20:56.663658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd82462-ae1a-4247-a733-cdc92bcc1ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:20:56.663936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd82462-ae1a-4247-a733-cdc92bcc1ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:20:56.664214 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd82462-ae1a-4247-a733-cdc92bcc1ae8 admin admin] PATH_INFO: `/v3/users/c851345eb1c8444e957b1dae85776695` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:20:56.665364 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd82462-ae1a-4247-a733-cdc92bcc1ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c851345eb1c8444e957b1dae85776695)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:20:56.667342 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd82462-ae1a-4247-a733-cdc92bcc1ae8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:20:56.725393 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3bd82462-ae1a-4247-a733-cdc92bcc1ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c851345eb1c8444e957b1dae85776695'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:20:56.726235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3bd82462-ae1a-4247-a733-cdc92bcc1ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c851345eb1c8444e957b1dae85776695'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:20:56.735084 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3bd82462-ae1a-4247-a733-cdc92bcc1ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c851345eb1c8444e957b1dae85776695'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:20:56.745276 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3bd82462-ae1a-4247-a733-cdc92bcc1ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c851345eb1c8444e957b1dae85776695'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:20:56.762157 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3bd82462-ae1a-4247-a733-cdc92bcc1ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c851345eb1c8444e957b1dae85776695'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:20:56.768564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1146/2273] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:20:56 2022] DELETE /identity/v3/users/c851345eb1c8444e957b1dae85776695 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:20:56.780570 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ff6a6-76e8-4e4d-ad4c-bc8e24b65730 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:20:56.782479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-5d7ff6a6-76e8-4e4d-ad4c-bc8e24b65730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:20:56.851260 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ff6a6-76e8-4e4d-ad4c-bc8e24b65730 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:20:56.916723 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f940b81-160d-45e0-a2eb-a0e3b154ca41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:20:56.917337 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f940b81-160d-45e0-a2eb-a0e3b154ca41 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:20:56.917613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f940b81-160d-45e0-a2eb-a0e3b154ca41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:20:56.917882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f940b81-160d-45e0-a2eb-a0e3b154ca41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:20:56.919681 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3f940b81-160d-45e0-a2eb-a0e3b154ca41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:20:56.986895 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f940b81-160d-45e0-a2eb-a0e3b154ca41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:20:56.988395 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f940b81-160d-45e0-a2eb-a0e3b154ca41 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:20:56.999717 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1128/2274] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:20:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:20:57.193332 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd82462-ae1a-4247-a733-cdc92bcc1ae8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:20:57.195185 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3bd82462-ae1a-4247-a733-cdc92bcc1ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:20:57.211433 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd82462-ae1a-4247-a733-cdc92bcc1ae8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:20:57.217099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545d4a7-5b44-42c1-addd-583b6b8e97c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:20:57.217825 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545d4a7-5b44-42c1-addd-583b6b8e97c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:20:57.218172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545d4a7-5b44-42c1-addd-583b6b8e97c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:20:57.218515 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545d4a7-5b44-42c1-addd-583b6b8e97c4 admin admin] PATH_INFO: `/v3/projects/99760fe295f24443ad0b816bbf69d007` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:20:57.219778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545d4a7-5b44-42c1-addd-583b6b8e97c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99760fe295f24443ad0b816bbf69d007)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:20:57.221804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545d4a7-5b44-42c1-addd-583b6b8e97c4 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:20:57.287473 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8545d4a7-5b44-42c1-addd-583b6b8e97c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99760fe295f24443ad0b816bbf69d007', 'request_id': 'req-8545d4a7-5b44-42c1-addd-583b6b8e97c4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:20:57.297417 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8545d4a7-5b44-42c1-addd-583b6b8e97c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99760fe295f24443ad0b816bbf69d007', 'request_id': 'req-8545d4a7-5b44-42c1-addd-583b6b8e97c4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:20:57.304129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8545d4a7-5b44-42c1-addd-583b6b8e97c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99760fe295f24443ad0b816bbf69d007', 'request_id': 'req-8545d4a7-5b44-42c1-addd-583b6b8e97c4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:20:57.314500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8545d4a7-5b44-42c1-addd-583b6b8e97c4 admin admin] The token cache is being invalidate because project 99760fe295f24443ad0b816bbf69d007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:20:57.314769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8545d4a7-5b44-42c1-addd-583b6b8e97c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:20:57.315439 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8545d4a7-5b44-42c1-addd-583b6b8e97c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:20:57.316934 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1147/2275] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:20:57 2022] DELETE /identity/v3/projects/99760fe295f24443ad0b816bbf69d007 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:20:57.323098 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d9cf6-dbb1-4476-aa6d-30ad1c6e9d92 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:20:57.323388 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d9cf6-dbb1-4476-aa6d-30ad1c6e9d92 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:20:57.323664 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d9cf6-dbb1-4476-aa6d-30ad1c6e9d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:20:57.343753 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-9d4d9cf6-dbb1-4476-aa6d-30ad1c6e9d92 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:20:57.344958 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-9d4d9cf6-dbb1-4476-aa6d-30ad1c6e9d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:20:57.350419 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:20:57.427582 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1129/2276] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:20:57.435744 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecf4d6-e06a-42e8-9abb-c6bf0dd2ec89 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:20:57.436073 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecf4d6-e06a-42e8-9abb-c6bf0dd2ec89 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:20:57.436574 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecf4d6-e06a-42e8-9abb-c6bf0dd2ec89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:20:57.445404 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:20:57.482331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-60ecf4d6-e06a-42e8-9abb-c6bf0dd2ec89 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:20:57.483531 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-60ecf4d6-e06a-42e8-9abb-c6bf0dd2ec89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:20:57.483658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d9cf6-dbb1-4476-aa6d-30ad1c6e9d92 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:20:57.486188 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-9d4d9cf6-dbb1-4476-aa6d-30ad1c6e9d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:20:57.493295 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1148/2277] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:20:57.500284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecf4d6-e06a-42e8-9abb-c6bf0dd2ec89 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:20:57.519229 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecf4d6-e06a-42e8-9abb-c6bf0dd2ec89 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:20:57.527338 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e00ef-0544-4d3b-9c52-e542391a2d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:20:57.528207 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e00ef-0544-4d3b-9c52-e542391a2d57 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:20:57.528688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e00ef-0544-4d3b-9c52-e542391a2d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:20:57.529035 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e00ef-0544-4d3b-9c52-e542391a2d57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:20:57.530103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e00ef-0544-4d3b-9c52-e542391a2d57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:20:57.530609 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e00ef-0544-4d3b-9c52-e542391a2d57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:20:57.532907 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e00ef-0544-4d3b-9c52-e542391a2d57 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:20:57.559622 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1149/2278] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:20:57.560639 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e00ef-0544-4d3b-9c52-e542391a2d57 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:20:57.565077 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d9cf6-dbb1-4476-aa6d-30ad1c6e9d92 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:20:57.574365 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc112d-ca59-4b03-9889-68b0f16c1a70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:20:57.574670 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc112d-ca59-4b03-9889-68b0f16c1a70 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:20:57.574947 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc112d-ca59-4b03-9889-68b0f16c1a70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:20:57.575247 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc112d-ca59-4b03-9889-68b0f16c1a70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:20:57.577079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-20dc112d-ca59-4b03-9889-68b0f16c1a70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:20:57.578600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e00ef-0544-4d3b-9c52-e542391a2d57 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:20:57.585449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e31acc-68ba-4d3c-ac02-f0bd62b32257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:20:57.586076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e31acc-68ba-4d3c-ac02-f0bd62b32257 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:20:57.586359 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e31acc-68ba-4d3c-ac02-f0bd62b32257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:20:57.586634 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e31acc-68ba-4d3c-ac02-f0bd62b32257 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:20:57.588173 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e31acc-68ba-4d3c-ac02-f0bd62b32257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:20:57.590822 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e31acc-68ba-4d3c-ac02-f0bd62b32257 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:20:57.636134 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1150/2279] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:20:57 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:20:57.637338 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e31acc-68ba-4d3c-ac02-f0bd62b32257 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:20:57.700742 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc112d-ca59-4b03-9889-68b0f16c1a70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:20:57.702400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc112d-ca59-4b03-9889-68b0f16c1a70 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:20:57.714576 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1130/2280] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:20:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:20:57.714933 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e31acc-68ba-4d3c-ac02-f0bd62b32257 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:20:57.719858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5742f6-c859-4aec-9626-4bf6747fcc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:20:57.720467 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5742f6-c859-4aec-9626-4bf6747fcc14 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:20:57.720748 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5742f6-c859-4aec-9626-4bf6747fcc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:20:57.721017 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5742f6-c859-4aec-9626-4bf6747fcc14 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:20:57.721643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5742f6-c859-4aec-9626-4bf6747fcc14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:20:57.723646 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5742f6-c859-4aec-9626-4bf6747fcc14 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:20:57.753538 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1151/2281] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:20:57 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:20:57.757861 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc112d-ca59-4b03-9889-68b0f16c1a70 service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:20:57.770872 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc112d-ca59-4b03-9889-68b0f16c1a70 service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:20:57.776648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9346630-f4d3-47d4-b6fa-09d3230fe790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:20:57.777267 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9346630-f4d3-47d4-b6fa-09d3230fe790 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:20:57.777547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9346630-f4d3-47d4-b6fa-09d3230fe790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:20:57.777822 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9346630-f4d3-47d4-b6fa-09d3230fe790 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:20:57.778458 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9346630-f4d3-47d4-b6fa-09d3230fe790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:20:57.798707 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9346630-f4d3-47d4-b6fa-09d3230fe790 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:20:57.814469 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1131/2282] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:20:57.818654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5742f6-c859-4aec-9626-4bf6747fcc14 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:20:57.836221 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5742f6-c859-4aec-9626-4bf6747fcc14 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:20:57.842603 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda604b-32f3-4823-af13-51db9ac1a17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:20:57.844490 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda604b-32f3-4823-af13-51db9ac1a17a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:20:57.844996 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda604b-32f3-4823-af13-51db9ac1a17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:20:57.846897 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda604b-32f3-4823-af13-51db9ac1a17a admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:20:57.848650 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda604b-32f3-4823-af13-51db9ac1a17a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:20:57.852224 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda604b-32f3-4823-af13-51db9ac1a17a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:20:57.872105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1152/2283] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:20:57.877045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9346630-f4d3-47d4-b6fa-09d3230fe790 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:20:57.893130 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9346630-f4d3-47d4-b6fa-09d3230fe790 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:20:57.905459 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02370a-1905-4a7f-a1d0-423adcda357a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:20:57.906147 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02370a-1905-4a7f-a1d0-423adcda357a admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:20:57.906989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02370a-1905-4a7f-a1d0-423adcda357a admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:20:57.907300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02370a-1905-4a7f-a1d0-423adcda357a admin admin] PATH_INFO: `/v3/projects/3ecbced4e9b34485b6f35f0e349f78e2/users/20dda0d1357440aab2bb1546a342873f/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:20:57.936471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02370a-1905-4a7f-a1d0-423adcda357a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ecbced4e9b34485b6f35f0e349f78e2, user_id=20dda0d1357440aab2bb1546a342873f, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:20:57.939547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02370a-1905-4a7f-a1d0-423adcda357a admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:20:57.955695 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1132/2284] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:20:57 2022] PUT /identity/v3/projects/3ecbced4e9b34485b6f35f0e349f78e2/users/20dda0d1357440aab2bb1546a342873f/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:20:57.966355 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f8653-d6dd-4367-b40b-966f396887cf None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:20:57.966650 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f8653-d6dd-4367-b40b-966f396887cf None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:20:57.966930 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f8653-d6dd-4367-b40b-966f396887cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:20:58.014347 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9f3f8653-d6dd-4367-b40b-966f396887cf None None] MFA Rules not processed for user `20dda0d1357440aab2bb1546a342873f`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:20:58.015914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9f3f8653-d6dd-4367-b40b-966f396887cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:20:58.090619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1153/2285] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:20:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:20:58.102113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02370a-1905-4a7f-a1d0-423adcda357a admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:20:58.104622 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-1f02370a-1905-4a7f-a1d0-423adcda357a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:20:58.126710 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:20:58.187603 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02370a-1905-4a7f-a1d0-423adcda357a admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:20:58.193663 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d15cc8-eed0-42b6-a6e9-07b735f0e071 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:20:58.194286 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d15cc8-eed0-42b6-a6e9-07b735f0e071 service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:20:58.194563 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d15cc8-eed0-42b6-a6e9-07b735f0e071 service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:20:58.194837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d15cc8-eed0-42b6-a6e9-07b735f0e071 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:20:58.204377 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d15cc8-eed0-42b6-a6e9-07b735f0e071 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:20:58.206037 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d15cc8-eed0-42b6-a6e9-07b735f0e071 service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:20:58.217087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1133/2286] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:20:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:20:58.529271 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f8653-d6dd-4367-b40b-966f396887cf None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:20:58.530781 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9f3f8653-d6dd-4367-b40b-966f396887cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:20:58.573672 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:20:58.604914 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f8653-d6dd-4367-b40b-966f396887cf None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:20:58.609112 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4dace-6d8d-4d75-bcaf-f78cd95b7fd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:20:58.610403 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4dace-6d8d-4d75-bcaf-f78cd95b7fd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:20:58.610574 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4dace-6d8d-4d75-bcaf-f78cd95b7fd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:20:58.610757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4dace-6d8d-4d75-bcaf-f78cd95b7fd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:20:58.612853 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-67b4dace-6d8d-4d75-bcaf-f78cd95b7fd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:20:58.629238 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4dace-6d8d-4d75-bcaf-f78cd95b7fd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:20:58.630709 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4dace-6d8d-4d75-bcaf-f78cd95b7fd6 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:20:58.644143 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1154/2287] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:20:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:21:01.138749 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d15cc8-eed0-42b6-a6e9-07b735f0e071 service nova] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:01.229574 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d15cc8-eed0-42b6-a6e9-07b735f0e071 service nova] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:01.233562 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a10406-b6ff-4ca0-b05a-36f620f8749c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:01.234227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a10406-b6ff-4ca0-b05a-36f620f8749c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:01.234493 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a10406-b6ff-4ca0-b05a-36f620f8749c admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:01.234773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a10406-b6ff-4ca0-b05a-36f620f8749c admin admin] PATH_INFO: `/v3/users/20dda0d1357440aab2bb1546a342873f` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:01.236875 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a10406-b6ff-4ca0-b05a-36f620f8749c admin admin] RBAC: Authorizing `identity:delete_user(user_id=20dda0d1357440aab2bb1546a342873f)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:01.238325 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a10406-b6ff-4ca0-b05a-36f620f8749c admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:01.317156 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e1a10406-b6ff-4ca0-b05a-36f620f8749c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20dda0d1357440aab2bb1546a342873f'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:01.317827 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e1a10406-b6ff-4ca0-b05a-36f620f8749c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20dda0d1357440aab2bb1546a342873f'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:01.329837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e1a10406-b6ff-4ca0-b05a-36f620f8749c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20dda0d1357440aab2bb1546a342873f'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:01.343588 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e1a10406-b6ff-4ca0-b05a-36f620f8749c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20dda0d1357440aab2bb1546a342873f'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:01.364279 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e1a10406-b6ff-4ca0-b05a-36f620f8749c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20dda0d1357440aab2bb1546a342873f'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:01.376755 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1134/2288] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:21:01 2022] DELETE /identity/v3/users/20dda0d1357440aab2bb1546a342873f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:21:01.383112 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b26380-536f-47f1-9e48-4c71aa77ecba None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:01.384209 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b26380-536f-47f1-9e48-4c71aa77ecba None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:01.384209 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b26380-536f-47f1-9e48-4c71aa77ecba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:01.404502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d6b26380-536f-47f1-9e48-4c71aa77ecba None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:01.405794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d6b26380-536f-47f1-9e48-4c71aa77ecba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:01.470409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1155/2289] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:21:01.483332 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a10406-b6ff-4ca0-b05a-36f620f8749c admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:01.485147 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-e1a10406-b6ff-4ca0-b05a-36f620f8749c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:01.538980 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:01.608046 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a10406-b6ff-4ca0-b05a-36f620f8749c admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:01.615331 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87d67a-3778-4435-ba69-ee00e1c76845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:01.616933 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87d67a-3778-4435-ba69-ee00e1c76845 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:01.617651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87d67a-3778-4435-ba69-ee00e1c76845 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:01.619230 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87d67a-3778-4435-ba69-ee00e1c76845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:01.639038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87d67a-3778-4435-ba69-ee00e1c76845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:01.641624 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87d67a-3778-4435-ba69-ee00e1c76845 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:01.662873 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1135/2290] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:21:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:21:02.504942 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b26380-536f-47f1-9e48-4c71aa77ecba None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:02.506309 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d6b26380-536f-47f1-9e48-4c71aa77ecba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:02.521047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b26380-536f-47f1-9e48-4c71aa77ecba None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:02.528482 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0d52e-43bf-472e-bcb5-c438fcf3f76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:02.529321 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0d52e-43bf-472e-bcb5-c438fcf3f76b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:02.529606 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0d52e-43bf-472e-bcb5-c438fcf3f76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:02.530102 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0d52e-43bf-472e-bcb5-c438fcf3f76b admin admin] PATH_INFO: `/v3/projects/3ecbced4e9b34485b6f35f0e349f78e2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:02.531477 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0d52e-43bf-472e-bcb5-c438fcf3f76b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ecbced4e9b34485b6f35f0e349f78e2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:02.533830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0d52e-43bf-472e-bcb5-c438fcf3f76b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:02.629922 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7ad0d52e-43bf-472e-bcb5-c438fcf3f76b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ecbced4e9b34485b6f35f0e349f78e2', 'request_id': 'req-7ad0d52e-43bf-472e-bcb5-c438fcf3f76b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:02.647829 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7ad0d52e-43bf-472e-bcb5-c438fcf3f76b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ecbced4e9b34485b6f35f0e349f78e2', 'request_id': 'req-7ad0d52e-43bf-472e-bcb5-c438fcf3f76b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:02.668672 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36f285-aaa6-4da5-a522-3f639652a5f3 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:02.669186 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36f285-aaa6-4da5-a522-3f639652a5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:02.669186 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36f285-aaa6-4da5-a522-3f639652a5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:02.675152 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7ad0d52e-43bf-472e-bcb5-c438fcf3f76b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ecbced4e9b34485b6f35f0e349f78e2', 'request_id': 'req-7ad0d52e-43bf-472e-bcb5-c438fcf3f76b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:02.693692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-1a36f285-aaa6-4da5-a522-3f639652a5f3 None None] MFA Rules not processed for user `182eec86daa44cd48d6ef1c38f58e89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:02.694201 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7ad0d52e-43bf-472e-bcb5-c438fcf3f76b admin admin] The token cache is being invalidate because project 3ecbced4e9b34485b6f35f0e349f78e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:21:02.694511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7ad0d52e-43bf-472e-bcb5-c438fcf3f76b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:02.695776 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-1a36f285-aaa6-4da5-a522-3f639652a5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:02.697681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7ad0d52e-43bf-472e-bcb5-c438fcf3f76b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:02.699838 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1156/2291] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:21:02 2022] DELETE /identity/v3/projects/3ecbced4e9b34485b6f35f0e349f78e2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:21:02.704975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fd23c-2a8c-454b-8ae8-58e4009b9d41 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:02.705489 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fd23c-2a8c-454b-8ae8-58e4009b9d41 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:02.706001 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fd23c-2a8c-454b-8ae8-58e4009b9d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:02.730949 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-366fd23c-2a8c-454b-8ae8-58e4009b9d41 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:02.732699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-366fd23c-2a8c-454b-8ae8-58e4009b9d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:02.816569 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1136/2292] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 10 13:21:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:21:02.818792 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:02.843483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1157/2293] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:21:02.844813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fa5aa-ce55-4b97-94c8-54aafc2aeb6d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:02.845113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fa5aa-ce55-4b97-94c8-54aafc2aeb6d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:02.845296 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fa5aa-ce55-4b97-94c8-54aafc2aeb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:02.884242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-d10fa5aa-ce55-4b97-94c8-54aafc2aeb6d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:02.885622 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d10fa5aa-ce55-4b97-94c8-54aafc2aeb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:02.898313 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1137/2294] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:02.899234 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fd23c-2a8c-454b-8ae8-58e4009b9d41 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:02.901345 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-366fd23c-2a8c-454b-8ae8-58e4009b9d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:02.904955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fa5aa-ce55-4b97-94c8-54aafc2aeb6d None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:02.926833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fa5aa-ce55-4b97-94c8-54aafc2aeb6d None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:02.944927 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6c14c-985c-4356-a2e7-955867b78b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:02.945838 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6c14c-985c-4356-a2e7-955867b78b0b admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:02.946801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6c14c-985c-4356-a2e7-955867b78b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:02.947346 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6c14c-985c-4356-a2e7-955867b78b0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:02.947773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6c14c-985c-4356-a2e7-955867b78b0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:21:02.948075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6c14c-985c-4356-a2e7-955867b78b0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:02.951989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6c14c-985c-4356-a2e7-955867b78b0b admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:02.972564 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1138/2295] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:21:02.977298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6c14c-985c-4356-a2e7-955867b78b0b admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:03.001627 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6c14c-985c-4356-a2e7-955867b78b0b admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:03.007326 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fadc6c-6229-42be-a251-6be724598d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:03.008373 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fadc6c-6229-42be-a251-6be724598d2f admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:03.009664 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fadc6c-6229-42be-a251-6be724598d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:03.010149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fadc6c-6229-42be-a251-6be724598d2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:03.011161 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fadc6c-6229-42be-a251-6be724598d2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:03.013314 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fadc6c-6229-42be-a251-6be724598d2f admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:03.043952 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fd23c-2a8c-454b-8ae8-58e4009b9d41 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:03.049793 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ed9b1-adb6-46a0-b016-91e7bac914d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c86ef66c9564e0395c325a84ca9c4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:03.050220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ed9b1-adb6-46a0-b016-91e7bac914d5 service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:03.050988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ed9b1-adb6-46a0-b016-91e7bac914d5 service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:03.050988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ed9b1-adb6-46a0-b016-91e7bac914d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:03.063512 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1139/2296] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:21:02 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:21:03.067853 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fadc6c-6229-42be-a251-6be724598d2f admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:03.069498 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ed9b1-adb6-46a0-b016-91e7bac914d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:03.072238 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ed9b1-adb6-46a0-b016-91e7bac914d5 service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:03.083086 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1158/2297] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 10 13:21:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 13:21:03.178400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fadc6c-6229-42be-a251-6be724598d2f admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:03.187809 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c395731-d3c1-489f-9021-66e27120080e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:03.188909 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c395731-d3c1-489f-9021-66e27120080e admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:03.189236 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c395731-d3c1-489f-9021-66e27120080e admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:03.189696 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c395731-d3c1-489f-9021-66e27120080e admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:03.191147 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c395731-d3c1-489f-9021-66e27120080e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:03.194758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c395731-d3c1-489f-9021-66e27120080e admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:03.253200 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1140/2298] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:21:03 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:21:03.254798 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ed9b1-adb6-46a0-b016-91e7bac914d5 service swift] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:03.291212 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ed9b1-adb6-46a0-b016-91e7bac914d5 service swift] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:03.313119 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc5a90-b31e-44f8-a2a9-b4eac3a282d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:03.314689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc5a90-b31e-44f8-a2a9-b4eac3a282d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:03.315176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc5a90-b31e-44f8-a2a9-b4eac3a282d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:03.315629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc5a90-b31e-44f8-a2a9-b4eac3a282d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:03.316445 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc5a90-b31e-44f8-a2a9-b4eac3a282d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:03.326639 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc5a90-b31e-44f8-a2a9-b4eac3a282d4 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:03.345147 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c395731-d3c1-489f-9021-66e27120080e admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:03.353015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1159/2299] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:21:03.370044 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c395731-d3c1-489f-9021-66e27120080e admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:03.387400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7b4c3-4472-4400-803f-d606d7ab6c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:03.388311 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7b4c3-4472-4400-803f-d606d7ab6c39 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:03.388678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7b4c3-4472-4400-803f-d606d7ab6c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:03.389005 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7b4c3-4472-4400-803f-d606d7ab6c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:03.389753 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7b4c3-4472-4400-803f-d606d7ab6c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:03.399036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7b4c3-4472-4400-803f-d606d7ab6c39 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:03.440509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc5a90-b31e-44f8-a2a9-b4eac3a282d4 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:03.441635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1141/2300] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:21:03.453164 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc5a90-b31e-44f8-a2a9-b4eac3a282d4 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:03.459289 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83d798-55e0-44cd-a4d1-5abf5a325197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:03.460306 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83d798-55e0-44cd-a4d1-5abf5a325197 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:03.460870 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83d798-55e0-44cd-a4d1-5abf5a325197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:03.461184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83d798-55e0-44cd-a4d1-5abf5a325197 admin admin] PATH_INFO: `/v3/projects/b731b605a4ae4d1091e109d5450a5304/users/24d7edab1e814549878be630505a4edd/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:03.483566 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83d798-55e0-44cd-a4d1-5abf5a325197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b731b605a4ae4d1091e109d5450a5304, user_id=24d7edab1e814549878be630505a4edd, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:03.486614 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83d798-55e0-44cd-a4d1-5abf5a325197 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:03.520572 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1160/2301] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:21:03 2022] PUT /identity/v3/projects/b731b605a4ae4d1091e109d5450a5304/users/24d7edab1e814549878be630505a4edd/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:21:03.533379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44a8bf-e019-410c-8067-56c6d93567ae None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:03.533662 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44a8bf-e019-410c-8067-56c6d93567ae None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:03.533937 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44a8bf-e019-410c-8067-56c6d93567ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:03.558149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:03.585482 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-ea44a8bf-e019-410c-8067-56c6d93567ae None None] MFA Rules not processed for user `24d7edab1e814549878be630505a4edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:03.594439 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-ea44a8bf-e019-410c-8067-56c6d93567ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:03.718175 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1142/2302] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:03.722888 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83d798-55e0-44cd-a4d1-5abf5a325197 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:03.860750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83d798-55e0-44cd-a4d1-5abf5a325197 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:03.866237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3219e6f-5318-4887-98ce-116971fc36e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:03.867365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3219e6f-5318-4887-98ce-116971fc36e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:03.867893 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3219e6f-5318-4887-98ce-116971fc36e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:03.869071 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3219e6f-5318-4887-98ce-116971fc36e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:03.869945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3219e6f-5318-4887-98ce-116971fc36e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:03.872156 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3219e6f-5318-4887-98ce-116971fc36e0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:03.912207 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1161/2303] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:21:03 2022] POST /identity/v3/projects => generated 371 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:21:03.913064 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44a8bf-e019-410c-8067-56c6d93567ae None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:03.932642 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44a8bf-e019-410c-8067-56c6d93567ae None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:04.048526 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3fd84-78cf-4022-a1f8-6e60b719e9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:04.049591 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3fd84-78cf-4022-a1f8-6e60b719e9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:04.050112 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3fd84-78cf-4022-a1f8-6e60b719e9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:04.050622 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3fd84-78cf-4022-a1f8-6e60b719e9f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:04.051512 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3fd84-78cf-4022-a1f8-6e60b719e9f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:04.053715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3fd84-78cf-4022-a1f8-6e60b719e9f9 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:04.100521 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3219e6f-5318-4887-98ce-116971fc36e0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:04.100899 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1143/2304] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:21:03 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:21:04.117618 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3219e6f-5318-4887-98ce-116971fc36e0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:04.128073 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f70711-a216-4724-90a6-635849ac7f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:04.128731 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f70711-a216-4724-90a6-635849ac7f7c admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:04.129283 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f70711-a216-4724-90a6-635849ac7f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:04.129559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f70711-a216-4724-90a6-635849ac7f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:04.130230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f70711-a216-4724-90a6-635849ac7f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:04.131934 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f70711-a216-4724-90a6-635849ac7f7c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:04.147071 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1162/2305] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:21:04.152580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3fd84-78cf-4022-a1f8-6e60b719e9f9 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:04.167417 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3fd84-78cf-4022-a1f8-6e60b719e9f9 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:04.172447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e1573-da4c-4729-b195-3c236ff87b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:04.174086 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e1573-da4c-4729-b195-3c236ff87b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:04.175274 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e1573-da4c-4729-b195-3c236ff87b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:04.176090 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e1573-da4c-4729-b195-3c236ff87b5c admin admin] PATH_INFO: `/v3/projects/81e024801ca64909ad44f6fec6d19b62/users/a9bf9361b1d14ad69c53107cce1230df/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:04.199070 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e1573-da4c-4729-b195-3c236ff87b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=81e024801ca64909ad44f6fec6d19b62, user_id=a9bf9361b1d14ad69c53107cce1230df, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:04.206814 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e1573-da4c-4729-b195-3c236ff87b5c admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:04.232679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f70711-a216-4724-90a6-635849ac7f7c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:04.233095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1144/2306] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:21:04 2022] PUT /identity/v3/projects/81e024801ca64909ad44f6fec6d19b62/users/a9bf9361b1d14ad69c53107cce1230df/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:21:04.245678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f70711-a216-4724-90a6-635849ac7f7c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:04.278497 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:04.331539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace5176-8ea6-41d0-a535-6a720f991d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:04.332314 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace5176-8ea6-41d0-a535-6a720f991d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:04.332670 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace5176-8ea6-41d0-a535-6a720f991d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:04.333016 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace5176-8ea6-41d0-a535-6a720f991d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:04.333764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace5176-8ea6-41d0-a535-6a720f991d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:04.335818 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace5176-8ea6-41d0-a535-6a720f991d1a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:04.351788 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1163/2307] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:21:04.358359 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e1573-da4c-4729-b195-3c236ff87b5c admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:04.375340 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e1573-da4c-4729-b195-3c236ff87b5c admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:04.381399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33baebd0-bb0c-46ff-8581-5237659b7730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:04.382721 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33baebd0-bb0c-46ff-8581-5237659b7730 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:04.384830 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33baebd0-bb0c-46ff-8581-5237659b7730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:04.385425 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33baebd0-bb0c-46ff-8581-5237659b7730 admin admin] PATH_INFO: `/v3/projects/81e024801ca64909ad44f6fec6d19b62/users/a9bf9361b1d14ad69c53107cce1230df/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:04.390094 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33baebd0-bb0c-46ff-8581-5237659b7730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81e024801ca64909ad44f6fec6d19b62, user_id=a9bf9361b1d14ad69c53107cce1230df, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:04.392898 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33baebd0-bb0c-46ff-8581-5237659b7730 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:04.409313 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1145/2308] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:21:04 2022] PUT /identity/v3/projects/81e024801ca64909ad44f6fec6d19b62/users/a9bf9361b1d14ad69c53107cce1230df/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:21:04.419720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3328a-8166-4acf-85a7-1ddeff7ff267 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:04.420064 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3328a-8166-4acf-85a7-1ddeff7ff267 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:04.420276 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3328a-8166-4acf-85a7-1ddeff7ff267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:04.480643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-54b3328a-8166-4acf-85a7-1ddeff7ff267 None None] MFA Rules not processed for user `a9bf9361b1d14ad69c53107cce1230df`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:04.482054 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-54b3328a-8166-4acf-85a7-1ddeff7ff267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:04.591429 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1164/2309] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:04.611380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33baebd0-bb0c-46ff-8581-5237659b7730 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:04.615222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-33baebd0-bb0c-46ff-8581-5237659b7730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:04.705108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:04.717632 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33baebd0-bb0c-46ff-8581-5237659b7730 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:04.723592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb9e39-f7a7-405c-8e21-3f1f7b1ced26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:04.724593 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb9e39-f7a7-405c-8e21-3f1f7b1ced26 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:04.724967 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb9e39-f7a7-405c-8e21-3f1f7b1ced26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:04.725336 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb9e39-f7a7-405c-8e21-3f1f7b1ced26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:04.745914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb9e39-f7a7-405c-8e21-3f1f7b1ced26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:04.749998 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb9e39-f7a7-405c-8e21-3f1f7b1ced26 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:04.765446 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1146/2310] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:21:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:21:05.412913 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3328a-8166-4acf-85a7-1ddeff7ff267 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:05.559174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3328a-8166-4acf-85a7-1ddeff7ff267 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:05.570585 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091dd4c-2351-4f90-80af-f4f53032ccd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:05.571371 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091dd4c-2351-4f90-80af-f4f53032ccd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:05.571833 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091dd4c-2351-4f90-80af-f4f53032ccd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:05.572272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091dd4c-2351-4f90-80af-f4f53032ccd8 admin admin] PATH_INFO: `/v3/users/24d7edab1e814549878be630505a4edd` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:05.573536 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091dd4c-2351-4f90-80af-f4f53032ccd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24d7edab1e814549878be630505a4edd)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:05.575553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091dd4c-2351-4f90-80af-f4f53032ccd8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:05.661352 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9091dd4c-2351-4f90-80af-f4f53032ccd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24d7edab1e814549878be630505a4edd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:05.662078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9091dd4c-2351-4f90-80af-f4f53032ccd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24d7edab1e814549878be630505a4edd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:05.664175 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:05.673823 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9091dd4c-2351-4f90-80af-f4f53032ccd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24d7edab1e814549878be630505a4edd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:05.685923 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9091dd4c-2351-4f90-80af-f4f53032ccd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24d7edab1e814549878be630505a4edd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:05.711667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9091dd4c-2351-4f90-80af-f4f53032ccd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24d7edab1e814549878be630505a4edd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:05.720749 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1165/2311] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:21:05 2022] DELETE /identity/v3/users/24d7edab1e814549878be630505a4edd => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:21:05.726424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367e37a-0854-44bb-9845-eaf2176f7d88 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:05.726977 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367e37a-0854-44bb-9845-eaf2176f7d88 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:05.727610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367e37a-0854-44bb-9845-eaf2176f7d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:05.768248 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-4367e37a-0854-44bb-9845-eaf2176f7d88 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:05.771227 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-4367e37a-0854-44bb-9845-eaf2176f7d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:05.868651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1147/2312] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:21:05.881464 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091dd4c-2351-4f90-80af-f4f53032ccd8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:05.884401 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9091dd4c-2351-4f90-80af-f4f53032ccd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:05.989034 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091dd4c-2351-4f90-80af-f4f53032ccd8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:05.999554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3a7e0-1f05-4115-8187-6dfe54f19518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:06.001629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3a7e0-1f05-4115-8187-6dfe54f19518 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:06.001629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3a7e0-1f05-4115-8187-6dfe54f19518 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:06.001629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3a7e0-1f05-4115-8187-6dfe54f19518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:06.028392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3a7e0-1f05-4115-8187-6dfe54f19518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:06.030946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3a7e0-1f05-4115-8187-6dfe54f19518 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:06.059350 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1166/2313] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:21:06.554611 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367e37a-0854-44bb-9845-eaf2176f7d88 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:06.565920 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-4367e37a-0854-44bb-9845-eaf2176f7d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:06.596025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367e37a-0854-44bb-9845-eaf2176f7d88 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:06.626410 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547c216-23d4-4046-b2fd-62867acb44d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:06.631592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c216-23d4-4046-b2fd-62867acb44d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:06.633098 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c216-23d4-4046-b2fd-62867acb44d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:06.635482 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c216-23d4-4046-b2fd-62867acb44d4 admin admin] PATH_INFO: `/v3/projects/b731b605a4ae4d1091e109d5450a5304` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:06.639975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547c216-23d4-4046-b2fd-62867acb44d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b731b605a4ae4d1091e109d5450a5304)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:06.651185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547c216-23d4-4046-b2fd-62867acb44d4 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:06.768200 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d547c216-23d4-4046-b2fd-62867acb44d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b731b605a4ae4d1091e109d5450a5304', 'request_id': 'req-d547c216-23d4-4046-b2fd-62867acb44d4'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:06.781061 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d547c216-23d4-4046-b2fd-62867acb44d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b731b605a4ae4d1091e109d5450a5304', 'request_id': 'req-d547c216-23d4-4046-b2fd-62867acb44d4'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:06.801702 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d547c216-23d4-4046-b2fd-62867acb44d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b731b605a4ae4d1091e109d5450a5304', 'request_id': 'req-d547c216-23d4-4046-b2fd-62867acb44d4'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:06.824799 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d547c216-23d4-4046-b2fd-62867acb44d4 admin admin] The token cache is being invalidate because project b731b605a4ae4d1091e109d5450a5304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:21:06.825238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d547c216-23d4-4046-b2fd-62867acb44d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:06.826254 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-d547c216-23d4-4046-b2fd-62867acb44d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:06.829187 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1148/2314] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:21:06 2022] DELETE /identity/v3/projects/b731b605a4ae4d1091e109d5450a5304 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:21:06.834078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3a7e0-1f05-4115-8187-6dfe54f19518 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:06.858540 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3a7e0-1f05-4115-8187-6dfe54f19518 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:07.003537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2981ab-def1-4f21-bc82-96c7e0fb31c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:07.003973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2981ab-def1-4f21-bc82-96c7e0fb31c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:07.004310 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2981ab-def1-4f21-bc82-96c7e0fb31c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:07.004644 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2981ab-def1-4f21-bc82-96c7e0fb31c6 admin admin] PATH_INFO: `/v3/users/a9bf9361b1d14ad69c53107cce1230df` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:07.005942 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2981ab-def1-4f21-bc82-96c7e0fb31c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9bf9361b1d14ad69c53107cce1230df)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:07.008384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2981ab-def1-4f21-bc82-96c7e0fb31c6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:07.087994 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-dd2981ab-def1-4f21-bc82-96c7e0fb31c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9bf9361b1d14ad69c53107cce1230df'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:07.089206 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-dd2981ab-def1-4f21-bc82-96c7e0fb31c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9bf9361b1d14ad69c53107cce1230df'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:07.098990 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-dd2981ab-def1-4f21-bc82-96c7e0fb31c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9bf9361b1d14ad69c53107cce1230df'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:07.113517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-dd2981ab-def1-4f21-bc82-96c7e0fb31c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9bf9361b1d14ad69c53107cce1230df'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:07.121221 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:07.137723 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-dd2981ab-def1-4f21-bc82-96c7e0fb31c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9bf9361b1d14ad69c53107cce1230df'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:07.153073 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1167/2315] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:21:06 2022] DELETE /identity/v3/users/a9bf9361b1d14ad69c53107cce1230df => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:21:07.600175 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547c216-23d4-4046-b2fd-62867acb44d4 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:07.601955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d547c216-23d4-4046-b2fd-62867acb44d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:07.643552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547c216-23d4-4046-b2fd-62867acb44d4 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:07.732584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85144f7c-f7bd-4010-afb4-ba44b4b8616e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:07.733409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85144f7c-f7bd-4010-afb4-ba44b4b8616e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:07.733693 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85144f7c-f7bd-4010-afb4-ba44b4b8616e admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:07.733969 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85144f7c-f7bd-4010-afb4-ba44b4b8616e admin admin] PATH_INFO: `/v3/projects/81e024801ca64909ad44f6fec6d19b62` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:07.735357 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85144f7c-f7bd-4010-afb4-ba44b4b8616e admin admin] RBAC: Authorizing `identity:delete_project(project_id=81e024801ca64909ad44f6fec6d19b62)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:07.737570 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85144f7c-f7bd-4010-afb4-ba44b4b8616e admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:07.760874 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:07.819819 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-85144f7c-f7bd-4010-afb4-ba44b4b8616e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81e024801ca64909ad44f6fec6d19b62', 'request_id': 'req-85144f7c-f7bd-4010-afb4-ba44b4b8616e'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:07.836131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-85144f7c-f7bd-4010-afb4-ba44b4b8616e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81e024801ca64909ad44f6fec6d19b62', 'request_id': 'req-85144f7c-f7bd-4010-afb4-ba44b4b8616e'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:07.857977 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-85144f7c-f7bd-4010-afb4-ba44b4b8616e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81e024801ca64909ad44f6fec6d19b62', 'request_id': 'req-85144f7c-f7bd-4010-afb4-ba44b4b8616e'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:07.878280 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-85144f7c-f7bd-4010-afb4-ba44b4b8616e admin admin] The token cache is being invalidate because project 81e024801ca64909ad44f6fec6d19b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:21:07.878585 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-85144f7c-f7bd-4010-afb4-ba44b4b8616e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:07.879543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-85144f7c-f7bd-4010-afb4-ba44b4b8616e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:07.881903 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1149/2316] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:21:07 2022] DELETE /identity/v3/projects/81e024801ca64909ad44f6fec6d19b62 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:21:07.888082 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e9333-2a0e-4fdf-9d5b-bf5c14eb96fe None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:07.888873 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e9333-2a0e-4fdf-9d5b-bf5c14eb96fe None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:07.888873 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e9333-2a0e-4fdf-9d5b-bf5c14eb96fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:07.914538 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-887e9333-2a0e-4fdf-9d5b-bf5c14eb96fe None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:07.916603 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-887e9333-2a0e-4fdf-9d5b-bf5c14eb96fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:08.043498 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1168/2317] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:08.052860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1453932-774a-41f9-abc8-7d294afce67d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:08.053263 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1453932-774a-41f9-abc8-7d294afce67d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:08.053712 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1453932-774a-41f9-abc8-7d294afce67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:08.101480 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-c1453932-774a-41f9-abc8-7d294afce67d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:08.103833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c1453932-774a-41f9-abc8-7d294afce67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:08.131057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1150/2318] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:08.136827 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e9333-2a0e-4fdf-9d5b-bf5c14eb96fe None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:08.171170 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e9333-2a0e-4fdf-9d5b-bf5c14eb96fe None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:08.192878 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a91210-d2d1-4ca9-91e7-bbaeaf8fa4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:08.193805 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a91210-d2d1-4ca9-91e7-bbaeaf8fa4ef admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:08.194226 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a91210-d2d1-4ca9-91e7-bbaeaf8fa4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:08.194938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a91210-d2d1-4ca9-91e7-bbaeaf8fa4ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:08.197443 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a91210-d2d1-4ca9-91e7-bbaeaf8fa4ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:21:08.197443 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a91210-d2d1-4ca9-91e7-bbaeaf8fa4ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:08.212480 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a91210-d2d1-4ca9-91e7-bbaeaf8fa4ef admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:08.260195 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1453932-774a-41f9-abc8-7d294afce67d None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:08.269215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1169/2319] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:21:08.282432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1453932-774a-41f9-abc8-7d294afce67d None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:08.289434 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ae52c-31f8-4fea-ba2b-733b9ed05105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:08.290079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ae52c-31f8-4fea-ba2b-733b9ed05105 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:08.290355 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ae52c-31f8-4fea-ba2b-733b9ed05105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:08.290624 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ae52c-31f8-4fea-ba2b-733b9ed05105 admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:08.291318 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ae52c-31f8-4fea-ba2b-733b9ed05105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:08.293468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ae52c-31f8-4fea-ba2b-733b9ed05105 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:08.339706 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1151/2320] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:21:08 2022] POST /identity/v3/projects => generated 363 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:21:08.342537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a91210-d2d1-4ca9-91e7-bbaeaf8fa4ef admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:08.360872 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a91210-d2d1-4ca9-91e7-bbaeaf8fa4ef admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:08.486509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67199f9c-b499-4fa5-a288-a275c71fd856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:08.487070 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67199f9c-b499-4fa5-a288-a275c71fd856 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:08.487355 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67199f9c-b499-4fa5-a288-a275c71fd856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:08.487611 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67199f9c-b499-4fa5-a288-a275c71fd856 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:08.488263 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67199f9c-b499-4fa5-a288-a275c71fd856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:08.490390 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67199f9c-b499-4fa5-a288-a275c71fd856 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:08.526063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1170/2321] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:21:08 2022] POST /identity/v3/users => generated 282 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:21:08.530257 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ae52c-31f8-4fea-ba2b-733b9ed05105 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:08.548758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ae52c-31f8-4fea-ba2b-733b9ed05105 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:08.557787 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322b26e-b783-45bb-b7b7-ea8d8cf45628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:08.558822 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322b26e-b783-45bb-b7b7-ea8d8cf45628 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:08.562459 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322b26e-b783-45bb-b7b7-ea8d8cf45628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:08.562459 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322b26e-b783-45bb-b7b7-ea8d8cf45628 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:08.562459 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322b26e-b783-45bb-b7b7-ea8d8cf45628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:08.564255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322b26e-b783-45bb-b7b7-ea8d8cf45628 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:08.584551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1152/2322] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:21:08.590341 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67199f9c-b499-4fa5-a288-a275c71fd856 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:08.607896 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67199f9c-b499-4fa5-a288-a275c71fd856 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:08.613644 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab72c2-3f95-4bea-aa83-b3f6a52ba8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:08.614271 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab72c2-3f95-4bea-aa83-b3f6a52ba8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:08.614545 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab72c2-3f95-4bea-aa83-b3f6a52ba8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:08.614812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab72c2-3f95-4bea-aa83-b3f6a52ba8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:08.615504 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab72c2-3f95-4bea-aa83-b3f6a52ba8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:08.617167 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab72c2-3f95-4bea-aa83-b3f6a52ba8a7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:08.635368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1171/2323] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:21:08.639984 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322b26e-b783-45bb-b7b7-ea8d8cf45628 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:08.651019 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322b26e-b783-45bb-b7b7-ea8d8cf45628 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:08.660337 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290f306-5aaa-41d5-94c3-b5eeb55caaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:08.661044 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290f306-5aaa-41d5-94c3-b5eeb55caaf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:08.661325 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290f306-5aaa-41d5-94c3-b5eeb55caaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:08.661714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290f306-5aaa-41d5-94c3-b5eeb55caaf1 admin admin] PATH_INFO: `/v3/projects/bb91517c80ef4d08a4c6afb4f0437f98/users/5d62ed352019424ea1c4d58a3b9edfe1/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:08.688889 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290f306-5aaa-41d5-94c3-b5eeb55caaf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb91517c80ef4d08a4c6afb4f0437f98, user_id=5d62ed352019424ea1c4d58a3b9edfe1, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:08.692133 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290f306-5aaa-41d5-94c3-b5eeb55caaf1 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:08.712565 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1153/2324] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:21:08 2022] PUT /identity/v3/projects/bb91517c80ef4d08a4c6afb4f0437f98/users/5d62ed352019424ea1c4d58a3b9edfe1/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:21:08.726692 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ce67a-b289-4f9f-a5b7-f92ba9ab601c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:08.726975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ce67a-b289-4f9f-a5b7-f92ba9ab601c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:08.727880 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ce67a-b289-4f9f-a5b7-f92ba9ab601c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:08.765803 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2a7ce67a-b289-4f9f-a5b7-f92ba9ab601c None None] MFA Rules not processed for user `5d62ed352019424ea1c4d58a3b9edfe1`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:08.767227 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2a7ce67a-b289-4f9f-a5b7-f92ba9ab601c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:08.839825 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:08.890040 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1172/2325] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:08.894420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290f306-5aaa-41d5-94c3-b5eeb55caaf1 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:09.044108 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290f306-5aaa-41d5-94c3-b5eeb55caaf1 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:09.050080 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ef9ba-c76a-4ebc-817e-71ea4c18e81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:09.051029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ef9ba-c76a-4ebc-817e-71ea4c18e81b admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:09.051508 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ef9ba-c76a-4ebc-817e-71ea4c18e81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:09.052057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ef9ba-c76a-4ebc-817e-71ea4c18e81b admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:09.052677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ef9ba-c76a-4ebc-817e-71ea4c18e81b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:09.054728 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ef9ba-c76a-4ebc-817e-71ea4c18e81b admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:09.095714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1154/2326] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:21:08 2022] POST /identity/v3/projects => generated 365 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:21:09.101599 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ce67a-b289-4f9f-a5b7-f92ba9ab601c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:09.117212 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ce67a-b289-4f9f-a5b7-f92ba9ab601c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:09.210743 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229770e-1722-4a75-867e-c574ec5d51ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:09.212898 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229770e-1722-4a75-867e-c574ec5d51ba admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:09.213534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229770e-1722-4a75-867e-c574ec5d51ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:09.214003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229770e-1722-4a75-867e-c574ec5d51ba admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:09.215230 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229770e-1722-4a75-867e-c574ec5d51ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:09.219582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229770e-1722-4a75-867e-c574ec5d51ba admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:09.253655 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1173/2327] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:21:09 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:21:09.260528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ef9ba-c76a-4ebc-817e-71ea4c18e81b admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:09.276557 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ef9ba-c76a-4ebc-817e-71ea4c18e81b admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:09.286240 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6beda-8bb4-4529-85ef-5667ec796f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:09.287771 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6beda-8bb4-4529-85ef-5667ec796f9f admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:09.288006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6beda-8bb4-4529-85ef-5667ec796f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:09.288296 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6beda-8bb4-4529-85ef-5667ec796f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:09.289014 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6beda-8bb4-4529-85ef-5667ec796f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:09.292079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6beda-8bb4-4529-85ef-5667ec796f9f admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:09.313363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1155/2328] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:21:09.320108 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229770e-1722-4a75-867e-c574ec5d51ba admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:09.331073 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229770e-1722-4a75-867e-c574ec5d51ba admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:09.336465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9b4e8-d09c-4381-a4f4-8a81281bc5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:09.337704 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9b4e8-d09c-4381-a4f4-8a81281bc5e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:09.337981 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9b4e8-d09c-4381-a4f4-8a81281bc5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:09.338254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9b4e8-d09c-4381-a4f4-8a81281bc5e7 admin admin] PATH_INFO: `/v3/projects/499ba0c4bab04945ba47997336544b87/users/8e5178c5cc534492a82c617491dbdb19/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:09.355834 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9b4e8-d09c-4381-a4f4-8a81281bc5e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=499ba0c4bab04945ba47997336544b87, user_id=8e5178c5cc534492a82c617491dbdb19, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:09.359246 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9b4e8-d09c-4381-a4f4-8a81281bc5e7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:09.413827 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1174/2329] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:21:09 2022] PUT /identity/v3/projects/499ba0c4bab04945ba47997336544b87/users/8e5178c5cc534492a82c617491dbdb19/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:21:09.419468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6beda-8bb4-4529-85ef-5667ec796f9f admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:09.430231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6beda-8bb4-4529-85ef-5667ec796f9f admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:09.443722 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:09.517524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3a2fb-63e0-4ef1-81c5-92f01e6dc812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:09.518168 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3a2fb-63e0-4ef1-81c5-92f01e6dc812 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:09.518595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3a2fb-63e0-4ef1-81c5-92f01e6dc812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:09.518877 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3a2fb-63e0-4ef1-81c5-92f01e6dc812 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:09.519955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3a2fb-63e0-4ef1-81c5-92f01e6dc812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:09.521753 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3a2fb-63e0-4ef1-81c5-92f01e6dc812 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:09.541485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1156/2330] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:21:09.543174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9b4e8-d09c-4381-a4f4-8a81281bc5e7 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:09.557059 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9b4e8-d09c-4381-a4f4-8a81281bc5e7 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:09.562331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aba57b-bbb1-4012-b187-4c2c158ab2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:09.563210 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aba57b-bbb1-4012-b187-4c2c158ab2b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:09.563497 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aba57b-bbb1-4012-b187-4c2c158ab2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:09.563764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aba57b-bbb1-4012-b187-4c2c158ab2b7 admin admin] PATH_INFO: `/v3/projects/499ba0c4bab04945ba47997336544b87/users/8e5178c5cc534492a82c617491dbdb19/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:09.565773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aba57b-bbb1-4012-b187-4c2c158ab2b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=499ba0c4bab04945ba47997336544b87, user_id=8e5178c5cc534492a82c617491dbdb19, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:09.568524 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aba57b-bbb1-4012-b187-4c2c158ab2b7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:09.595043 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1175/2331] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:21:09 2022] PUT /identity/v3/projects/499ba0c4bab04945ba47997336544b87/users/8e5178c5cc534492a82c617491dbdb19/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:21:09.610009 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4f9d5-9e6e-453f-946a-7ff9c92b446d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:09.610284 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4f9d5-9e6e-453f-946a-7ff9c92b446d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:09.610557 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4f9d5-9e6e-453f-946a-7ff9c92b446d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:09.650528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-25a4f9d5-9e6e-453f-946a-7ff9c92b446d None None] MFA Rules not processed for user `8e5178c5cc534492a82c617491dbdb19`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:09.651986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-25a4f9d5-9e6e-453f-946a-7ff9c92b446d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:09.770412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1157/2332] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:09.783510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aba57b-bbb1-4012-b187-4c2c158ab2b7 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:09.786975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-55aba57b-bbb1-4012-b187-4c2c158ab2b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:09.878143 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aba57b-bbb1-4012-b187-4c2c158ab2b7 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:09.884366 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284971c3-e1cb-4a3d-911f-29e12d1807b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:09.885094 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284971c3-e1cb-4a3d-911f-29e12d1807b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:09.885443 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284971c3-e1cb-4a3d-911f-29e12d1807b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:09.885780 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284971c3-e1cb-4a3d-911f-29e12d1807b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:09.900306 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284971c3-e1cb-4a3d-911f-29e12d1807b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:09.902005 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284971c3-e1cb-4a3d-911f-29e12d1807b6 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:09.913634 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1176/2333] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:21:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:21:10.540178 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4f9d5-9e6e-453f-946a-7ff9c92b446d None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:10.682383 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4f9d5-9e6e-453f-946a-7ff9c92b446d None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:10.708676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58bfad0-3f87-4354-b364-ac5d53de911e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:10.710138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bfad0-3f87-4354-b364-ac5d53de911e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:10.710650 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bfad0-3f87-4354-b364-ac5d53de911e admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:10.711186 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bfad0-3f87-4354-b364-ac5d53de911e admin admin] PATH_INFO: `/v3/users/5d62ed352019424ea1c4d58a3b9edfe1` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:10.714095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58bfad0-3f87-4354-b364-ac5d53de911e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d62ed352019424ea1c4d58a3b9edfe1)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:10.716979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58bfad0-3f87-4354-b364-ac5d53de911e admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:10.834265 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:10.850892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c58bfad0-3f87-4354-b364-ac5d53de911e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d62ed352019424ea1c4d58a3b9edfe1'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:10.852829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c58bfad0-3f87-4354-b364-ac5d53de911e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d62ed352019424ea1c4d58a3b9edfe1'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:10.872763 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c58bfad0-3f87-4354-b364-ac5d53de911e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d62ed352019424ea1c4d58a3b9edfe1'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:10.886658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c58bfad0-3f87-4354-b364-ac5d53de911e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d62ed352019424ea1c4d58a3b9edfe1'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:10.909489 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c58bfad0-3f87-4354-b364-ac5d53de911e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d62ed352019424ea1c4d58a3b9edfe1'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:10.921741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1158/2334] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:21:10 2022] DELETE /identity/v3/users/5d62ed352019424ea1c4d58a3b9edfe1 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:21:10.930512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130d72f-c004-4b0c-bb9d-ff6c37cb9fd0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:10.931142 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130d72f-c004-4b0c-bb9d-ff6c37cb9fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:10.931529 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130d72f-c004-4b0c-bb9d-ff6c37cb9fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:10.973413 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a130d72f-c004-4b0c-bb9d-ff6c37cb9fd0 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:10.976928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a130d72f-c004-4b0c-bb9d-ff6c37cb9fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:11.037863 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:11.076158 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1177/2335] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:11.087562 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58bfad0-3f87-4354-b364-ac5d53de911e admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:11.089220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c58bfad0-3f87-4354-b364-ac5d53de911e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:11.181554 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58bfad0-3f87-4354-b364-ac5d53de911e admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:11.185515 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe7c4c-bca8-4b94-89e9-4125653b04ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:11.186146 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe7c4c-bca8-4b94-89e9-4125653b04ab service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:11.186425 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe7c4c-bca8-4b94-89e9-4125653b04ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:11.186698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe7c4c-bca8-4b94-89e9-4125653b04ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:11.199425 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe7c4c-bca8-4b94-89e9-4125653b04ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:11.201016 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe7c4c-bca8-4b94-89e9-4125653b04ab service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:11.219953 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1159/2336] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:21:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:21:11.563934 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130d72f-c004-4b0c-bb9d-ff6c37cb9fd0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:11.565605 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a130d72f-c004-4b0c-bb9d-ff6c37cb9fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:11.584220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130d72f-c004-4b0c-bb9d-ff6c37cb9fd0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:11.599776 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d554b-a0c7-4036-8fc0-eea14edc4a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:11.602796 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d554b-a0c7-4036-8fc0-eea14edc4a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:11.603356 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d554b-a0c7-4036-8fc0-eea14edc4a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:11.603670 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d554b-a0c7-4036-8fc0-eea14edc4a83 admin admin] PATH_INFO: `/v3/projects/bb91517c80ef4d08a4c6afb4f0437f98` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:11.606290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d554b-a0c7-4036-8fc0-eea14edc4a83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb91517c80ef4d08a4c6afb4f0437f98)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:11.608535 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d554b-a0c7-4036-8fc0-eea14edc4a83 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:11.674208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1e9d554b-a0c7-4036-8fc0-eea14edc4a83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb91517c80ef4d08a4c6afb4f0437f98', 'request_id': 'req-1e9d554b-a0c7-4036-8fc0-eea14edc4a83'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:11.685884 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1e9d554b-a0c7-4036-8fc0-eea14edc4a83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb91517c80ef4d08a4c6afb4f0437f98', 'request_id': 'req-1e9d554b-a0c7-4036-8fc0-eea14edc4a83'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:11.694101 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1e9d554b-a0c7-4036-8fc0-eea14edc4a83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb91517c80ef4d08a4c6afb4f0437f98', 'request_id': 'req-1e9d554b-a0c7-4036-8fc0-eea14edc4a83'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:11.707877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1e9d554b-a0c7-4036-8fc0-eea14edc4a83 admin admin] The token cache is being invalidate because project bb91517c80ef4d08a4c6afb4f0437f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:21:11.708201 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1e9d554b-a0c7-4036-8fc0-eea14edc4a83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:11.709264 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1e9d554b-a0c7-4036-8fc0-eea14edc4a83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:11.714114 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1178/2337] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:21:11 2022] DELETE /identity/v3/projects/bb91517c80ef4d08a4c6afb4f0437f98 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:21:11.714956 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe7c4c-bca8-4b94-89e9-4125653b04ab service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:11.731905 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe7c4c-bca8-4b94-89e9-4125653b04ab service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:11.816244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96399b1-8dcd-4277-8d83-50a28be6df19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:11.816912 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96399b1-8dcd-4277-8d83-50a28be6df19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:11.817366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96399b1-8dcd-4277-8d83-50a28be6df19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:11.817675 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96399b1-8dcd-4277-8d83-50a28be6df19 admin admin] PATH_INFO: `/v3/users/8e5178c5cc534492a82c617491dbdb19` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:11.818829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96399b1-8dcd-4277-8d83-50a28be6df19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e5178c5cc534492a82c617491dbdb19)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:11.822085 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96399b1-8dcd-4277-8d83-50a28be6df19 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:11.894879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f96399b1-8dcd-4277-8d83-50a28be6df19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e5178c5cc534492a82c617491dbdb19'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:11.896281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f96399b1-8dcd-4277-8d83-50a28be6df19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e5178c5cc534492a82c617491dbdb19'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:11.906265 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f96399b1-8dcd-4277-8d83-50a28be6df19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e5178c5cc534492a82c617491dbdb19'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:11.927657 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:11.930790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f96399b1-8dcd-4277-8d83-50a28be6df19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e5178c5cc534492a82c617491dbdb19'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:11.961879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f96399b1-8dcd-4277-8d83-50a28be6df19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e5178c5cc534492a82c617491dbdb19'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:11.982936 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1160/2338] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:21:11 2022] DELETE /identity/v3/users/8e5178c5cc534492a82c617491dbdb19 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:21:12.366795 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d554b-a0c7-4036-8fc0-eea14edc4a83 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:12.369116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1e9d554b-a0c7-4036-8fc0-eea14edc4a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:12.391656 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d554b-a0c7-4036-8fc0-eea14edc4a83 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:12.480866 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738902b-719b-42a3-a92c-f6a08103bf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:12.481624 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738902b-719b-42a3-a92c-f6a08103bf3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:12.482149 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738902b-719b-42a3-a92c-f6a08103bf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:12.482565 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738902b-719b-42a3-a92c-f6a08103bf3d admin admin] PATH_INFO: `/v3/projects/499ba0c4bab04945ba47997336544b87` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:12.485488 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738902b-719b-42a3-a92c-f6a08103bf3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=499ba0c4bab04945ba47997336544b87)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:12.488826 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738902b-719b-42a3-a92c-f6a08103bf3d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:12.568740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a738902b-719b-42a3-a92c-f6a08103bf3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '499ba0c4bab04945ba47997336544b87', 'request_id': 'req-a738902b-719b-42a3-a92c-f6a08103bf3d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:12.585603 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a738902b-719b-42a3-a92c-f6a08103bf3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '499ba0c4bab04945ba47997336544b87', 'request_id': 'req-a738902b-719b-42a3-a92c-f6a08103bf3d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:12.594417 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a738902b-719b-42a3-a92c-f6a08103bf3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '499ba0c4bab04945ba47997336544b87', 'request_id': 'req-a738902b-719b-42a3-a92c-f6a08103bf3d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:12.598395 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:12.613236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a738902b-719b-42a3-a92c-f6a08103bf3d admin admin] The token cache is being invalidate because project 499ba0c4bab04945ba47997336544b87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:21:12.614179 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a738902b-719b-42a3-a92c-f6a08103bf3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:12.615281 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a738902b-719b-42a3-a92c-f6a08103bf3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:12.619101 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1179/2339] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:21:12 2022] DELETE /identity/v3/projects/499ba0c4bab04945ba47997336544b87 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:21:12.624500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f39b0e-6de2-47b2-ad70-f3d4d32ede2e None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:12.626200 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f39b0e-6de2-47b2-ad70-f3d4d32ede2e None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:12.626480 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f39b0e-6de2-47b2-ad70-f3d4d32ede2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:12.659563 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-c5f39b0e-6de2-47b2-ad70-f3d4d32ede2e None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:12.660856 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c5f39b0e-6de2-47b2-ad70-f3d4d32ede2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:12.768581 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1161/2340] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:12.782734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831c0fd-f732-4ae5-a4e4-7a288a9cf083 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:12.783887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831c0fd-f732-4ae5-a4e4-7a288a9cf083 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:12.786492 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831c0fd-f732-4ae5-a4e4-7a288a9cf083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:12.816370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2831c0fd-f732-4ae5-a4e4-7a288a9cf083 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:12.817737 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2831c0fd-f732-4ae5-a4e4-7a288a9cf083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:12.831339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1180/2341] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:12.834861 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f39b0e-6de2-47b2-ad70-f3d4d32ede2e None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:12.867247 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f39b0e-6de2-47b2-ad70-f3d4d32ede2e None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:12.876681 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d6f6c-768b-407b-b4de-6ee7b4b576e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:12.877486 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d6f6c-768b-407b-b4de-6ee7b4b576e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:12.877901 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d6f6c-768b-407b-b4de-6ee7b4b576e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:12.878413 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d6f6c-768b-407b-b4de-6ee7b4b576e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:12.879415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d6f6c-768b-407b-b4de-6ee7b4b576e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:21:12.880281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d6f6c-768b-407b-b4de-6ee7b4b576e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:12.882295 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d6f6c-768b-407b-b4de-6ee7b4b576e7 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:12.905319 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1162/2342] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:21:12.909686 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831c0fd-f732-4ae5-a4e4-7a288a9cf083 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:12.920681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831c0fd-f732-4ae5-a4e4-7a288a9cf083 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:12.931748 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf853d6-a04c-4b0a-bf3c-727ff3901bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:12.932798 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf853d6-a04c-4b0a-bf3c-727ff3901bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:12.933279 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf853d6-a04c-4b0a-bf3c-727ff3901bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:12.933761 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf853d6-a04c-4b0a-bf3c-727ff3901bb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:12.934898 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf853d6-a04c-4b0a-bf3c-727ff3901bb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:12.938062 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf853d6-a04c-4b0a-bf3c-727ff3901bb6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:12.979653 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1181/2343] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:21:12 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:21:12.985493 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d6f6c-768b-407b-b4de-6ee7b4b576e7 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:13.002955 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d6f6c-768b-407b-b4de-6ee7b4b576e7 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:13.097460 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780caf8c-d770-41d4-8f65-7cf4f8f25ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:13.098185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780caf8c-d770-41d4-8f65-7cf4f8f25ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:13.098543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780caf8c-d770-41d4-8f65-7cf4f8f25ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:13.098878 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780caf8c-d770-41d4-8f65-7cf4f8f25ad1 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:13.099596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780caf8c-d770-41d4-8f65-7cf4f8f25ad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:13.101635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780caf8c-d770-41d4-8f65-7cf4f8f25ad1 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:13.130804 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1163/2344] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:21:12 2022] POST /identity/v3/users => generated 285 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:21:13.136268 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf853d6-a04c-4b0a-bf3c-727ff3901bb6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:13.148707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf853d6-a04c-4b0a-bf3c-727ff3901bb6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:13.155325 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc35e6-a398-4e14-9fdd-9f21dfc2204b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:13.162113 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc35e6-a398-4e14-9fdd-9f21dfc2204b admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:13.162113 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc35e6-a398-4e14-9fdd-9f21dfc2204b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:13.162113 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc35e6-a398-4e14-9fdd-9f21dfc2204b admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:13.162113 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc35e6-a398-4e14-9fdd-9f21dfc2204b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:13.162113 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc35e6-a398-4e14-9fdd-9f21dfc2204b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:13.173461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1182/2345] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:21:13.177865 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780caf8c-d770-41d4-8f65-7cf4f8f25ad1 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:13.194251 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780caf8c-d770-41d4-8f65-7cf4f8f25ad1 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:13.202880 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc75825-6845-477a-a83a-251fa994c356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:13.203544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc75825-6845-477a-a83a-251fa994c356 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:13.203826 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc75825-6845-477a-a83a-251fa994c356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:13.204242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc75825-6845-477a-a83a-251fa994c356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:13.204796 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc75825-6845-477a-a83a-251fa994c356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:13.212116 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc75825-6845-477a-a83a-251fa994c356 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:13.231151 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1164/2346] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:21:13.232067 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc35e6-a398-4e14-9fdd-9f21dfc2204b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:13.247223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc35e6-a398-4e14-9fdd-9f21dfc2204b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:13.256789 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e3ff2-bad3-4f33-812c-ae541865c54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:13.257736 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e3ff2-bad3-4f33-812c-ae541865c54c admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:13.258217 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e3ff2-bad3-4f33-812c-ae541865c54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:13.258644 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e3ff2-bad3-4f33-812c-ae541865c54c admin admin] PATH_INFO: `/v3/projects/5cc0b0b17d3b4d479b9081a61697d529/users/80b1a10990a0445fa611ad42c95218fd/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:13.281729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e3ff2-bad3-4f33-812c-ae541865c54c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc0b0b17d3b4d479b9081a61697d529, user_id=80b1a10990a0445fa611ad42c95218fd, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:13.284577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e3ff2-bad3-4f33-812c-ae541865c54c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:13.302801 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1183/2347] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:21:13 2022] PUT /identity/v3/projects/5cc0b0b17d3b4d479b9081a61697d529/users/80b1a10990a0445fa611ad42c95218fd/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:21:13.313797 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306f5a5-5224-40a0-887e-084cd22a659c None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:13.314293 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306f5a5-5224-40a0-887e-084cd22a659c None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:13.314632 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306f5a5-5224-40a0-887e-084cd22a659c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:13.348386 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-a306f5a5-5224-40a0-887e-084cd22a659c None None] MFA Rules not processed for user `80b1a10990a0445fa611ad42c95218fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:13.349612 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-a306f5a5-5224-40a0-887e-084cd22a659c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:13.387681 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:13.433208 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1165/2348] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:13.438461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e3ff2-bad3-4f33-812c-ae541865c54c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:13.506563 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e3ff2-bad3-4f33-812c-ae541865c54c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:13.513528 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5bc50-bccc-443e-88a5-b7c1e9b7da9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:13.514153 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5bc50-bccc-443e-88a5-b7c1e9b7da9f admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:13.514446 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5bc50-bccc-443e-88a5-b7c1e9b7da9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:13.514714 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5bc50-bccc-443e-88a5-b7c1e9b7da9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:13.515508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5bc50-bccc-443e-88a5-b7c1e9b7da9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:13.517447 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5bc50-bccc-443e-88a5-b7c1e9b7da9f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:13.548110 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1184/2349] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:21:13 2022] POST /identity/v3/projects => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:21:13.554333 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306f5a5-5224-40a0-887e-084cd22a659c None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:13.575073 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306f5a5-5224-40a0-887e-084cd22a659c None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:13.649731 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c592d-c33b-4ae3-9d01-ef313c2ef32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:13.650127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c592d-c33b-4ae3-9d01-ef313c2ef32a admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:13.650420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c592d-c33b-4ae3-9d01-ef313c2ef32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:13.650805 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c592d-c33b-4ae3-9d01-ef313c2ef32a admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:13.651490 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c592d-c33b-4ae3-9d01-ef313c2ef32a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:13.653443 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c592d-c33b-4ae3-9d01-ef313c2ef32a admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:13.680776 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1166/2350] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:21:13 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:21:13.684751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5bc50-bccc-443e-88a5-b7c1e9b7da9f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:13.695424 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5bc50-bccc-443e-88a5-b7c1e9b7da9f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:13.703179 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e1d15-22c6-4acf-855a-cf55bf0aa73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:13.703789 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e1d15-22c6-4acf-855a-cf55bf0aa73d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:13.704144 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e1d15-22c6-4acf-855a-cf55bf0aa73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:13.704413 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e1d15-22c6-4acf-855a-cf55bf0aa73d admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:13.705054 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e1d15-22c6-4acf-855a-cf55bf0aa73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:13.706652 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e1d15-22c6-4acf-855a-cf55bf0aa73d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:13.719101 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1185/2351] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:21:13.724016 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c592d-c33b-4ae3-9d01-ef313c2ef32a admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:13.735190 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c592d-c33b-4ae3-9d01-ef313c2ef32a admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:13.740240 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f786f-28b7-48c1-8f19-991efb2c1768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:13.740907 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f786f-28b7-48c1-8f19-991efb2c1768 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:13.741185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f786f-28b7-48c1-8f19-991efb2c1768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:13.741464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f786f-28b7-48c1-8f19-991efb2c1768 admin admin] PATH_INFO: `/v3/projects/181804355c2b48e3bb0bae3bdb6f422c/users/e3ea67771a6c41d596f9f1a7626b35fc/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:13.761167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f786f-28b7-48c1-8f19-991efb2c1768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=181804355c2b48e3bb0bae3bdb6f422c, user_id=e3ea67771a6c41d596f9f1a7626b35fc, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:13.764212 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f786f-28b7-48c1-8f19-991efb2c1768 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:13.780132 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1167/2352] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:21:13 2022] PUT /identity/v3/projects/181804355c2b48e3bb0bae3bdb6f422c/users/e3ea67771a6c41d596f9f1a7626b35fc/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:21:13.784485 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e1d15-22c6-4acf-855a-cf55bf0aa73d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:13.795161 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e1d15-22c6-4acf-855a-cf55bf0aa73d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:13.861435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398fba0-6cfe-4e82-a22e-18d46b1d3ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:13.862082 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398fba0-6cfe-4e82-a22e-18d46b1d3ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:13.862362 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398fba0-6cfe-4e82-a22e-18d46b1d3ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:13.862630 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398fba0-6cfe-4e82-a22e-18d46b1d3ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:13.863344 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398fba0-6cfe-4e82-a22e-18d46b1d3ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:13.864989 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398fba0-6cfe-4e82-a22e-18d46b1d3ac5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:13.867413 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:13.878969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1186/2353] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:21:13.883774 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f786f-28b7-48c1-8f19-991efb2c1768 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:13.893936 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f786f-28b7-48c1-8f19-991efb2c1768 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:13.898493 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa178006-00c7-4e1f-a996-5c920a435b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:13.899890 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa178006-00c7-4e1f-a996-5c920a435b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:13.900106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa178006-00c7-4e1f-a996-5c920a435b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:13.900420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa178006-00c7-4e1f-a996-5c920a435b1a admin admin] PATH_INFO: `/v3/projects/181804355c2b48e3bb0bae3bdb6f422c/users/e3ea67771a6c41d596f9f1a7626b35fc/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:13.902273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa178006-00c7-4e1f-a996-5c920a435b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=181804355c2b48e3bb0bae3bdb6f422c, user_id=e3ea67771a6c41d596f9f1a7626b35fc, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:13.904913 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa178006-00c7-4e1f-a996-5c920a435b1a admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:13.915494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1168/2354] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:21:13 2022] PUT /identity/v3/projects/181804355c2b48e3bb0bae3bdb6f422c/users/e3ea67771a6c41d596f9f1a7626b35fc/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:21:13.926510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf8ce9-ad51-42d7-8429-52c6f79706ee None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:13.926794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf8ce9-ad51-42d7-8429-52c6f79706ee None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:13.927103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf8ce9-ad51-42d7-8429-52c6f79706ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:13.955324 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-72cf8ce9-ad51-42d7-8429-52c6f79706ee None None] MFA Rules not processed for user `e3ea67771a6c41d596f9f1a7626b35fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:13.956528 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-72cf8ce9-ad51-42d7-8429-52c6f79706ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:14.029550 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1187/2355] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:14.041708 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa178006-00c7-4e1f-a996-5c920a435b1a admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:14.043536 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-aa178006-00c7-4e1f-a996-5c920a435b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:14.113365 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa178006-00c7-4e1f-a996-5c920a435b1a admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:14.117420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac77170-8bc3-422a-bd4a-b41dc673bad8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:14.118266 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac77170-8bc3-422a-bd4a-b41dc673bad8 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:14.118544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac77170-8bc3-422a-bd4a-b41dc673bad8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:14.118810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac77170-8bc3-422a-bd4a-b41dc673bad8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:14.128524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac77170-8bc3-422a-bd4a-b41dc673bad8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:14.129959 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac77170-8bc3-422a-bd4a-b41dc673bad8 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:14.140849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1169/2356] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:21:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:21:14.372275 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf8ce9-ad51-42d7-8429-52c6f79706ee None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:14.375731 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-72cf8ce9-ad51-42d7-8429-52c6f79706ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:14.484667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf8ce9-ad51-42d7-8429-52c6f79706ee None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:14.490867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724b3f7-aeee-4713-b1fe-6d532c73a9da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:14.491735 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724b3f7-aeee-4713-b1fe-6d532c73a9da service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:14.492087 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724b3f7-aeee-4713-b1fe-6d532c73a9da service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:14.492434 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724b3f7-aeee-4713-b1fe-6d532c73a9da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:14.494262 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b724b3f7-aeee-4713-b1fe-6d532c73a9da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:14.571070 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724b3f7-aeee-4713-b1fe-6d532c73a9da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:14.572956 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724b3f7-aeee-4713-b1fe-6d532c73a9da service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:14.584207 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1188/2357] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:21:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:21:15.902584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac77170-8bc3-422a-bd4a-b41dc673bad8 service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:15.934458 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:15.969885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac77170-8bc3-422a-bd4a-b41dc673bad8 service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:15.974474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44df162-11fc-4f87-834a-ffd4eacc60e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:15.975131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44df162-11fc-4f87-834a-ffd4eacc60e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:15.975409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44df162-11fc-4f87-834a-ffd4eacc60e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:15.975681 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44df162-11fc-4f87-834a-ffd4eacc60e2 admin admin] PATH_INFO: `/v3/users/80b1a10990a0445fa611ad42c95218fd` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:15.976822 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44df162-11fc-4f87-834a-ffd4eacc60e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80b1a10990a0445fa611ad42c95218fd)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:15.978768 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44df162-11fc-4f87-834a-ffd4eacc60e2 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:16.026306 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c44df162-11fc-4f87-834a-ffd4eacc60e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80b1a10990a0445fa611ad42c95218fd'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:16.026884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c44df162-11fc-4f87-834a-ffd4eacc60e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80b1a10990a0445fa611ad42c95218fd'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:16.034025 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c44df162-11fc-4f87-834a-ffd4eacc60e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80b1a10990a0445fa611ad42c95218fd'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:16.040727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c44df162-11fc-4f87-834a-ffd4eacc60e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80b1a10990a0445fa611ad42c95218fd'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:16.052609 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c44df162-11fc-4f87-834a-ffd4eacc60e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80b1a10990a0445fa611ad42c95218fd'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:16.058885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1170/2358] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:21:15 2022] DELETE /identity/v3/users/80b1a10990a0445fa611ad42c95218fd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:21:16.063380 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be0f0d-b87e-4790-818f-bf9495123561 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:16.063844 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be0f0d-b87e-4790-818f-bf9495123561 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:16.063939 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be0f0d-b87e-4790-818f-bf9495123561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:16.084908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d2be0f0d-b87e-4790-818f-bf9495123561 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:16.086340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d2be0f0d-b87e-4790-818f-bf9495123561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:16.104595 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:16.149846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1189/2359] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:16.159690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44df162-11fc-4f87-834a-ffd4eacc60e2 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:16.161087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c44df162-11fc-4f87-834a-ffd4eacc60e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:16.219455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44df162-11fc-4f87-834a-ffd4eacc60e2 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:16.223392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3c1fa-ba4a-4dee-b1e0-4f05ef83196a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:16.224010 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3c1fa-ba4a-4dee-b1e0-4f05ef83196a service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:16.224287 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3c1fa-ba4a-4dee-b1e0-4f05ef83196a service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:16.224558 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3c1fa-ba4a-4dee-b1e0-4f05ef83196a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:16.235111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3c1fa-ba4a-4dee-b1e0-4f05ef83196a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:16.236529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3c1fa-ba4a-4dee-b1e0-4f05ef83196a service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:16.246692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1171/2360] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:21:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:21:16.526649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be0f0d-b87e-4790-818f-bf9495123561 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:16.528373 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d2be0f0d-b87e-4790-818f-bf9495123561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:16.541145 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be0f0d-b87e-4790-818f-bf9495123561 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:16.546429 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de19bc-9b3f-40d7-961d-8f7caa4414dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:16.547128 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de19bc-9b3f-40d7-961d-8f7caa4414dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:16.547408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de19bc-9b3f-40d7-961d-8f7caa4414dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:16.547875 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de19bc-9b3f-40d7-961d-8f7caa4414dc admin admin] PATH_INFO: `/v3/projects/5cc0b0b17d3b4d479b9081a61697d529` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:16.549488 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de19bc-9b3f-40d7-961d-8f7caa4414dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cc0b0b17d3b4d479b9081a61697d529)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:16.551977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de19bc-9b3f-40d7-961d-8f7caa4414dc admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:16.599745 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d4de19bc-9b3f-40d7-961d-8f7caa4414dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cc0b0b17d3b4d479b9081a61697d529', 'request_id': 'req-d4de19bc-9b3f-40d7-961d-8f7caa4414dc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:16.607952 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d4de19bc-9b3f-40d7-961d-8f7caa4414dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cc0b0b17d3b4d479b9081a61697d529', 'request_id': 'req-d4de19bc-9b3f-40d7-961d-8f7caa4414dc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:16.615033 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d4de19bc-9b3f-40d7-961d-8f7caa4414dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cc0b0b17d3b4d479b9081a61697d529', 'request_id': 'req-d4de19bc-9b3f-40d7-961d-8f7caa4414dc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:16.625782 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d4de19bc-9b3f-40d7-961d-8f7caa4414dc admin admin] The token cache is being invalidate because project 5cc0b0b17d3b4d479b9081a61697d529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:21:16.626069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d4de19bc-9b3f-40d7-961d-8f7caa4414dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:16.626738 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d4de19bc-9b3f-40d7-961d-8f7caa4414dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:16.628260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1190/2361] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:21:16 2022] DELETE /identity/v3/projects/5cc0b0b17d3b4d479b9081a61697d529 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:21:16.632546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3c1fa-ba4a-4dee-b1e0-4f05ef83196a service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:16.642304 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3c1fa-ba4a-4dee-b1e0-4f05ef83196a service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:16.691691 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:16.703380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31366043-2842-4c51-9f3d-b71ed0c93b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:16.704027 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31366043-2842-4c51-9f3d-b71ed0c93b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:16.704300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31366043-2842-4c51-9f3d-b71ed0c93b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:16.704567 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31366043-2842-4c51-9f3d-b71ed0c93b0c admin admin] PATH_INFO: `/v3/users/e3ea67771a6c41d596f9f1a7626b35fc` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:16.705686 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31366043-2842-4c51-9f3d-b71ed0c93b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3ea67771a6c41d596f9f1a7626b35fc)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:16.707643 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31366043-2842-4c51-9f3d-b71ed0c93b0c admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:16.759255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-31366043-2842-4c51-9f3d-b71ed0c93b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3ea67771a6c41d596f9f1a7626b35fc'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:16.759991 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-31366043-2842-4c51-9f3d-b71ed0c93b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3ea67771a6c41d596f9f1a7626b35fc'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:16.768969 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-31366043-2842-4c51-9f3d-b71ed0c93b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3ea67771a6c41d596f9f1a7626b35fc'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:16.778004 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-31366043-2842-4c51-9f3d-b71ed0c93b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3ea67771a6c41d596f9f1a7626b35fc'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:16.791224 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-31366043-2842-4c51-9f3d-b71ed0c93b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3ea67771a6c41d596f9f1a7626b35fc'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:16.797764 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1172/2362] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:21:16 2022] DELETE /identity/v3/users/e3ea67771a6c41d596f9f1a7626b35fc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:21:17.232957 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de19bc-9b3f-40d7-961d-8f7caa4414dc admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:17.236463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d4de19bc-9b3f-40d7-961d-8f7caa4414dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:17.266483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de19bc-9b3f-40d7-961d-8f7caa4414dc admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:17.350822 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad07492-607b-4105-9551-5855a42a339c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:17.351518 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad07492-607b-4105-9551-5855a42a339c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:17.351792 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad07492-607b-4105-9551-5855a42a339c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:17.352064 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad07492-607b-4105-9551-5855a42a339c admin admin] PATH_INFO: `/v3/projects/181804355c2b48e3bb0bae3bdb6f422c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:17.353187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad07492-607b-4105-9551-5855a42a339c admin admin] RBAC: Authorizing `identity:delete_project(project_id=181804355c2b48e3bb0bae3bdb6f422c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:17.355127 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad07492-607b-4105-9551-5855a42a339c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:17.416365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:17.420917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6ad07492-607b-4105-9551-5855a42a339c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '181804355c2b48e3bb0bae3bdb6f422c', 'request_id': 'req-6ad07492-607b-4105-9551-5855a42a339c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:17.432109 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6ad07492-607b-4105-9551-5855a42a339c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '181804355c2b48e3bb0bae3bdb6f422c', 'request_id': 'req-6ad07492-607b-4105-9551-5855a42a339c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:17.438922 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6ad07492-607b-4105-9551-5855a42a339c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '181804355c2b48e3bb0bae3bdb6f422c', 'request_id': 'req-6ad07492-607b-4105-9551-5855a42a339c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:17.450147 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6ad07492-607b-4105-9551-5855a42a339c admin admin] The token cache is being invalidate because project 181804355c2b48e3bb0bae3bdb6f422c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:21:17.450654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6ad07492-607b-4105-9551-5855a42a339c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:17.451457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6ad07492-607b-4105-9551-5855a42a339c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:17.453260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1191/2363] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:21:17 2022] DELETE /identity/v3/projects/181804355c2b48e3bb0bae3bdb6f422c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:21:17.459345 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ef624-43d2-4558-a76f-8829f1346312 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:17.459864 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ef624-43d2-4558-a76f-8829f1346312 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:17.459864 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ef624-43d2-4558-a76f-8829f1346312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:17.480181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-761ef624-43d2-4558-a76f-8829f1346312 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:17.481399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-761ef624-43d2-4558-a76f-8829f1346312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:17.551568 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1173/2364] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:17.562650 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eab0b-b15d-48c1-9397-0af898c7962c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:17.562650 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eab0b-b15d-48c1-9397-0af898c7962c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:17.562942 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eab0b-b15d-48c1-9397-0af898c7962c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:17.597002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9a7eab0b-b15d-48c1-9397-0af898c7962c None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:17.598248 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9a7eab0b-b15d-48c1-9397-0af898c7962c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:17.606815 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1192/2365] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:21:17.611136 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ef624-43d2-4558-a76f-8829f1346312 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:17.621204 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ef624-43d2-4558-a76f-8829f1346312 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:17.626448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4229a-d1fe-4c35-8380-94fb56d4bb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:17.627105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4229a-d1fe-4c35-8380-94fb56d4bb01 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:17.627381 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4229a-d1fe-4c35-8380-94fb56d4bb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:17.627652 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4229a-d1fe-4c35-8380-94fb56d4bb01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:17.628318 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4229a-d1fe-4c35-8380-94fb56d4bb01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:21:17.628615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4229a-d1fe-4c35-8380-94fb56d4bb01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:17.630199 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4229a-d1fe-4c35-8380-94fb56d4bb01 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:17.642209 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1174/2366] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:21:17.646664 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7eab0b-b15d-48c1-9397-0af898c7962c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:17.656903 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7eab0b-b15d-48c1-9397-0af898c7962c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:17.662219 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183b4bc-03c9-4d72-acfd-e854405b4374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:17.662938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183b4bc-03c9-4d72-acfd-e854405b4374 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:17.663327 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183b4bc-03c9-4d72-acfd-e854405b4374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:17.663673 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183b4bc-03c9-4d72-acfd-e854405b4374 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:17.664916 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4183b4bc-03c9-4d72-acfd-e854405b4374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:17.666910 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4183b4bc-03c9-4d72-acfd-e854405b4374 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:17.694785 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1193/2367] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:21:17 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:21:17.699169 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4229a-d1fe-4c35-8380-94fb56d4bb01 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:17.709522 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4229a-d1fe-4c35-8380-94fb56d4bb01 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:17.764176 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:17.771515 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d402697-081a-48b3-a022-b870394d66c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:17.772140 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d402697-081a-48b3-a022-b870394d66c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:17.772642 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d402697-081a-48b3-a022-b870394d66c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:17.773315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d402697-081a-48b3-a022-b870394d66c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:17.774145 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d402697-081a-48b3-a022-b870394d66c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:17.776354 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d402697-081a-48b3-a022-b870394d66c4 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:17.803036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1175/2368] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:21:17 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:21:17.805535 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183b4bc-03c9-4d72-acfd-e854405b4374 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:17.816199 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183b4bc-03c9-4d72-acfd-e854405b4374 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:17.827932 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c7f86-8d95-49fe-ba04-dbc6f90a4c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:17.828561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c7f86-8d95-49fe-ba04-dbc6f90a4c49 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:17.828840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c7f86-8d95-49fe-ba04-dbc6f90a4c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:17.829112 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c7f86-8d95-49fe-ba04-dbc6f90a4c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:17.829763 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c7f86-8d95-49fe-ba04-dbc6f90a4c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:17.831410 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c7f86-8d95-49fe-ba04-dbc6f90a4c49 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:17.843075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1194/2369] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:21:17.848122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d402697-081a-48b3-a022-b870394d66c4 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:17.862429 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d402697-081a-48b3-a022-b870394d66c4 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:17.868202 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e792389-e8ff-4419-8bca-cc6f1d2a6db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:17.868845 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e792389-e8ff-4419-8bca-cc6f1d2a6db6 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:17.869122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e792389-e8ff-4419-8bca-cc6f1d2a6db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:17.869395 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e792389-e8ff-4419-8bca-cc6f1d2a6db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:17.870044 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e792389-e8ff-4419-8bca-cc6f1d2a6db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:17.872197 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e792389-e8ff-4419-8bca-cc6f1d2a6db6 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:17.885689 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1176/2370] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:21:17.891286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c7f86-8d95-49fe-ba04-dbc6f90a4c49 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:17.901606 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c7f86-8d95-49fe-ba04-dbc6f90a4c49 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:17.906474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32fa2a-2824-4931-8972-67f01a5be94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:17.907242 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32fa2a-2824-4931-8972-67f01a5be94e admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:17.907523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32fa2a-2824-4931-8972-67f01a5be94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:17.907793 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32fa2a-2824-4931-8972-67f01a5be94e admin admin] PATH_INFO: `/v3/projects/0bcd454ea6d446e4b85d299a2087cf45/users/c21467a7c1af4cc1a6d3d81c89aa87f5/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:17.924338 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32fa2a-2824-4931-8972-67f01a5be94e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bcd454ea6d446e4b85d299a2087cf45, user_id=c21467a7c1af4cc1a6d3d81c89aa87f5, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:17.926986 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32fa2a-2824-4931-8972-67f01a5be94e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:17.943611 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1195/2371] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:21:17 2022] PUT /identity/v3/projects/0bcd454ea6d446e4b85d299a2087cf45/users/c21467a7c1af4cc1a6d3d81c89aa87f5/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:21:17.955040 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57643de5-5d7f-4abc-8855-0622f3028f2f None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:17.955281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57643de5-5d7f-4abc-8855-0622f3028f2f None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:17.955460 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57643de5-5d7f-4abc-8855-0622f3028f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:17.986560 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-57643de5-5d7f-4abc-8855-0622f3028f2f None None] MFA Rules not processed for user `c21467a7c1af4cc1a6d3d81c89aa87f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:17.987761 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-57643de5-5d7f-4abc-8855-0622f3028f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:18.057676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1177/2372] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:18.068966 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32fa2a-2824-4931-8972-67f01a5be94e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:18.071370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3e32fa2a-2824-4931-8972-67f01a5be94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:18.135946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32fa2a-2824-4931-8972-67f01a5be94e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:18.139957 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca46c7-7e19-4b3b-b686-e0dc0eca4bed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5979be13ad31421b886069faf0dcc915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:18.140568 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca46c7-7e19-4b3b-b686-e0dc0eca4bed service glance] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:18.140849 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca46c7-7e19-4b3b-b686-e0dc0eca4bed service glance] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:18.141123 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca46c7-7e19-4b3b-b686-e0dc0eca4bed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:18.151124 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca46c7-7e19-4b3b-b686-e0dc0eca4bed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:18.152607 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca46c7-7e19-4b3b-b686-e0dc0eca4bed service glance] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:18.161809 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1196/2373] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:21:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:21:18.246696 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ac49c-f761-4ac6-ac0f-cc3bd182f3f0 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:18.246980 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ac49c-f761-4ac6-ac0f-cc3bd182f3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:18.247552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ac49c-f761-4ac6-ac0f-cc3bd182f3f0 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:18.249244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1178/2374] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 10 13:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 13:21:18.257137 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bc6b8-ed70-418a-85a0-a7c005e87638 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:18.257596 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bc6b8-ed70-418a-85a0-a7c005e87638 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:18.257866 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bc6b8-ed70-418a-85a0-a7c005e87638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:18.280521 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ec0bc6b8-ed70-418a-85a0-a7c005e87638 None None] MFA Rules not processed for user `7fd0f76f24ea481191dfd65fff2376af`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:18.281757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ec0bc6b8-ed70-418a-85a0-a7c005e87638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:18.367929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1197/2375] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 10 13:21:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:18.379726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ac49c-f761-4ac6-ac0f-cc3bd182f3f0 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:18.381484 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-732ac49c-f761-4ac6-ac0f-cc3bd182f3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:18.397148 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ac49c-f761-4ac6-ac0f-cc3bd182f3f0 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:18.401564 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19254c4-a16f-470a-94ab-463c7f27fc17 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5979be13ad31421b886069faf0dcc915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:18.402347 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19254c4-a16f-470a-94ab-463c7f27fc17 service glance] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:18.402699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19254c4-a16f-470a-94ab-463c7f27fc17 service glance] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:18.403329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19254c4-a16f-470a-94ab-463c7f27fc17 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:18.415392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19254c4-a16f-470a-94ab-463c7f27fc17 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:18.416851 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19254c4-a16f-470a-94ab-463c7f27fc17 service glance] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:18.427853 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1179/2376] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:21:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:21:18.502833 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91affde9-33a4-42a6-bda1-96662faed0bb None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:18.503229 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91affde9-33a4-42a6-bda1-96662faed0bb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:18.503657 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91affde9-33a4-42a6-bda1-96662faed0bb None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:18.505841 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1198/2377] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 10 13:21:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:21:18.510659 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a9b9e-6047-4cba-b6a6-4fd5dfea96ac None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:18.511233 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a9b9e-6047-4cba-b6a6-4fd5dfea96ac None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:18.511233 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a9b9e-6047-4cba-b6a6-4fd5dfea96ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:18.533307 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-717a9b9e-6047-4cba-b6a6-4fd5dfea96ac None None] MFA Rules not processed for user `49b69dad00934ce78cbede99f976439f`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:18.534566 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-717a9b9e-6047-4cba-b6a6-4fd5dfea96ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:18.594336 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1180/2378] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 10 13:21:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:18.607851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91affde9-33a4-42a6-bda1-96662faed0bb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:18.609579 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-91affde9-33a4-42a6-bda1-96662faed0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:18.620193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:18.626031 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91affde9-33a4-42a6-bda1-96662faed0bb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:18.631915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f58f1-d0af-4a84-ada1-a2c5b65026f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:18.633056 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f58f1-d0af-4a84-ada1-a2c5b65026f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:18.633692 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f58f1-d0af-4a84-ada1-a2c5b65026f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:18.634450 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f58f1-d0af-4a84-ada1-a2c5b65026f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:18.643362 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f58f1-d0af-4a84-ada1-a2c5b65026f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:18.645088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f58f1-d0af-4a84-ada1-a2c5b65026f3 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:18.654928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1199/2379] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:21:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:21:18.741872 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba59737-d7dc-4e5b-84a2-617cf528e1e7 None None] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:18.742148 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba59737-d7dc-4e5b-84a2-617cf528e1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:18.743102 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba59737-d7dc-4e5b-84a2-617cf528e1e7 None None] PATH_INFO: `/` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:18.744514 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1181/2380] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 10 13:21:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 13:21:18.750184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe6163-52c4-4e47-962e-1e50fb524376 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:18.750594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe6163-52c4-4e47-962e-1e50fb524376 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:18.750943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe6163-52c4-4e47-962e-1e50fb524376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:18.771616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6cbe6163-52c4-4e47-962e-1e50fb524376 None None] MFA Rules not processed for user `7fd0f76f24ea481191dfd65fff2376af`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:18.772828 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6cbe6163-52c4-4e47-962e-1e50fb524376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:18.782903 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1200/2381] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 10 13:21:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:18.794325 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba59737-d7dc-4e5b-84a2-617cf528e1e7 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:18.805692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba59737-d7dc-4e5b-84a2-617cf528e1e7 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:18.809519 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b20d7-815f-4aef-87b6-30efaf1c4793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:18.810109 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b20d7-815f-4aef-87b6-30efaf1c4793 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:18.810389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b20d7-815f-4aef-87b6-30efaf1c4793 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:18.810661 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b20d7-815f-4aef-87b6-30efaf1c4793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:18.821534 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b20d7-815f-4aef-87b6-30efaf1c4793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:18.822937 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b20d7-815f-4aef-87b6-30efaf1c4793 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:18.833843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1182/2382] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:21:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:21:20.771932 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7aa74e-3c9f-4e48-9823-3bf4e2d93d92 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:20.772550 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7aa74e-3c9f-4e48-9823-3bf4e2d93d92 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:20.772899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7aa74e-3c9f-4e48-9823-3bf4e2d93d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:20.798350 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3a7aa74e-3c9f-4e48-9823-3bf4e2d93d92 None None] MFA Rules not processed for user `182eec86daa44cd48d6ef1c38f58e89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:20.799949 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3a7aa74e-3c9f-4e48-9823-3bf4e2d93d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:20.866152 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1201/2383] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 10 13:21:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:20.878863 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b20d7-815f-4aef-87b6-30efaf1c4793 service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:20.880396 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-0d2b20d7-815f-4aef-87b6-30efaf1c4793 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:20.932456 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:20.955808 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b20d7-815f-4aef-87b6-30efaf1c4793 service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:20.961464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d6d8b-f837-471b-912d-fb29dd09a42b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c86ef66c9564e0395c325a84ca9c4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:20.962106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d6d8b-f837-471b-912d-fb29dd09a42b service swift] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:20.962388 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d6d8b-f837-471b-912d-fb29dd09a42b service swift] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:20.962661 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d6d8b-f837-471b-912d-fb29dd09a42b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:20.971778 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d6d8b-f837-471b-912d-fb29dd09a42b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:20.973400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d6d8b-f837-471b-912d-fb29dd09a42b service swift] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:20.982711 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1183/2384] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 10 13:21:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 13:21:30.859066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=32 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:30.979424 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=10 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:35.684640 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7aa74e-3c9f-4e48-9823-3bf4e2d93d92 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:35.685985 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3a7aa74e-3c9f-4e48-9823-3bf4e2d93d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:35.698286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7aa74e-3c9f-4e48-9823-3bf4e2d93d92 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:35.702202 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa62d71-9df6-410b-a227-5288d9ae501a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:35.702820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa62d71-9df6-410b-a227-5288d9ae501a service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:35.703136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa62d71-9df6-410b-a227-5288d9ae501a service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:35.703411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa62d71-9df6-410b-a227-5288d9ae501a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:35.705225 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4aa62d71-9df6-410b-a227-5288d9ae501a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:35.716501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa62d71-9df6-410b-a227-5288d9ae501a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:35.717958 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa62d71-9df6-410b-a227-5288d9ae501a service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:35.726588 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1202/2385] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:21:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:21:37.475235 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ea1c1-36eb-4a36-a96a-15fe8540385d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:37.476481 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ea1c1-36eb-4a36-a96a-15fe8540385d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:37.476481 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ea1c1-36eb-4a36-a96a-15fe8540385d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:37.496267 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-f04ea1c1-36eb-4a36-a96a-15fe8540385d None None] MFA Rules not processed for user `182eec86daa44cd48d6ef1c38f58e89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:37.497555 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-f04ea1c1-36eb-4a36-a96a-15fe8540385d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:37.504787 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1184/2386] 10.222.0.46 () {58 vars in 967 bytes} [Wed Aug 10 13:21:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:37.517111 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa62d71-9df6-410b-a227-5288d9ae501a service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:37.529322 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa62d71-9df6-410b-a227-5288d9ae501a service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:37.534216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c13833-cd52-43e4-99f3-d851570ec9b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c86ef66c9564e0395c325a84ca9c4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:37.534795 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13833-cd52-43e4-99f3-d851570ec9b9 service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:37.535093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13833-cd52-43e4-99f3-d851570ec9b9 service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:37.535423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13833-cd52-43e4-99f3-d851570ec9b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:37.543866 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c13833-cd52-43e4-99f3-d851570ec9b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:37.545432 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c13833-cd52-43e4-99f3-d851570ec9b9 service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:37.553635 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1203/2387] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 10 13:21:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 13:21:42.388031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ea1c1-36eb-4a36-a96a-15fe8540385d None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:42.450274 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ea1c1-36eb-4a36-a96a-15fe8540385d None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:42.454965 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c10de-f061-4f62-87ae-b8214cdbd5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:42.455614 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c10de-f061-4f62-87ae-b8214cdbd5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:42.455894 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c10de-f061-4f62-87ae-b8214cdbd5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:42.456169 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c10de-f061-4f62-87ae-b8214cdbd5a0 admin admin] PATH_INFO: `/v3/users/c21467a7c1af4cc1a6d3d81c89aa87f5` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:42.457275 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c10de-f061-4f62-87ae-b8214cdbd5a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21467a7c1af4cc1a6d3d81c89aa87f5)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:42.459496 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c10de-f061-4f62-87ae-b8214cdbd5a0 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:42.506739 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b50c10de-f061-4f62-87ae-b8214cdbd5a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21467a7c1af4cc1a6d3d81c89aa87f5'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:42.507447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b50c10de-f061-4f62-87ae-b8214cdbd5a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21467a7c1af4cc1a6d3d81c89aa87f5'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:42.514921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b50c10de-f061-4f62-87ae-b8214cdbd5a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21467a7c1af4cc1a6d3d81c89aa87f5'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:42.522210 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b50c10de-f061-4f62-87ae-b8214cdbd5a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21467a7c1af4cc1a6d3d81c89aa87f5'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:42.534019 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b50c10de-f061-4f62-87ae-b8214cdbd5a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21467a7c1af4cc1a6d3d81c89aa87f5'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:42.540502 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1185/2388] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:21:42 2022] DELETE /identity/v3/users/c21467a7c1af4cc1a6d3d81c89aa87f5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:21:42.545000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4e3c7-0d60-4df1-8ca8-550d9164414f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:42.545491 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4e3c7-0d60-4df1-8ca8-550d9164414f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:42.545586 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4e3c7-0d60-4df1-8ca8-550d9164414f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:42.564558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ccc4e3c7-0d60-4df1-8ca8-550d9164414f None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:42.565764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ccc4e3c7-0d60-4df1-8ca8-550d9164414f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:42.623329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1204/2389] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:42.632944 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c10de-f061-4f62-87ae-b8214cdbd5a0 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:42.634335 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-b50c10de-f061-4f62-87ae-b8214cdbd5a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:42.691445 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c10de-f061-4f62-87ae-b8214cdbd5a0 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:42.695263 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a42d33-9ab2-4633-bcb3-0203f39f72c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:42.695865 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a42d33-9ab2-4633-bcb3-0203f39f72c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:42.696138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a42d33-9ab2-4633-bcb3-0203f39f72c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:42.696406 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a42d33-9ab2-4633-bcb3-0203f39f72c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:42.705506 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a42d33-9ab2-4633-bcb3-0203f39f72c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:42.706915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a42d33-9ab2-4633-bcb3-0203f39f72c6 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:42.716549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1186/2390] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:21:42.999530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4e3c7-0d60-4df1-8ca8-550d9164414f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:43.001083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ccc4e3c7-0d60-4df1-8ca8-550d9164414f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:43.013734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4e3c7-0d60-4df1-8ca8-550d9164414f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:43.018421 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ab478-5cc9-4615-8ec6-6221337f63ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:43.019085 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ab478-5cc9-4615-8ec6-6221337f63ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:43.019368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ab478-5cc9-4615-8ec6-6221337f63ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:43.019643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ab478-5cc9-4615-8ec6-6221337f63ff admin admin] PATH_INFO: `/v3/projects/0bcd454ea6d446e4b85d299a2087cf45` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:43.020892 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ab478-5cc9-4615-8ec6-6221337f63ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bcd454ea6d446e4b85d299a2087cf45)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:43.023371 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ab478-5cc9-4615-8ec6-6221337f63ff admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:43.076512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1c7ab478-5cc9-4615-8ec6-6221337f63ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bcd454ea6d446e4b85d299a2087cf45', 'request_id': 'req-1c7ab478-5cc9-4615-8ec6-6221337f63ff'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:43.083907 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1c7ab478-5cc9-4615-8ec6-6221337f63ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bcd454ea6d446e4b85d299a2087cf45', 'request_id': 'req-1c7ab478-5cc9-4615-8ec6-6221337f63ff'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:43.090560 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1c7ab478-5cc9-4615-8ec6-6221337f63ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bcd454ea6d446e4b85d299a2087cf45', 'request_id': 'req-1c7ab478-5cc9-4615-8ec6-6221337f63ff'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:43.101162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1c7ab478-5cc9-4615-8ec6-6221337f63ff admin admin] The token cache is being invalidate because project 0bcd454ea6d446e4b85d299a2087cf45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:21:43.101490 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1c7ab478-5cc9-4615-8ec6-6221337f63ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:43.102103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1c7ab478-5cc9-4615-8ec6-6221337f63ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:21:43.103615 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1205/2391] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:21:42 2022] DELETE /identity/v3/projects/0bcd454ea6d446e4b85d299a2087cf45 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:21:43.108492 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a6f43-1a0b-4fe2-aab3-d9ae4eddcb72 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:43.108782 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a6f43-1a0b-4fe2-aab3-d9ae4eddcb72 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:43.109055 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a6f43-1a0b-4fe2-aab3-d9ae4eddcb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:43.129371 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-a45a6f43-1a0b-4fe2-aab3-d9ae4eddcb72 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:43.130500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-a45a6f43-1a0b-4fe2-aab3-d9ae4eddcb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:43.140421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:43.191386 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1187/2392] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:43.199811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef4ea5-6d26-4ab6-8ffb-2bb53e28646a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:43.200119 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef4ea5-6d26-4ab6-8ffb-2bb53e28646a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:43.200391 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef4ea5-6d26-4ab6-8ffb-2bb53e28646a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:43.220524 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fdef4ea5-6d26-4ab6-8ffb-2bb53e28646a None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:43.221724 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fdef4ea5-6d26-4ab6-8ffb-2bb53e28646a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:43.230064 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1206/2393] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:43.234410 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a6f43-1a0b-4fe2-aab3-d9ae4eddcb72 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:43.244790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a6f43-1a0b-4fe2-aab3-d9ae4eddcb72 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:43.249375 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73589046-ba02-458d-8b44-345de9a89763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:43.249978 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73589046-ba02-458d-8b44-345de9a89763 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:43.250253 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73589046-ba02-458d-8b44-345de9a89763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:43.250523 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73589046-ba02-458d-8b44-345de9a89763 admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:43.251199 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73589046-ba02-458d-8b44-345de9a89763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:21:43.251500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73589046-ba02-458d-8b44-345de9a89763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:43.253083 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73589046-ba02-458d-8b44-345de9a89763 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:43.265642 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1188/2394] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:21:43.270080 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef4ea5-6d26-4ab6-8ffb-2bb53e28646a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:43.280246 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef4ea5-6d26-4ab6-8ffb-2bb53e28646a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:43.284998 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df520d-385c-4971-96ba-b9f9e85f6a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:43.285609 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df520d-385c-4971-96ba-b9f9e85f6a85 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:43.285890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df520d-385c-4971-96ba-b9f9e85f6a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:43.286160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df520d-385c-4971-96ba-b9f9e85f6a85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:43.286797 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df520d-385c-4971-96ba-b9f9e85f6a85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:43.288761 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df520d-385c-4971-96ba-b9f9e85f6a85 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:43.318024 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1207/2395] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:21:43 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:21:43.322409 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73589046-ba02-458d-8b44-345de9a89763 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:43.333082 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73589046-ba02-458d-8b44-345de9a89763 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:43.395508 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2dc8a1-1d26-48fa-b774-9cac0db54177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:43.396172 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dc8a1-1d26-48fa-b774-9cac0db54177 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:43.396311 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dc8a1-1d26-48fa-b774-9cac0db54177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:43.396580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dc8a1-1d26-48fa-b774-9cac0db54177 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:43.398038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2dc8a1-1d26-48fa-b774-9cac0db54177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:43.400086 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2dc8a1-1d26-48fa-b774-9cac0db54177 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:43.422101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1189/2396] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:21:43 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:21:43.426272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df520d-385c-4971-96ba-b9f9e85f6a85 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:43.436510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df520d-385c-4971-96ba-b9f9e85f6a85 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:43.441076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e637e6-4dc4-40eb-8192-50a100cf14f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:43.441688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e637e6-4dc4-40eb-8192-50a100cf14f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:43.441950 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e637e6-4dc4-40eb-8192-50a100cf14f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:43.442222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e637e6-4dc4-40eb-8192-50a100cf14f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:43.442858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e637e6-4dc4-40eb-8192-50a100cf14f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:43.445015 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e637e6-4dc4-40eb-8192-50a100cf14f8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:43.454767 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1208/2397] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:21:43.459194 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2dc8a1-1d26-48fa-b774-9cac0db54177 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:43.469476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2dc8a1-1d26-48fa-b774-9cac0db54177 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:43.474081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46839e6-7087-435b-9c23-61b30fcd0863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:43.474703 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46839e6-7087-435b-9c23-61b30fcd0863 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:43.475173 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46839e6-7087-435b-9c23-61b30fcd0863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:43.475486 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46839e6-7087-435b-9c23-61b30fcd0863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:43.476693 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46839e6-7087-435b-9c23-61b30fcd0863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:43.478265 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46839e6-7087-435b-9c23-61b30fcd0863 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:43.488836 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1190/2398] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:21:43.493764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e637e6-4dc4-40eb-8192-50a100cf14f8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:43.504094 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e637e6-4dc4-40eb-8192-50a100cf14f8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:43.508765 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82df46-2ff3-4400-be7c-c6a7b13f72c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:43.509405 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82df46-2ff3-4400-be7c-c6a7b13f72c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:43.509678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82df46-2ff3-4400-be7c-c6a7b13f72c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:43.509949 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82df46-2ff3-4400-be7c-c6a7b13f72c3 admin admin] PATH_INFO: `/v3/projects/91f0de74bdef440cbbcf6c932687aeba/users/1d0c375aeddb41c5bb7a8174b6efcc4f/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:43.524481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82df46-2ff3-4400-be7c-c6a7b13f72c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91f0de74bdef440cbbcf6c932687aeba, user_id=1d0c375aeddb41c5bb7a8174b6efcc4f, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:43.527146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82df46-2ff3-4400-be7c-c6a7b13f72c3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:43.529310 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:43.540843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1209/2399] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:21:43 2022] PUT /identity/v3/projects/91f0de74bdef440cbbcf6c932687aeba/users/1d0c375aeddb41c5bb7a8174b6efcc4f/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:21:43.548649 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83818d56-d28b-4cca-a4ba-b1627b1f802e None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:43.548649 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83818d56-d28b-4cca-a4ba-b1627b1f802e None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:43.548649 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83818d56-d28b-4cca-a4ba-b1627b1f802e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:43.566985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-83818d56-d28b-4cca-a4ba-b1627b1f802e None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:43.568201 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-83818d56-d28b-4cca-a4ba-b1627b1f802e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:43.625291 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1191/2400] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:43.635160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82df46-2ff3-4400-be7c-c6a7b13f72c3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:43.636973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9d82df46-2ff3-4400-be7c-c6a7b13f72c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:43.693653 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82df46-2ff3-4400-be7c-c6a7b13f72c3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:43.697191 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68aae8d-d358-413f-aa9c-6b3125b10c6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:43.697792 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68aae8d-d358-413f-aa9c-6b3125b10c6a service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:43.698075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68aae8d-d358-413f-aa9c-6b3125b10c6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:43.698351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68aae8d-d358-413f-aa9c-6b3125b10c6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:43.707306 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68aae8d-d358-413f-aa9c-6b3125b10c6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:43.708993 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68aae8d-d358-413f-aa9c-6b3125b10c6a service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:43.719067 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1210/2401] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:21:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:21:44.367145 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db0a6e-4cc4-44f5-8235-3dc183161feb None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:44.367431 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db0a6e-4cc4-44f5-8235-3dc183161feb None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:44.367709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db0a6e-4cc4-44f5-8235-3dc183161feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:44.396413 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-c3db0a6e-4cc4-44f5-8235-3dc183161feb None None] MFA Rules not processed for user `1d0c375aeddb41c5bb7a8174b6efcc4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:44.397664 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c3db0a6e-4cc4-44f5-8235-3dc183161feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:44.407813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:44.474308 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1192/2402] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:44.485365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68aae8d-d358-413f-aa9c-6b3125b10c6a service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:44.486756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a68aae8d-d358-413f-aa9c-6b3125b10c6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:44.548078 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68aae8d-d358-413f-aa9c-6b3125b10c6a service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:44.551812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0293f-d566-41a3-9005-2a9bd0600f2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:44.552510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0293f-d566-41a3-9005-2a9bd0600f2d service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:44.552863 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0293f-d566-41a3-9005-2a9bd0600f2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:44.552965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0293f-d566-41a3-9005-2a9bd0600f2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:44.563345 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0293f-d566-41a3-9005-2a9bd0600f2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:44.564794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0293f-d566-41a3-9005-2a9bd0600f2d service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:44.574208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1211/2403] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:21:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:21:44.840516 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db0a6e-4cc4-44f5-8235-3dc183161feb None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:44.841943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c3db0a6e-4cc4-44f5-8235-3dc183161feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:44.930518 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db0a6e-4cc4-44f5-8235-3dc183161feb None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:44.936617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d7ea2-2ab1-4f85-89d7-b76fd71decc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:44.937214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d7ea2-2ab1-4f85-89d7-b76fd71decc9 service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:44.937492 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d7ea2-2ab1-4f85-89d7-b76fd71decc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:44.937760 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d7ea2-2ab1-4f85-89d7-b76fd71decc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:44.939534 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-af3d7ea2-2ab1-4f85-89d7-b76fd71decc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:45.002426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d7ea2-2ab1-4f85-89d7-b76fd71decc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:45.004053 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d7ea2-2ab1-4f85-89d7-b76fd71decc9 service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:45.013213 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1193/2404] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:21:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:21:46.000089 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b431ec2-5155-4f99-86f3-8de659e3b3ea None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:46.000608 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b431ec2-5155-4f99-86f3-8de659e3b3ea None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:46.000608 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b431ec2-5155-4f99-86f3-8de659e3b3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:46.019421 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6b431ec2-5155-4f99-86f3-8de659e3b3ea None None] MFA Rules not processed for user `1d0c375aeddb41c5bb7a8174b6efcc4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:21:46.020600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6b431ec2-5155-4f99-86f3-8de659e3b3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:46.027283 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1212/2405] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:21:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:21:46.260978 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d7ea2-2ab1-4f85-89d7-b76fd71decc9 service nova] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:46.270864 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d7ea2-2ab1-4f85-89d7-b76fd71decc9 service nova] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:46.275964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4ee83-77d4-4bf5-ae97-5e2d26365c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:46.276766 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4ee83-77d4-4bf5-ae97-5e2d26365c5f service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:46.277043 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4ee83-77d4-4bf5-ae97-5e2d26365c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:46.277312 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4ee83-77d4-4bf5-ae97-5e2d26365c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:46.279054 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-86d4ee83-77d4-4bf5-ae97-5e2d26365c5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:46.289460 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4ee83-77d4-4bf5-ae97-5e2d26365c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:46.290875 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4ee83-77d4-4bf5-ae97-5e2d26365c5f service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:46.299591 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1194/2406] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:21:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:21:46.658848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b431ec2-5155-4f99-86f3-8de659e3b3ea None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:46.660751 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6b431ec2-5155-4f99-86f3-8de659e3b3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:46.757486 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b431ec2-5155-4f99-86f3-8de659e3b3ea None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:46.762631 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d4a2e-1b89-4890-8b84-16fa63be109a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15780b69faa745e9b99f1fffb6abe231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:46.763288 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d4a2e-1b89-4890-8b84-16fa63be109a service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:46.763589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d4a2e-1b89-4890-8b84-16fa63be109a service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:46.763843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d4a2e-1b89-4890-8b84-16fa63be109a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:46.765609 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f52d4a2e-1b89-4890-8b84-16fa63be109a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:46.778482 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d4a2e-1b89-4890-8b84-16fa63be109a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:46.780188 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d4a2e-1b89-4890-8b84-16fa63be109a service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:46.791771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1213/2407] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:21:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:21:50.228278 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4ee83-77d4-4bf5-ae97-5e2d26365c5f service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:50.246774 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4ee83-77d4-4bf5-ae97-5e2d26365c5f service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:50.253400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f87eb-9398-4aff-926c-277596a9ce47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:50.254447 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f87eb-9398-4aff-926c-277596a9ce47 service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:50.254930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f87eb-9398-4aff-926c-277596a9ce47 service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:50.255255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f87eb-9398-4aff-926c-277596a9ce47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:50.259646 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-530f87eb-9398-4aff-926c-277596a9ce47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:50.278667 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f87eb-9398-4aff-926c-277596a9ce47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:50.280848 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f87eb-9398-4aff-926c-277596a9ce47 service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:50.293152 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1195/2408] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:21:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:21:54.238573 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d4a2e-1b89-4890-8b84-16fa63be109a service placement] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:54.251646 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d4a2e-1b89-4890-8b84-16fa63be109a service placement] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:54.257615 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811476d0-27f5-46cb-95d2-a3e5805ceed8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:54.258232 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811476d0-27f5-46cb-95d2-a3e5805ceed8 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:54.258513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811476d0-27f5-46cb-95d2-a3e5805ceed8 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:54.258785 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811476d0-27f5-46cb-95d2-a3e5805ceed8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:54.260664 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-811476d0-27f5-46cb-95d2-a3e5805ceed8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:54.274350 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811476d0-27f5-46cb-95d2-a3e5805ceed8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:54.276103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811476d0-27f5-46cb-95d2-a3e5805ceed8 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:54.288658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1214/2409] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:21:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:21:57.489536 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f87eb-9398-4aff-926c-277596a9ce47 service nova] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:57.492001 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-530f87eb-9398-4aff-926c-277596a9ce47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:57.508380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f87eb-9398-4aff-926c-277596a9ce47 service nova] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:57.514532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2b4e6-6170-4af0-a71b-45b9a31ee647 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:57.515303 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b4e6-6170-4af0-a71b-45b9a31ee647 service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:57.515662 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b4e6-6170-4af0-a71b-45b9a31ee647 service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:57.516049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b4e6-6170-4af0-a71b-45b9a31ee647 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:57.518005 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-9fb2b4e6-6170-4af0-a71b-45b9a31ee647 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:57.530829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2b4e6-6170-4af0-a71b-45b9a31ee647 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:57.532435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2b4e6-6170-4af0-a71b-45b9a31ee647 service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:57.544019 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1196/2410] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:21:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:21:59.787351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811476d0-27f5-46cb-95d2-a3e5805ceed8 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:21:59.788790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-811476d0-27f5-46cb-95d2-a3e5805ceed8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:59.800721 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811476d0-27f5-46cb-95d2-a3e5805ceed8 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:21:59.804361 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5fc3e-3338-42d8-80a7-4f056b85bbfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:21:59.804959 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5fc3e-3338-42d8-80a7-4f056b85bbfb service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:21:59.805237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5fc3e-3338-42d8-80a7-4f056b85bbfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:21:59.805509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5fc3e-3338-42d8-80a7-4f056b85bbfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:21:59.807236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ced5fc3e-3338-42d8-80a7-4f056b85bbfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:21:59.816549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:21:59.819479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5fc3e-3338-42d8-80a7-4f056b85bbfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:21:59.821417 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5fc3e-3338-42d8-80a7-4f056b85bbfb service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:21:59.831725 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1215/2411] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:21:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:04.060135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2b4e6-6170-4af0-a71b-45b9a31ee647 service nova] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:04.060135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-9fb2b4e6-6170-4af0-a71b-45b9a31ee647 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:04.082695 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2b4e6-6170-4af0-a71b-45b9a31ee647 service nova] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:04.088597 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a67a8-67f8-4ebe-8b2e-a8c2d20460de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:04.089282 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a67a8-67f8-4ebe-8b2e-a8c2d20460de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:04.089555 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a67a8-67f8-4ebe-8b2e-a8c2d20460de admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:04.089986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a67a8-67f8-4ebe-8b2e-a8c2d20460de admin admin] PATH_INFO: `/v3/users/0ed48747fc084496ba252279614be4c2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:04.091581 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a67a8-67f8-4ebe-8b2e-a8c2d20460de admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ed48747fc084496ba252279614be4c2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:04.093762 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a67a8-67f8-4ebe-8b2e-a8c2d20460de admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:04.097060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:04.173326 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-024a67a8-67f8-4ebe-8b2e-a8c2d20460de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ed48747fc084496ba252279614be4c2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:04.173999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-024a67a8-67f8-4ebe-8b2e-a8c2d20460de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ed48747fc084496ba252279614be4c2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:04.190528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-024a67a8-67f8-4ebe-8b2e-a8c2d20460de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ed48747fc084496ba252279614be4c2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:04.200773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-024a67a8-67f8-4ebe-8b2e-a8c2d20460de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ed48747fc084496ba252279614be4c2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:04.218699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-024a67a8-67f8-4ebe-8b2e-a8c2d20460de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ed48747fc084496ba252279614be4c2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:04.225211 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1197/2412] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:22:04 2022] DELETE /identity/v3/users/0ed48747fc084496ba252279614be4c2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:04.641581 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5fc3e-3338-42d8-80a7-4f056b85bbfb service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:04.652422 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5fc3e-3338-42d8-80a7-4f056b85bbfb service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:04.723353 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f64f47-becb-4576-9170-a68fc8345a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:04.724164 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f64f47-becb-4576-9170-a68fc8345a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:04.724577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f64f47-becb-4576-9170-a68fc8345a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:04.724972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f64f47-becb-4576-9170-a68fc8345a65 admin admin] PATH_INFO: `/v3/projects/c8d1b71ba4814b6da8dd056018684ce1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:04.726359 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f64f47-becb-4576-9170-a68fc8345a65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d1b71ba4814b6da8dd056018684ce1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:04.728449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f64f47-becb-4576-9170-a68fc8345a65 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:04.793206 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4f64f47-becb-4576-9170-a68fc8345a65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d1b71ba4814b6da8dd056018684ce1', 'request_id': 'req-a4f64f47-becb-4576-9170-a68fc8345a65'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:04.801184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4f64f47-becb-4576-9170-a68fc8345a65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d1b71ba4814b6da8dd056018684ce1', 'request_id': 'req-a4f64f47-becb-4576-9170-a68fc8345a65'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:04.808446 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4f64f47-becb-4576-9170-a68fc8345a65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d1b71ba4814b6da8dd056018684ce1', 'request_id': 'req-a4f64f47-becb-4576-9170-a68fc8345a65'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:04.820741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4f64f47-becb-4576-9170-a68fc8345a65 admin admin] The token cache is being invalidate because project c8d1b71ba4814b6da8dd056018684ce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:22:04.820992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4f64f47-becb-4576-9170-a68fc8345a65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:04.821739 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a4f64f47-becb-4576-9170-a68fc8345a65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:04.825457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1216/2413] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:22:04 2022] DELETE /identity/v3/projects/c8d1b71ba4814b6da8dd056018684ce1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:04.830376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23083dc-090a-4fad-8b1a-20934b1f8594 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:04.830663 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23083dc-090a-4fad-8b1a-20934b1f8594 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:04.830969 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23083dc-090a-4fad-8b1a-20934b1f8594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:04.854825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-a23083dc-090a-4fad-8b1a-20934b1f8594 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:04.857289 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-a23083dc-090a-4fad-8b1a-20934b1f8594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:04.947746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1198/2414] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:04.956474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6724a-886f-4ffd-93c9-6a5fd6308046 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:04.956756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6724a-886f-4ffd-93c9-6a5fd6308046 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:04.957030 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6724a-886f-4ffd-93c9-6a5fd6308046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:04.986171 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5ab6724a-886f-4ffd-93c9-6a5fd6308046 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:04.987666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5ab6724a-886f-4ffd-93c9-6a5fd6308046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:04.998591 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1217/2415] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:05.002957 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23083dc-090a-4fad-8b1a-20934b1f8594 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:05.015114 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23083dc-090a-4fad-8b1a-20934b1f8594 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:05.020299 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfa31a-a610-4643-884e-0d1dac6aaff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:05.020905 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfa31a-a610-4643-884e-0d1dac6aaff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:05.021177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfa31a-a610-4643-884e-0d1dac6aaff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:05.021463 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfa31a-a610-4643-884e-0d1dac6aaff2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:05.022107 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfa31a-a610-4643-884e-0d1dac6aaff2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:22:05.022407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfa31a-a610-4643-884e-0d1dac6aaff2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:05.024155 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfa31a-a610-4643-884e-0d1dac6aaff2 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:05.036697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1199/2416] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:22:05.042110 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6724a-886f-4ffd-93c9-6a5fd6308046 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:05.051471 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6724a-886f-4ffd-93c9-6a5fd6308046 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:05.056969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c722249-7ecc-4a26-a191-b02ae144df16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:05.057570 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c722249-7ecc-4a26-a191-b02ae144df16 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:05.057857 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c722249-7ecc-4a26-a191-b02ae144df16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:05.058130 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c722249-7ecc-4a26-a191-b02ae144df16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:05.058754 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c722249-7ecc-4a26-a191-b02ae144df16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:05.060734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c722249-7ecc-4a26-a191-b02ae144df16 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:05.090033 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1218/2417] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:22:05 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:05.094223 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfa31a-a610-4643-884e-0d1dac6aaff2 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:05.105101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfa31a-a610-4643-884e-0d1dac6aaff2 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:05.164023 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abea30-9660-48be-bdc4-56493428355a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:05.164627 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abea30-9660-48be-bdc4-56493428355a admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:05.164930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abea30-9660-48be-bdc4-56493428355a admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:05.165157 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abea30-9660-48be-bdc4-56493428355a admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:05.165772 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abea30-9660-48be-bdc4-56493428355a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:05.167776 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abea30-9660-48be-bdc4-56493428355a admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:05.184675 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:05.191879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1200/2418] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:22:05 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:05.196216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c722249-7ecc-4a26-a191-b02ae144df16 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:05.206647 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c722249-7ecc-4a26-a191-b02ae144df16 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:05.211772 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654720e0-d751-49a7-93a2-6fda29616ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:05.212370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654720e0-d751-49a7-93a2-6fda29616ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:05.212655 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654720e0-d751-49a7-93a2-6fda29616ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:05.212928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654720e0-d751-49a7-93a2-6fda29616ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:05.213571 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654720e0-d751-49a7-93a2-6fda29616ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:05.215203 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654720e0-d751-49a7-93a2-6fda29616ec9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:05.225707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1219/2419] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:05.229830 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abea30-9660-48be-bdc4-56493428355a admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:05.239664 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abea30-9660-48be-bdc4-56493428355a admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:05.244896 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8a4d7-ed7e-4806-bf24-26783271e5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:05.245484 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8a4d7-ed7e-4806-bf24-26783271e5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:05.245766 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8a4d7-ed7e-4806-bf24-26783271e5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:05.246038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8a4d7-ed7e-4806-bf24-26783271e5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:05.246667 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8a4d7-ed7e-4806-bf24-26783271e5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:05.248276 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8a4d7-ed7e-4806-bf24-26783271e5f7 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:05.259527 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1201/2420] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:05.263867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654720e0-d751-49a7-93a2-6fda29616ec9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:05.275255 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654720e0-d751-49a7-93a2-6fda29616ec9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:05.286637 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079748c-c454-4a08-8fa1-cd65bac54a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:05.287913 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079748c-c454-4a08-8fa1-cd65bac54a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:05.288193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079748c-c454-4a08-8fa1-cd65bac54a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:05.288664 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079748c-c454-4a08-8fa1-cd65bac54a3e admin admin] PATH_INFO: `/v3/projects/b5901b84626b42008d30df496f48c834/users/ab5473abfec94015abe51ec51ac6afd4/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:05.304579 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079748c-c454-4a08-8fa1-cd65bac54a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5901b84626b42008d30df496f48c834, user_id=ab5473abfec94015abe51ec51ac6afd4, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:05.307330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079748c-c454-4a08-8fa1-cd65bac54a3e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:05.321591 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1220/2421] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:05 2022] PUT /identity/v3/projects/b5901b84626b42008d30df496f48c834/users/ab5473abfec94015abe51ec51ac6afd4/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:05.333344 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11aca7-2066-4a20-a49e-78099bf6898f None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:05.333597 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11aca7-2066-4a20-a49e-78099bf6898f None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:05.333780 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11aca7-2066-4a20-a49e-78099bf6898f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:05.364904 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-3f11aca7-2066-4a20-a49e-78099bf6898f None None] MFA Rules not processed for user `ab5473abfec94015abe51ec51ac6afd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:05.369706 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3f11aca7-2066-4a20-a49e-78099bf6898f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:05.429133 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1202/2422] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:05.433625 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079748c-c454-4a08-8fa1-cd65bac54a3e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:05.459020 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:05.496243 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079748c-c454-4a08-8fa1-cd65bac54a3e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:05.500856 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bf6e9-088a-426c-a4c8-e012f89de1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:05.501460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bf6e9-088a-426c-a4c8-e012f89de1ea admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:05.501736 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bf6e9-088a-426c-a4c8-e012f89de1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:05.502005 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bf6e9-088a-426c-a4c8-e012f89de1ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:05.502613 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312bf6e9-088a-426c-a4c8-e012f89de1ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:05.504532 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312bf6e9-088a-426c-a4c8-e012f89de1ea admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:05.545848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1221/2423] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:22:05 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:22:05.550426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11aca7-2066-4a20-a49e-78099bf6898f None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:05.561671 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11aca7-2066-4a20-a49e-78099bf6898f None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:05.618284 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3b2a8-206a-4f39-a509-18600da983ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:05.618797 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3b2a8-206a-4f39-a509-18600da983ec admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:05.619100 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3b2a8-206a-4f39-a509-18600da983ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:05.619369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3b2a8-206a-4f39-a509-18600da983ec admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:05.619989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3b2a8-206a-4f39-a509-18600da983ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:05.621887 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3b2a8-206a-4f39-a509-18600da983ec admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:05.648831 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1203/2424] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:22:05 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:05.652767 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bf6e9-088a-426c-a4c8-e012f89de1ea admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:05.663411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bf6e9-088a-426c-a4c8-e012f89de1ea admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:05.667939 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ea248-f6a9-45ea-b925-781b4c303caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:05.668527 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ea248-f6a9-45ea-b925-781b4c303caa admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:05.668800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ea248-f6a9-45ea-b925-781b4c303caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:05.669067 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ea248-f6a9-45ea-b925-781b4c303caa admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:05.669698 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ea248-f6a9-45ea-b925-781b4c303caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:05.671307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ea248-f6a9-45ea-b925-781b4c303caa admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:05.682478 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1222/2425] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:22:05.686871 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3b2a8-206a-4f39-a509-18600da983ec admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:05.697058 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3b2a8-206a-4f39-a509-18600da983ec admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:05.701569 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db0fde-a915-4d13-9ea8-c42d52040ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:05.702202 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db0fde-a915-4d13-9ea8-c42d52040ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:05.702476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db0fde-a915-4d13-9ea8-c42d52040ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:05.702746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db0fde-a915-4d13-9ea8-c42d52040ea1 admin admin] PATH_INFO: `/v3/projects/217633d6ec3d4912a4b5faa1b8b2c2e1/users/482c444f06ea43d793037e2e6dee8720/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:05.717541 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db0fde-a915-4d13-9ea8-c42d52040ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=217633d6ec3d4912a4b5faa1b8b2c2e1, user_id=482c444f06ea43d793037e2e6dee8720, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:05.720200 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db0fde-a915-4d13-9ea8-c42d52040ea1 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:05.734318 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1204/2426] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:05 2022] PUT /identity/v3/projects/217633d6ec3d4912a4b5faa1b8b2c2e1/users/482c444f06ea43d793037e2e6dee8720/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:05.738825 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ea248-f6a9-45ea-b925-781b4c303caa admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:05.750202 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ea248-f6a9-45ea-b925-781b4c303caa admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:05.810297 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0a88a-969a-4bc4-bfca-878c489a1e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:05.810892 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0a88a-969a-4bc4-bfca-878c489a1e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:05.811275 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0a88a-969a-4bc4-bfca-878c489a1e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:05.811548 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0a88a-969a-4bc4-bfca-878c489a1e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:05.812187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0a88a-969a-4bc4-bfca-878c489a1e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:05.813810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0a88a-969a-4bc4-bfca-878c489a1e96 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:05.823449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1223/2427] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:05.827685 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db0fde-a915-4d13-9ea8-c42d52040ea1 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:05.838203 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db0fde-a915-4d13-9ea8-c42d52040ea1 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:05.842832 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e1789-15cc-4806-bd5f-07aa8e90e0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:05.843512 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e1789-15cc-4806-bd5f-07aa8e90e0a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:05.843790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e1789-15cc-4806-bd5f-07aa8e90e0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:05.844064 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e1789-15cc-4806-bd5f-07aa8e90e0a8 admin admin] PATH_INFO: `/v3/projects/217633d6ec3d4912a4b5faa1b8b2c2e1/users/482c444f06ea43d793037e2e6dee8720/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:05.845972 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e1789-15cc-4806-bd5f-07aa8e90e0a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=217633d6ec3d4912a4b5faa1b8b2c2e1, user_id=482c444f06ea43d793037e2e6dee8720, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:05.848646 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e1789-15cc-4806-bd5f-07aa8e90e0a8 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:05.859315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1205/2428] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:05 2022] PUT /identity/v3/projects/217633d6ec3d4912a4b5faa1b8b2c2e1/users/482c444f06ea43d793037e2e6dee8720/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:05.870083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1f1cf-9f78-40a6-8d25-51db6076d21a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:05.870339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1f1cf-9f78-40a6-8d25-51db6076d21a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:05.870618 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1f1cf-9f78-40a6-8d25-51db6076d21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:05.897803 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-11b1f1cf-9f78-40a6-8d25-51db6076d21a None None] MFA Rules not processed for user `482c444f06ea43d793037e2e6dee8720`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:05.899068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-11b1f1cf-9f78-40a6-8d25-51db6076d21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:05.967608 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1224/2429] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:05.981721 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e1789-15cc-4806-bd5f-07aa8e90e0a8 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:05.984167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3a5e1789-15cc-4806-bd5f-07aa8e90e0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:06.017317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:06.045825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e1789-15cc-4806-bd5f-07aa8e90e0a8 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:06.053111 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecd12f-2471-40ae-80ee-55d6f5b5002b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:06.053728 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecd12f-2471-40ae-80ee-55d6f5b5002b service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:06.054005 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecd12f-2471-40ae-80ee-55d6f5b5002b service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:06.054279 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecd12f-2471-40ae-80ee-55d6f5b5002b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:06.063964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecd12f-2471-40ae-80ee-55d6f5b5002b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:06.065565 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecd12f-2471-40ae-80ee-55d6f5b5002b service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:06.076065 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1206/2430] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:06.160187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1f1cf-9f78-40a6-8d25-51db6076d21a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:06.170018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1f1cf-9f78-40a6-8d25-51db6076d21a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:06.173791 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9077715-c087-4b0f-942a-2a89d7259635 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:06.174415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9077715-c087-4b0f-942a-2a89d7259635 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:06.174697 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9077715-c087-4b0f-942a-2a89d7259635 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:06.174968 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9077715-c087-4b0f-942a-2a89d7259635 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:06.188740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:06.239621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9077715-c087-4b0f-942a-2a89d7259635 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:06.241632 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9077715-c087-4b0f-942a-2a89d7259635 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:06.250757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1225/2431] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:11.913507 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecd12f-2471-40ae-80ee-55d6f5b5002b service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:11.914960 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-78ecd12f-2471-40ae-80ee-55d6f5b5002b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:11.998719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecd12f-2471-40ae-80ee-55d6f5b5002b service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:12.003919 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09e9eb-c7d1-45e3-9fde-e0ad187b7116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:12.004548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09e9eb-c7d1-45e3-9fde-e0ad187b7116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:12.004987 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09e9eb-c7d1-45e3-9fde-e0ad187b7116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:12.005264 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09e9eb-c7d1-45e3-9fde-e0ad187b7116 admin admin] PATH_INFO: `/v3/users/db000fc481df44009c205493eb80eae2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:12.006415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09e9eb-c7d1-45e3-9fde-e0ad187b7116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db000fc481df44009c205493eb80eae2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:12.008908 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09e9eb-c7d1-45e3-9fde-e0ad187b7116 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:12.060859 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-bb09e9eb-c7d1-45e3-9fde-e0ad187b7116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db000fc481df44009c205493eb80eae2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:12.061474 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-bb09e9eb-c7d1-45e3-9fde-e0ad187b7116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db000fc481df44009c205493eb80eae2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:12.069938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-bb09e9eb-c7d1-45e3-9fde-e0ad187b7116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db000fc481df44009c205493eb80eae2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:12.077198 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-bb09e9eb-c7d1-45e3-9fde-e0ad187b7116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db000fc481df44009c205493eb80eae2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:12.090277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-bb09e9eb-c7d1-45e3-9fde-e0ad187b7116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db000fc481df44009c205493eb80eae2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:12.096232 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1207/2432] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:22:11 2022] DELETE /identity/v3/users/db000fc481df44009c205493eb80eae2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:12.290229 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9077715-c087-4b0f-942a-2a89d7259635 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:12.301794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9077715-c087-4b0f-942a-2a89d7259635 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:12.373877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57fb417-39d0-4835-bee9-e639c35777b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:12.374564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fb417-39d0-4835-bee9-e639c35777b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:12.374841 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fb417-39d0-4835-bee9-e639c35777b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:12.375229 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fb417-39d0-4835-bee9-e639c35777b9 admin admin] PATH_INFO: `/v3/projects/29cbccfdddfa4d08882cf5854af047d2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:12.376811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57fb417-39d0-4835-bee9-e639c35777b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29cbccfdddfa4d08882cf5854af047d2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:12.379823 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57fb417-39d0-4835-bee9-e639c35777b9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:12.431809 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d57fb417-39d0-4835-bee9-e639c35777b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29cbccfdddfa4d08882cf5854af047d2', 'request_id': 'req-d57fb417-39d0-4835-bee9-e639c35777b9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:12.440360 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d57fb417-39d0-4835-bee9-e639c35777b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29cbccfdddfa4d08882cf5854af047d2', 'request_id': 'req-d57fb417-39d0-4835-bee9-e639c35777b9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:12.447440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d57fb417-39d0-4835-bee9-e639c35777b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29cbccfdddfa4d08882cf5854af047d2', 'request_id': 'req-d57fb417-39d0-4835-bee9-e639c35777b9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:12.457675 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d57fb417-39d0-4835-bee9-e639c35777b9 admin admin] The token cache is being invalidate because project 29cbccfdddfa4d08882cf5854af047d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:22:12.458223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d57fb417-39d0-4835-bee9-e639c35777b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:12.458864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d57fb417-39d0-4835-bee9-e639c35777b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:12.460934 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1226/2433] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:22:12 2022] DELETE /identity/v3/projects/29cbccfdddfa4d08882cf5854af047d2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:12.466078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8096232-2418-497d-a0a3-873b8d0b667d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:12.466368 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8096232-2418-497d-a0a3-873b8d0b667d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:12.466635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8096232-2418-497d-a0a3-873b8d0b667d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:12.485364 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-a8096232-2418-497d-a0a3-873b8d0b667d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:12.486711 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-a8096232-2418-497d-a0a3-873b8d0b667d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:12.542465 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:12.561251 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1208/2434] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:12.569261 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1523144-d07d-4420-a81c-7c94af862cf6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:12.569515 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1523144-d07d-4420-a81c-7c94af862cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:12.569794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1523144-d07d-4420-a81c-7c94af862cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:12.591096 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d1523144-d07d-4420-a81c-7c94af862cf6 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:12.592388 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d1523144-d07d-4420-a81c-7c94af862cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:12.601122 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1227/2435] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:12.605691 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8096232-2418-497d-a0a3-873b8d0b667d None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:12.616062 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8096232-2418-497d-a0a3-873b8d0b667d None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:12.620933 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b402300-6796-44f3-a4db-dc4f21923066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:12.621629 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b402300-6796-44f3-a4db-dc4f21923066 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:12.621848 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b402300-6796-44f3-a4db-dc4f21923066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:12.622126 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b402300-6796-44f3-a4db-dc4f21923066 admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:12.622771 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b402300-6796-44f3-a4db-dc4f21923066 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:22:12.623101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b402300-6796-44f3-a4db-dc4f21923066 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:12.625063 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b402300-6796-44f3-a4db-dc4f21923066 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:12.637410 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1209/2436] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:22:12.641792 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1523144-d07d-4420-a81c-7c94af862cf6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:12.653199 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1523144-d07d-4420-a81c-7c94af862cf6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:12.658010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37778f42-3f1a-4356-a3a9-00f3564509a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:12.658610 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37778f42-3f1a-4356-a3a9-00f3564509a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:12.658891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37778f42-3f1a-4356-a3a9-00f3564509a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:12.659197 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37778f42-3f1a-4356-a3a9-00f3564509a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:12.659820 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37778f42-3f1a-4356-a3a9-00f3564509a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:12.661725 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37778f42-3f1a-4356-a3a9-00f3564509a6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:12.690835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1228/2437] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:22:12 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:12.694681 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b402300-6796-44f3-a4db-dc4f21923066 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:12.705599 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b402300-6796-44f3-a4db-dc4f21923066 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:12.763191 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f2ef3-9831-4cc0-a75b-f3c84e0a0fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:12.763793 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f2ef3-9831-4cc0-a75b-f3c84e0a0fac admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:12.764073 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f2ef3-9831-4cc0-a75b-f3c84e0a0fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:12.764349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f2ef3-9831-4cc0-a75b-f3c84e0a0fac admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:12.764964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f2ef3-9831-4cc0-a75b-f3c84e0a0fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:12.766962 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f2ef3-9831-4cc0-a75b-f3c84e0a0fac admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:12.788305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1210/2438] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:22:12 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:12.792515 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37778f42-3f1a-4356-a3a9-00f3564509a6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:12.802674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37778f42-3f1a-4356-a3a9-00f3564509a6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:12.807739 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cc5af-5522-4b0d-9e20-b9753e0845ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:12.808330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cc5af-5522-4b0d-9e20-b9753e0845ed admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:12.808604 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cc5af-5522-4b0d-9e20-b9753e0845ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:12.808879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cc5af-5522-4b0d-9e20-b9753e0845ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:12.809499 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757cc5af-5522-4b0d-9e20-b9753e0845ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:12.811124 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757cc5af-5522-4b0d-9e20-b9753e0845ed admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:12.820842 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1229/2439] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:12.825572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f2ef3-9831-4cc0-a75b-f3c84e0a0fac admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:12.836046 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f2ef3-9831-4cc0-a75b-f3c84e0a0fac admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:12.840733 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32900a-c6bf-412e-a72e-6dea5d7a6681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:12.841324 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32900a-c6bf-412e-a72e-6dea5d7a6681 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:12.841600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32900a-c6bf-412e-a72e-6dea5d7a6681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:12.841873 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32900a-c6bf-412e-a72e-6dea5d7a6681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:12.842501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32900a-c6bf-412e-a72e-6dea5d7a6681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:12.844105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32900a-c6bf-412e-a72e-6dea5d7a6681 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:12.855573 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1211/2440] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:12.867441 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cc5af-5522-4b0d-9e20-b9753e0845ed admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:12.881402 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cc5af-5522-4b0d-9e20-b9753e0845ed admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:12.889165 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc19bcd-9ae6-4f9c-a055-5b603b1c7767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:12.889778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc19bcd-9ae6-4f9c-a055-5b603b1c7767 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:12.890079 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc19bcd-9ae6-4f9c-a055-5b603b1c7767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:12.890410 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc19bcd-9ae6-4f9c-a055-5b603b1c7767 admin admin] PATH_INFO: `/v3/projects/2e0c7144a6764209a595e9f5475e2c5c/users/1f9df43796594c61a6587824ca162bfc/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:12.897706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:12.914689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc19bcd-9ae6-4f9c-a055-5b603b1c7767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e0c7144a6764209a595e9f5475e2c5c, user_id=1f9df43796594c61a6587824ca162bfc, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:12.917538 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc19bcd-9ae6-4f9c-a055-5b603b1c7767 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:12.932734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1230/2441] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:12 2022] PUT /identity/v3/projects/2e0c7144a6764209a595e9f5475e2c5c/users/1f9df43796594c61a6587824ca162bfc/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:12.943835 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2d401-97c4-44ad-bd19-09a2f90566e6 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:12.944334 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2d401-97c4-44ad-bd19-09a2f90566e6 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:12.944558 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2d401-97c4-44ad-bd19-09a2f90566e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:12.974729 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-d2a2d401-97c4-44ad-bd19-09a2f90566e6 None None] MFA Rules not processed for user `1f9df43796594c61a6587824ca162bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:12.976063 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d2a2d401-97c4-44ad-bd19-09a2f90566e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:13.045235 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1212/2442] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:13.048176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc19bcd-9ae6-4f9c-a055-5b603b1c7767 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:13.116539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc19bcd-9ae6-4f9c-a055-5b603b1c7767 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:13.121825 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79a0d8-0377-4e61-871e-2506cb30793d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:13.122422 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79a0d8-0377-4e61-871e-2506cb30793d admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:13.122700 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79a0d8-0377-4e61-871e-2506cb30793d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:13.122970 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79a0d8-0377-4e61-871e-2506cb30793d admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:13.123619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79a0d8-0377-4e61-871e-2506cb30793d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:13.125518 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79a0d8-0377-4e61-871e-2506cb30793d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:13.151503 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1231/2443] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:22:13 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:22:13.155502 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2d401-97c4-44ad-bd19-09a2f90566e6 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:13.166625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2d401-97c4-44ad-bd19-09a2f90566e6 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:13.210021 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:13.223436 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1348e-5f1c-44e4-be5a-bb0936e77269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:13.224042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1348e-5f1c-44e4-be5a-bb0936e77269 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:13.224351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1348e-5f1c-44e4-be5a-bb0936e77269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:13.224622 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1348e-5f1c-44e4-be5a-bb0936e77269 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:13.225246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1348e-5f1c-44e4-be5a-bb0936e77269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:13.227207 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1348e-5f1c-44e4-be5a-bb0936e77269 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:13.248835 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1213/2444] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:22:13 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:13.252917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79a0d8-0377-4e61-871e-2506cb30793d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:13.263195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79a0d8-0377-4e61-871e-2506cb30793d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:13.267835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57323355-38db-4d4b-8b2c-8fba76fa9e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:13.268427 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57323355-38db-4d4b-8b2c-8fba76fa9e0c admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:13.268708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57323355-38db-4d4b-8b2c-8fba76fa9e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:13.268979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57323355-38db-4d4b-8b2c-8fba76fa9e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:13.269624 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57323355-38db-4d4b-8b2c-8fba76fa9e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:13.271261 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57323355-38db-4d4b-8b2c-8fba76fa9e0c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:13.281851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1232/2445] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:22:13.285992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1348e-5f1c-44e4-be5a-bb0936e77269 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:13.296694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1348e-5f1c-44e4-be5a-bb0936e77269 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:13.301317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad47af-1105-457c-80b1-31f0c8f42ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:13.301956 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad47af-1105-457c-80b1-31f0c8f42ce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:13.302234 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad47af-1105-457c-80b1-31f0c8f42ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:13.302506 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad47af-1105-457c-80b1-31f0c8f42ce2 admin admin] PATH_INFO: `/v3/projects/3872c4d7177f4aa1acb9e4564b097eb4/users/5e0cab03d0bc4d479922d0e271c0ccaa/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:13.321331 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad47af-1105-457c-80b1-31f0c8f42ce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3872c4d7177f4aa1acb9e4564b097eb4, user_id=5e0cab03d0bc4d479922d0e271c0ccaa, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:13.325883 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad47af-1105-457c-80b1-31f0c8f42ce2 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:13.342577 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1214/2446] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:13 2022] PUT /identity/v3/projects/3872c4d7177f4aa1acb9e4564b097eb4/users/5e0cab03d0bc4d479922d0e271c0ccaa/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:13.346535 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57323355-38db-4d4b-8b2c-8fba76fa9e0c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:13.357197 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57323355-38db-4d4b-8b2c-8fba76fa9e0c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:13.421837 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe20451-03ef-410b-8ad0-8b1a3ddaea31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:13.421837 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe20451-03ef-410b-8ad0-8b1a3ddaea31 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:13.421837 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe20451-03ef-410b-8ad0-8b1a3ddaea31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:13.421837 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe20451-03ef-410b-8ad0-8b1a3ddaea31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:13.422417 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe20451-03ef-410b-8ad0-8b1a3ddaea31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:13.424032 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe20451-03ef-410b-8ad0-8b1a3ddaea31 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:13.435410 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1233/2447] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:13.439817 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad47af-1105-457c-80b1-31f0c8f42ce2 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:13.450928 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad47af-1105-457c-80b1-31f0c8f42ce2 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:13.456183 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af191e-0e04-4df5-a598-255ca0ff8da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:13.457005 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af191e-0e04-4df5-a598-255ca0ff8da3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:13.457286 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af191e-0e04-4df5-a598-255ca0ff8da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:13.457558 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af191e-0e04-4df5-a598-255ca0ff8da3 admin admin] PATH_INFO: `/v3/projects/3872c4d7177f4aa1acb9e4564b097eb4/users/5e0cab03d0bc4d479922d0e271c0ccaa/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:13.460203 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af191e-0e04-4df5-a598-255ca0ff8da3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3872c4d7177f4aa1acb9e4564b097eb4, user_id=5e0cab03d0bc4d479922d0e271c0ccaa, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:13.463367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af191e-0e04-4df5-a598-255ca0ff8da3 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:13.474804 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1215/2448] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:13 2022] PUT /identity/v3/projects/3872c4d7177f4aa1acb9e4564b097eb4/users/5e0cab03d0bc4d479922d0e271c0ccaa/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:22:13.486104 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa43709-9642-459e-b22a-a4c3b50327fc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:13.486393 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa43709-9642-459e-b22a-a4c3b50327fc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:13.486756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa43709-9642-459e-b22a-a4c3b50327fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:13.515307 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-dfa43709-9642-459e-b22a-a4c3b50327fc None None] MFA Rules not processed for user `5e0cab03d0bc4d479922d0e271c0ccaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:13.516543 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dfa43709-9642-459e-b22a-a4c3b50327fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:13.561185 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:13.592497 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1234/2449] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:13.602908 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af191e-0e04-4df5-a598-255ca0ff8da3 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:13.605205 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-f5af191e-0e04-4df5-a598-255ca0ff8da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:13.684221 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af191e-0e04-4df5-a598-255ca0ff8da3 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:13.688139 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e7674-8576-42a1-9b8e-f085f47224cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:13.688744 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e7674-8576-42a1-9b8e-f085f47224cb service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:13.689030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e7674-8576-42a1-9b8e-f085f47224cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:13.689300 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e7674-8576-42a1-9b8e-f085f47224cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:13.747784 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e7674-8576-42a1-9b8e-f085f47224cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:13.749223 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e7674-8576-42a1-9b8e-f085f47224cb service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:13.759298 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1216/2450] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:16.354011 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa43709-9642-459e-b22a-a4c3b50327fc None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:16.355482 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dfa43709-9642-459e-b22a-a4c3b50327fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:16.368182 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa43709-9642-459e-b22a-a4c3b50327fc None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:16.372454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bb75f-2844-4567-92c2-7c77309fa596 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:16.373054 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bb75f-2844-4567-92c2-7c77309fa596 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:16.373334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bb75f-2844-4567-92c2-7c77309fa596 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:16.373606 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bb75f-2844-4567-92c2-7c77309fa596 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:16.382385 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65bb75f-2844-4567-92c2-7c77309fa596 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:16.383883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65bb75f-2844-4567-92c2-7c77309fa596 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:16.393340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1235/2451] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:23.334609 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105423c-7663-4b1a-8002-d6613925bd3d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:23.335366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105423c-7663-4b1a-8002-d6613925bd3d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:23.335366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105423c-7663-4b1a-8002-d6613925bd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:23.362647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-6105423c-7663-4b1a-8002-d6613925bd3d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:23.363904 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-6105423c-7663-4b1a-8002-d6613925bd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:23.432387 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:23.453589 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1217/2452] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Aug 10 13:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:23.478415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bb75f-2844-4567-92c2-7c77309fa596 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:23.481924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a65bb75f-2844-4567-92c2-7c77309fa596 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:23.579811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bb75f-2844-4567-92c2-7c77309fa596 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:23.585992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388febe6-de3d-4de6-839d-e575894f0b04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:23.586677 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388febe6-de3d-4de6-839d-e575894f0b04 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:23.587176 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388febe6-de3d-4de6-839d-e575894f0b04 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:23.587498 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388febe6-de3d-4de6-839d-e575894f0b04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:23.597563 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388febe6-de3d-4de6-839d-e575894f0b04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:23.599227 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388febe6-de3d-4de6-839d-e575894f0b04 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:23.610843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1236/2453] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:22:26.357854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed72e9c-6fba-4c31-b42e-efe49e34648d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:26.357854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed72e9c-6fba-4c31-b42e-efe49e34648d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:26.357854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed72e9c-6fba-4c31-b42e-efe49e34648d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:26.382096 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-3ed72e9c-6fba-4c31-b42e-efe49e34648d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:26.383363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3ed72e9c-6fba-4c31-b42e-efe49e34648d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:26.396097 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1218/2454] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Aug 10 13:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:26.415104 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388febe6-de3d-4de6-839d-e575894f0b04 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:26.418566 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-388febe6-de3d-4de6-839d-e575894f0b04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:26.435584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388febe6-de3d-4de6-839d-e575894f0b04 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:26.440761 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68728a96-fa83-43f6-9b00-2af066e5c1eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:26.441391 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68728a96-fa83-43f6-9b00-2af066e5c1eb service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:26.441666 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68728a96-fa83-43f6-9b00-2af066e5c1eb service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:26.441935 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68728a96-fa83-43f6-9b00-2af066e5c1eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:26.444328 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed72e9c-6fba-4c31-b42e-efe49e34648d None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:26.446163 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3ed72e9c-6fba-4c31-b42e-efe49e34648d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:26.451795 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68728a96-fa83-43f6-9b00-2af066e5c1eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:26.453395 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68728a96-fa83-43f6-9b00-2af066e5c1eb service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:26.464594 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1237/2455] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:26.522423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed72e9c-6fba-4c31-b42e-efe49e34648d None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:26.528730 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531caee-9a2f-4879-a1d5-35a9ad6ee335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:26.529571 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531caee-9a2f-4879-a1d5-35a9ad6ee335 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:26.530096 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531caee-9a2f-4879-a1d5-35a9ad6ee335 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:26.530441 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531caee-9a2f-4879-a1d5-35a9ad6ee335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:26.532517 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-e531caee-9a2f-4879-a1d5-35a9ad6ee335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:26.550506 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531caee-9a2f-4879-a1d5-35a9ad6ee335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:26.552459 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531caee-9a2f-4879-a1d5-35a9ad6ee335 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:26.565112 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1219/2456] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:29.367505 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68728a96-fa83-43f6-9b00-2af066e5c1eb service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:29.380722 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68728a96-fa83-43f6-9b00-2af066e5c1eb service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:29.388730 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e067ef9-a7cf-445b-ace8-1e3df2985aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:29.390148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e067ef9-a7cf-445b-ace8-1e3df2985aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:29.391347 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e067ef9-a7cf-445b-ace8-1e3df2985aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:29.391347 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e067ef9-a7cf-445b-ace8-1e3df2985aad admin admin] PATH_INFO: `/v3/users/1f9df43796594c61a6587824ca162bfc` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:29.394401 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e067ef9-a7cf-445b-ace8-1e3df2985aad admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f9df43796594c61a6587824ca162bfc)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:29.398209 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e067ef9-a7cf-445b-ace8-1e3df2985aad admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:29.477251 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5e067ef9-a7cf-445b-ace8-1e3df2985aad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f9df43796594c61a6587824ca162bfc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:29.478631 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5e067ef9-a7cf-445b-ace8-1e3df2985aad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f9df43796594c61a6587824ca162bfc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:29.488800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5e067ef9-a7cf-445b-ace8-1e3df2985aad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f9df43796594c61a6587824ca162bfc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:29.503983 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5e067ef9-a7cf-445b-ace8-1e3df2985aad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f9df43796594c61a6587824ca162bfc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:29.538229 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5e067ef9-a7cf-445b-ace8-1e3df2985aad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f9df43796594c61a6587824ca162bfc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:29.552379 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1238/2457] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:22:29 2022] DELETE /identity/v3/users/1f9df43796594c61a6587824ca162bfc => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:29.558229 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a390a-42a0-4ac2-b409-aadfe641f634 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:29.558848 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a390a-42a0-4ac2-b409-aadfe641f634 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:29.558948 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a390a-42a0-4ac2-b409-aadfe641f634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:29.603684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-202a390a-42a0-4ac2-b409-aadfe641f634 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:29.605816 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-202a390a-42a0-4ac2-b409-aadfe641f634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:29.703203 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1220/2458] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:29.714540 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e067ef9-a7cf-445b-ace8-1e3df2985aad admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:29.716867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5e067ef9-a7cf-445b-ace8-1e3df2985aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:29.731991 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:29.823209 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e067ef9-a7cf-445b-ace8-1e3df2985aad admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:29.828665 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0e142-8062-4f9e-b744-f94410287ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:29.830186 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0e142-8062-4f9e-b744-f94410287ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:29.830775 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0e142-8062-4f9e-b744-f94410287ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:29.831299 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0e142-8062-4f9e-b744-f94410287ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:29.855225 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0e142-8062-4f9e-b744-f94410287ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:29.857752 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0e142-8062-4f9e-b744-f94410287ce4 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:29.858495 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6df91c-257b-4776-914a-376ec4e516d3 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:29.858880 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6df91c-257b-4776-914a-376ec4e516d3 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:29.859248 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6df91c-257b-4776-914a-376ec4e516d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:29.876667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1239/2459] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:22:29.902799 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-bb6df91c-257b-4776-914a-376ec4e516d3 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:29.905207 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-bb6df91c-257b-4776-914a-376ec4e516d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:29.921766 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1221/2460] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Aug 10 13:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:29.947214 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0e142-8062-4f9e-b744-f94410287ce4 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:29.955112 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-44c0e142-8062-4f9e-b744-f94410287ce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:30.146419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0e142-8062-4f9e-b744-f94410287ce4 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:30.160804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827b160-dedf-4c28-b51f-e549a9e682c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:30.162277 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827b160-dedf-4c28-b51f-e549a9e682c8 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:30.162825 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827b160-dedf-4c28-b51f-e549a9e682c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:30.163375 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827b160-dedf-4c28-b51f-e549a9e682c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:30.182583 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1827b160-dedf-4c28-b51f-e549a9e682c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:30.190844 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1827b160-dedf-4c28-b51f-e549a9e682c8 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:30.215181 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1240/2461] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:22:30.541911 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6df91c-257b-4776-914a-376ec4e516d3 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:30.544118 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-bb6df91c-257b-4776-914a-376ec4e516d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:30.561578 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6df91c-257b-4776-914a-376ec4e516d3 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:30.570451 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d910a92-1f3b-468f-8926-4b87f2d7ed5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:30.572710 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d910a92-1f3b-468f-8926-4b87f2d7ed5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:30.573523 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d910a92-1f3b-468f-8926-4b87f2d7ed5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:30.574620 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d910a92-1f3b-468f-8926-4b87f2d7ed5c admin admin] PATH_INFO: `/v3/projects/2e0c7144a6764209a595e9f5475e2c5c` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:30.577265 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d910a92-1f3b-468f-8926-4b87f2d7ed5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e0c7144a6764209a595e9f5475e2c5c)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:30.581775 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d910a92-1f3b-468f-8926-4b87f2d7ed5c admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:30.721806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3d910a92-1f3b-468f-8926-4b87f2d7ed5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e0c7144a6764209a595e9f5475e2c5c', 'request_id': 'req-3d910a92-1f3b-468f-8926-4b87f2d7ed5c'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:30.730196 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3d910a92-1f3b-468f-8926-4b87f2d7ed5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e0c7144a6764209a595e9f5475e2c5c', 'request_id': 'req-3d910a92-1f3b-468f-8926-4b87f2d7ed5c'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:30.739555 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3d910a92-1f3b-468f-8926-4b87f2d7ed5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e0c7144a6764209a595e9f5475e2c5c', 'request_id': 'req-3d910a92-1f3b-468f-8926-4b87f2d7ed5c'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:30.752426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3d910a92-1f3b-468f-8926-4b87f2d7ed5c admin admin] The token cache is being invalidate because project 2e0c7144a6764209a595e9f5475e2c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:22:30.753075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3d910a92-1f3b-468f-8926-4b87f2d7ed5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:30.753789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3d910a92-1f3b-468f-8926-4b87f2d7ed5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:30.756196 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1222/2462] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:22:30 2022] DELETE /identity/v3/projects/2e0c7144a6764209a595e9f5475e2c5c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:30.761527 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827b160-dedf-4c28-b51f-e549a9e682c8 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:30.774094 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827b160-dedf-4c28-b51f-e549a9e682c8 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:30.800021 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d910a92-1f3b-468f-8926-4b87f2d7ed5c admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:30.801752 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3d910a92-1f3b-468f-8926-4b87f2d7ed5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:30.827823 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:30.889638 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec683f-4951-48a3-b27e-bb30fe0fa85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:30.893368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec683f-4951-48a3-b27e-bb30fe0fa85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:30.893672 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec683f-4951-48a3-b27e-bb30fe0fa85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:30.894814 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec683f-4951-48a3-b27e-bb30fe0fa85e admin admin] PATH_INFO: `/v3/users/5e0cab03d0bc4d479922d0e271c0ccaa` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:30.899105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec683f-4951-48a3-b27e-bb30fe0fa85e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e0cab03d0bc4d479922d0e271c0ccaa)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:30.905613 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec683f-4951-48a3-b27e-bb30fe0fa85e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:30.949753 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d910a92-1f3b-468f-8926-4b87f2d7ed5c admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:30.960307 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59bea3-678c-463b-8e21-a9788163ded6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15780b69faa745e9b99f1fffb6abe231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:30.960968 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59bea3-678c-463b-8e21-a9788163ded6 service placement] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:30.961944 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59bea3-678c-463b-8e21-a9788163ded6 service placement] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:30.961944 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59bea3-678c-463b-8e21-a9788163ded6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:30.965693 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-bb59bea3-678c-463b-8e21-a9788163ded6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:30.973425 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:30.983168 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59bea3-678c-463b-8e21-a9788163ded6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:30.984794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59bea3-678c-463b-8e21-a9788163ded6 service placement] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:30.989415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-efec683f-4951-48a3-b27e-bb30fe0fa85e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e0cab03d0bc4d479922d0e271c0ccaa'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:30.990161 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-efec683f-4951-48a3-b27e-bb30fe0fa85e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e0cab03d0bc4d479922d0e271c0ccaa'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:31.008279 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-efec683f-4951-48a3-b27e-bb30fe0fa85e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e0cab03d0bc4d479922d0e271c0ccaa'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:31.009603 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1223/2463] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:31.011422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59bea3-678c-463b-8e21-a9788163ded6 service placement] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:31.013746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-bb59bea3-678c-463b-8e21-a9788163ded6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:31.036837 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-efec683f-4951-48a3-b27e-bb30fe0fa85e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e0cab03d0bc4d479922d0e271c0ccaa'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:31.041109 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59bea3-678c-463b-8e21-a9788163ded6 service placement] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:31.046559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd0515-ea1e-4ea7-9ce0-6ad8077cb55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:31.047357 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd0515-ea1e-4ea7-9ce0-6ad8077cb55d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:31.048044 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd0515-ea1e-4ea7-9ce0-6ad8077cb55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:31.048382 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd0515-ea1e-4ea7-9ce0-6ad8077cb55d admin admin] PATH_INFO: `/v3/users/9c02f3fe4aa64e97b8172369816a9584` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:31.049761 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd0515-ea1e-4ea7-9ce0-6ad8077cb55d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c02f3fe4aa64e97b8172369816a9584)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:31.052210 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd0515-ea1e-4ea7-9ce0-6ad8077cb55d admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:31.054504 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-efec683f-4951-48a3-b27e-bb30fe0fa85e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e0cab03d0bc4d479922d0e271c0ccaa'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:31.068758 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1241/2464] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:22:30 2022] DELETE /identity/v3/users/5e0cab03d0bc4d479922d0e271c0ccaa => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:31.136891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7ddd0515-ea1e-4ea7-9ce0-6ad8077cb55d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c02f3fe4aa64e97b8172369816a9584'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:31.137879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7ddd0515-ea1e-4ea7-9ce0-6ad8077cb55d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c02f3fe4aa64e97b8172369816a9584'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:31.149319 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7ddd0515-ea1e-4ea7-9ce0-6ad8077cb55d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c02f3fe4aa64e97b8172369816a9584'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:31.159017 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7ddd0515-ea1e-4ea7-9ce0-6ad8077cb55d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c02f3fe4aa64e97b8172369816a9584'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:31.176582 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-7ddd0515-ea1e-4ea7-9ce0-6ad8077cb55d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c02f3fe4aa64e97b8172369816a9584'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:31.185948 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1224/2465] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:22:31 2022] DELETE /identity/v3/users/9c02f3fe4aa64e97b8172369816a9584 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:31.441109 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec683f-4951-48a3-b27e-bb30fe0fa85e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:31.442793 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-efec683f-4951-48a3-b27e-bb30fe0fa85e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:31.456996 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd0515-ea1e-4ea7-9ce0-6ad8077cb55d admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:31.459716 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7ddd0515-ea1e-4ea7-9ce0-6ad8077cb55d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:31.532186 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec683f-4951-48a3-b27e-bb30fe0fa85e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:31.581214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd0515-ea1e-4ea7-9ce0-6ad8077cb55d admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:31.586941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e9f1f-c4fe-409d-a2e9-2fba16d93005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:31.587756 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e9f1f-c4fe-409d-a2e9-2fba16d93005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:31.588152 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e9f1f-c4fe-409d-a2e9-2fba16d93005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:31.588414 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e9f1f-c4fe-409d-a2e9-2fba16d93005 admin admin] PATH_INFO: `/v3/projects/3872c4d7177f4aa1acb9e4564b097eb4` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:31.589555 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e9f1f-c4fe-409d-a2e9-2fba16d93005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3872c4d7177f4aa1acb9e4564b097eb4)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:31.591544 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e9f1f-c4fe-409d-a2e9-2fba16d93005 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:31.602870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:31.608047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad1ff5-1888-46de-9d7b-1b9e0734ac8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:31.608691 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad1ff5-1888-46de-9d7b-1b9e0734ac8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:31.609010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad1ff5-1888-46de-9d7b-1b9e0734ac8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:31.609257 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad1ff5-1888-46de-9d7b-1b9e0734ac8f admin admin] PATH_INFO: `/v3/projects/7c70cdaaf35542b9b169414f08b7e11d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:31.610437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad1ff5-1888-46de-9d7b-1b9e0734ac8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c70cdaaf35542b9b169414f08b7e11d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:31.612430 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad1ff5-1888-46de-9d7b-1b9e0734ac8f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:31.657920 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-048e9f1f-c4fe-409d-a2e9-2fba16d93005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3872c4d7177f4aa1acb9e4564b097eb4', 'request_id': 'req-048e9f1f-c4fe-409d-a2e9-2fba16d93005'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:31.670369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-048e9f1f-c4fe-409d-a2e9-2fba16d93005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3872c4d7177f4aa1acb9e4564b097eb4', 'request_id': 'req-048e9f1f-c4fe-409d-a2e9-2fba16d93005'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:31.681581 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-048e9f1f-c4fe-409d-a2e9-2fba16d93005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3872c4d7177f4aa1acb9e4564b097eb4', 'request_id': 'req-048e9f1f-c4fe-409d-a2e9-2fba16d93005'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:31.688547 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-06ad1ff5-1888-46de-9d7b-1b9e0734ac8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c70cdaaf35542b9b169414f08b7e11d', 'request_id': 'req-06ad1ff5-1888-46de-9d7b-1b9e0734ac8f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:31.695938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-048e9f1f-c4fe-409d-a2e9-2fba16d93005 admin admin] The token cache is being invalidate because project 3872c4d7177f4aa1acb9e4564b097eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:22:31.697183 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-048e9f1f-c4fe-409d-a2e9-2fba16d93005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:31.697598 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-06ad1ff5-1888-46de-9d7b-1b9e0734ac8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c70cdaaf35542b9b169414f08b7e11d', 'request_id': 'req-06ad1ff5-1888-46de-9d7b-1b9e0734ac8f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:31.697886 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-048e9f1f-c4fe-409d-a2e9-2fba16d93005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:31.699826 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1225/2466] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:22:31 2022] DELETE /identity/v3/projects/3872c4d7177f4aa1acb9e4564b097eb4 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:31.704503 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854ba3-69bf-4bb7-a521-94b6927c1a76 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:31.704785 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854ba3-69bf-4bb7-a521-94b6927c1a76 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:31.705693 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854ba3-69bf-4bb7-a521-94b6927c1a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:31.712127 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-06ad1ff5-1888-46de-9d7b-1b9e0734ac8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c70cdaaf35542b9b169414f08b7e11d', 'request_id': 'req-06ad1ff5-1888-46de-9d7b-1b9e0734ac8f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:31.717398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:31.730198 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-97854ba3-69bf-4bb7-a521-94b6927c1a76 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:31.730664 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-06ad1ff5-1888-46de-9d7b-1b9e0734ac8f admin admin] The token cache is being invalidate because project 7c70cdaaf35542b9b169414f08b7e11d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:22:31.730956 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-06ad1ff5-1888-46de-9d7b-1b9e0734ac8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:31.731849 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-97854ba3-69bf-4bb7-a521-94b6927c1a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:31.733905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-06ad1ff5-1888-46de-9d7b-1b9e0734ac8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:31.739937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1242/2467] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:22:31 2022] DELETE /identity/v3/projects/7c70cdaaf35542b9b169414f08b7e11d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:31.742612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1354dae-0fd4-47a5-81bf-4cead63ffe35 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:31.746030 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1354dae-0fd4-47a5-81bf-4cead63ffe35 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:31.747324 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1354dae-0fd4-47a5-81bf-4cead63ffe35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:31.776548 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d1354dae-0fd4-47a5-81bf-4cead63ffe35 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:31.777818 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d1354dae-0fd4-47a5-81bf-4cead63ffe35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:31.839715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1226/2468] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:22:31.849468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65211e85-1a8a-4391-a0c5-15cb1f046216 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:31.849962 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65211e85-1a8a-4391-a0c5-15cb1f046216 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:31.850384 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65211e85-1a8a-4391-a0c5-15cb1f046216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:31.857398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1243/2469] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:31.860148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2c772-01ba-4515-a6df-00a33d70884f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:31.861525 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2c772-01ba-4515-a6df-00a33d70884f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:31.861525 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2c772-01ba-4515-a6df-00a33d70884f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:31.873583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-65211e85-1a8a-4391-a0c5-15cb1f046216 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:31.874993 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-65211e85-1a8a-4391-a0c5-15cb1f046216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:31.883599 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1227/2470] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:31.888071 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65211e85-1a8a-4391-a0c5-15cb1f046216 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:31.891208 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-81f2c772-01ba-4515-a6df-00a33d70884f None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:31.892641 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-81f2c772-01ba-4515-a6df-00a33d70884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:31.897433 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65211e85-1a8a-4391-a0c5-15cb1f046216 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:31.902652 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ded54-47e5-40ba-af60-f1b9d578567c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:31.903394 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ded54-47e5-40ba-af60-f1b9d578567c admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:31.903685 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ded54-47e5-40ba-af60-f1b9d578567c admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:31.903973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ded54-47e5-40ba-af60-f1b9d578567c admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:31.904598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ded54-47e5-40ba-af60-f1b9d578567c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:22:31.904899 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ded54-47e5-40ba-af60-f1b9d578567c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:31.906507 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ded54-47e5-40ba-af60-f1b9d578567c admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:31.906794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1244/2471] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:31.907871 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2c772-01ba-4515-a6df-00a33d70884f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:31.921610 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2c772-01ba-4515-a6df-00a33d70884f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:31.924750 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1228/2472] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:22:31.925654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ded54-47e5-40ba-af60-f1b9d578567c admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:31.926732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4c7c4-db75-4c7e-bc61-a8f809b283eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:31.927392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4c7c4-db75-4c7e-bc61-a8f809b283eb admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:31.927692 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4c7c4-db75-4c7e-bc61-a8f809b283eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:31.927973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4c7c4-db75-4c7e-bc61-a8f809b283eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:31.928577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4c7c4-db75-4c7e-bc61-a8f809b283eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:22:31.928881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4c7c4-db75-4c7e-bc61-a8f809b283eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:31.931330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4c7c4-db75-4c7e-bc61-a8f809b283eb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:31.937922 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ded54-47e5-40ba-af60-f1b9d578567c admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:31.944065 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efed2e-071a-4255-86f7-9bd9a0053742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:31.945100 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efed2e-071a-4255-86f7-9bd9a0053742 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:31.945446 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efed2e-071a-4255-86f7-9bd9a0053742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:31.945779 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efed2e-071a-4255-86f7-9bd9a0053742 admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:31.946515 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efed2e-071a-4255-86f7-9bd9a0053742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:31.948465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1245/2473] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:22:31.948620 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efed2e-071a-4255-86f7-9bd9a0053742 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:31.954254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4c7c4-db75-4c7e-bc61-a8f809b283eb admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:31.966899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4c7c4-db75-4c7e-bc61-a8f809b283eb admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:31.973547 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca07e4-2cd6-44e9-b27a-bc0ff545cdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:31.974310 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca07e4-2cd6-44e9-b27a-bc0ff545cdc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:31.974691 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca07e4-2cd6-44e9-b27a-bc0ff545cdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:31.975086 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca07e4-2cd6-44e9-b27a-bc0ff545cdc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:31.975811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca07e4-2cd6-44e9-b27a-bc0ff545cdc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:31.978385 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca07e4-2cd6-44e9-b27a-bc0ff545cdc9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:31.997455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1229/2474] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:22:31 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:31.998454 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efed2e-071a-4255-86f7-9bd9a0053742 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:32.017275 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1246/2475] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:22:31 2022] POST /identity/v3/projects => generated 405 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:32.021324 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca07e4-2cd6-44e9-b27a-bc0ff545cdc9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:32.063525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:32.067919 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efed2e-071a-4255-86f7-9bd9a0053742 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:32.100661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca07e4-2cd6-44e9-b27a-bc0ff545cdc9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:32.107531 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cad95-2744-4957-b5c8-385ca3be8474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:32.108151 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cad95-2744-4957-b5c8-385ca3be8474 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:32.108432 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cad95-2744-4957-b5c8-385ca3be8474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:32.109043 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cad95-2744-4957-b5c8-385ca3be8474 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:32.109328 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cad95-2744-4957-b5c8-385ca3be8474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:32.111288 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cad95-2744-4957-b5c8-385ca3be8474 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:32.139503 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1247/2476] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:22:32 2022] POST /identity/v3/users => generated 303 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:22:32.141937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cad95-2744-4957-b5c8-385ca3be8474 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:32.155553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b593192-a9ec-47ee-8439-4617664538dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:32.156173 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b593192-a9ec-47ee-8439-4617664538dc admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:32.156522 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b593192-a9ec-47ee-8439-4617664538dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:32.156790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b593192-a9ec-47ee-8439-4617664538dc admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:32.156971 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cad95-2744-4957-b5c8-385ca3be8474 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:32.157353 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b593192-a9ec-47ee-8439-4617664538dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:32.159317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b593192-a9ec-47ee-8439-4617664538dc admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:32.162491 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f5412-300d-4dd3-a40f-b470cc9e297d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:32.163144 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f5412-300d-4dd3-a40f-b470cc9e297d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:32.163424 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f5412-300d-4dd3-a40f-b470cc9e297d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:32.163700 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f5412-300d-4dd3-a40f-b470cc9e297d admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:32.164351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f5412-300d-4dd3-a40f-b470cc9e297d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:32.166003 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f5412-300d-4dd3-a40f-b470cc9e297d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:32.183551 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1248/2477] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:32.183830 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1230/2478] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:22:31 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:22:32.185431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f5412-300d-4dd3-a40f-b470cc9e297d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:32.186243 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b593192-a9ec-47ee-8439-4617664538dc admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:32.196957 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b593192-a9ec-47ee-8439-4617664538dc admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:32.197198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f5412-300d-4dd3-a40f-b470cc9e297d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:32.201919 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f836bf-b6f4-4b97-b477-997d0d3a45af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:32.202166 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68572a01-f745-41e3-95de-3e58fb0f2ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:32.202541 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f836bf-b6f4-4b97-b477-997d0d3a45af admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:32.202767 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68572a01-f745-41e3-95de-3e58fb0f2ecd admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:32.202886 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f836bf-b6f4-4b97-b477-997d0d3a45af admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:32.202987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68572a01-f745-41e3-95de-3e58fb0f2ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:32.203106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f836bf-b6f4-4b97-b477-997d0d3a45af admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:32.203193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68572a01-f745-41e3-95de-3e58fb0f2ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:32.203740 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f836bf-b6f4-4b97-b477-997d0d3a45af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:32.203882 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68572a01-f745-41e3-95de-3e58fb0f2ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:32.205355 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f836bf-b6f4-4b97-b477-997d0d3a45af admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:32.205484 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68572a01-f745-41e3-95de-3e58fb0f2ecd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:32.217019 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1231/2479] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:22:32.220762 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1249/2480] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:32.221689 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f836bf-b6f4-4b97-b477-997d0d3a45af admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:32.221811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68572a01-f745-41e3-95de-3e58fb0f2ecd admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:32.233159 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f836bf-b6f4-4b97-b477-997d0d3a45af admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:32.235337 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68572a01-f745-41e3-95de-3e58fb0f2ecd admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:32.238035 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdefc0a-531a-49bd-981d-347d77e51997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:32.238641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdefc0a-531a-49bd-981d-347d77e51997 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:32.238915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdefc0a-531a-49bd-981d-347d77e51997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:32.239223 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdefc0a-531a-49bd-981d-347d77e51997 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:32.239863 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdefc0a-531a-49bd-981d-347d77e51997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:32.240907 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c498dbd-d51d-484f-869b-564a18a4bdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:32.241454 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdefc0a-531a-49bd-981d-347d77e51997 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:32.241797 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c498dbd-d51d-484f-869b-564a18a4bdb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:32.242083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c498dbd-d51d-484f-869b-564a18a4bdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:32.242362 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c498dbd-d51d-484f-869b-564a18a4bdb5 admin admin] PATH_INFO: `/v3/projects/fa43704eef4245f9820dac54b52b9a69/users/1116ad3982cb45288026846f9c3e5fd2/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:32.261682 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1232/2481] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:32.263337 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdefc0a-531a-49bd-981d-347d77e51997 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:32.264952 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c498dbd-d51d-484f-869b-564a18a4bdb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa43704eef4245f9820dac54b52b9a69, user_id=1116ad3982cb45288026846f9c3e5fd2, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:32.268381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c498dbd-d51d-484f-869b-564a18a4bdb5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:32.272415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:32.273961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdefc0a-531a-49bd-981d-347d77e51997 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:32.279172 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944d1b0-1055-4cf5-8715-97ff997a7481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:32.279848 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944d1b0-1055-4cf5-8715-97ff997a7481 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:32.280130 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944d1b0-1055-4cf5-8715-97ff997a7481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:32.280403 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944d1b0-1055-4cf5-8715-97ff997a7481 admin admin] PATH_INFO: `/v3/projects/2682026c02aa4a619c8da07ca8e4ff82/users/6a255a73562b40db91d88cbe6f3815b6/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:32.287763 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1250/2482] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:32 2022] PUT /identity/v3/projects/fa43704eef4245f9820dac54b52b9a69/users/1116ad3982cb45288026846f9c3e5fd2/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:32.293251 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c567d3-b61b-43e9-9c93-329f720c90f2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:32.293545 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c567d3-b61b-43e9-9c93-329f720c90f2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:32.293813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c567d3-b61b-43e9-9c93-329f720c90f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:32.296746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944d1b0-1055-4cf5-8715-97ff997a7481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2682026c02aa4a619c8da07ca8e4ff82, user_id=6a255a73562b40db91d88cbe6f3815b6, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:32.299449 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944d1b0-1055-4cf5-8715-97ff997a7481 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:32.313430 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a1c567d3-b61b-43e9-9c93-329f720c90f2 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:32.314826 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1233/2483] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:32 2022] PUT /identity/v3/projects/2682026c02aa4a619c8da07ca8e4ff82/users/6a255a73562b40db91d88cbe6f3815b6/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:22:32.314995 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a1c567d3-b61b-43e9-9c93-329f720c90f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:32.325843 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a819ffb-4887-4424-8645-614e4fd0d441 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:32.326127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a819ffb-4887-4424-8645-614e4fd0d441 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:32.326410 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a819ffb-4887-4424-8645-614e4fd0d441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:32.357514 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-5a819ffb-4887-4424-8645-614e4fd0d441 None None] MFA Rules not processed for user `6a255a73562b40db91d88cbe6f3815b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:32.358892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-5a819ffb-4887-4424-8645-614e4fd0d441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:32.396484 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1251/2484] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:22:32.408957 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c567d3-b61b-43e9-9c93-329f720c90f2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:32.412150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a1c567d3-b61b-43e9-9c93-329f720c90f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:32.438656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1234/2485] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:22:32.443380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a819ffb-4887-4424-8645-614e4fd0d441 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:32.463558 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a819ffb-4887-4424-8645-614e4fd0d441 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:32.474994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302088b-4dc2-4e8e-afd7-63d6a43158d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:32.475595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302088b-4dc2-4e8e-afd7-63d6a43158d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:32.475945 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302088b-4dc2-4e8e-afd7-63d6a43158d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:32.476224 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302088b-4dc2-4e8e-afd7-63d6a43158d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:32.477004 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302088b-4dc2-4e8e-afd7-63d6a43158d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:32.479105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302088b-4dc2-4e8e-afd7-63d6a43158d8 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:32.521373 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c567d3-b61b-43e9-9c93-329f720c90f2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:32.530260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21840fb0-6a9b-4a82-8ff0-7ba9e4c6a56d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:32.531515 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21840fb0-6a9b-4a82-8ff0-7ba9e4c6a56d service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:32.536124 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21840fb0-6a9b-4a82-8ff0-7ba9e4c6a56d service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:32.536333 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1235/2486] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:22:32 2022] POST /identity/v3/projects => generated 381 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:22:32.536435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21840fb0-6a9b-4a82-8ff0-7ba9e4c6a56d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:32.537430 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302088b-4dc2-4e8e-afd7-63d6a43158d8 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:32.555553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21840fb0-6a9b-4a82-8ff0-7ba9e4c6a56d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:32.558921 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21840fb0-6a9b-4a82-8ff0-7ba9e4c6a56d service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:32.563830 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:32.587293 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1252/2487] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:32.617913 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302088b-4dc2-4e8e-afd7-63d6a43158d8 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:32.624417 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463cb13-74c1-4165-98dc-6cfb583ff2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:32.625105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463cb13-74c1-4165-98dc-6cfb583ff2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:32.625485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463cb13-74c1-4165-98dc-6cfb583ff2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:32.625702 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463cb13-74c1-4165-98dc-6cfb583ff2a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:32.626382 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463cb13-74c1-4165-98dc-6cfb583ff2a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:32.628643 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463cb13-74c1-4165-98dc-6cfb583ff2a8 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:32.655136 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1236/2488] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:22:32 2022] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:32.659409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21840fb0-6a9b-4a82-8ff0-7ba9e4c6a56d service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:32.671882 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21840fb0-6a9b-4a82-8ff0-7ba9e4c6a56d service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:32.678309 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354fb54-70d8-455e-87df-84e3bccefd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:32.679301 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354fb54-70d8-455e-87df-84e3bccefd1a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:32.679604 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354fb54-70d8-455e-87df-84e3bccefd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:32.679858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354fb54-70d8-455e-87df-84e3bccefd1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:32.681113 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354fb54-70d8-455e-87df-84e3bccefd1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:32.683071 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354fb54-70d8-455e-87df-84e3bccefd1a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:32.694724 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1253/2489] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:32.699558 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463cb13-74c1-4165-98dc-6cfb583ff2a8 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:32.713291 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463cb13-74c1-4165-98dc-6cfb583ff2a8 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:32.720676 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa91814-9bdd-4b81-92c5-0ad4f79dfc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:32.721530 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa91814-9bdd-4b81-92c5-0ad4f79dfc3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:32.721823 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa91814-9bdd-4b81-92c5-0ad4f79dfc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:32.722102 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa91814-9bdd-4b81-92c5-0ad4f79dfc3e admin admin] PATH_INFO: `/v3/projects/10eede43befe4af293580450335f3f5c/users/8e5efc123196407092964419559b0bc0/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:32.745021 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa91814-9bdd-4b81-92c5-0ad4f79dfc3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=10eede43befe4af293580450335f3f5c, user_id=8e5efc123196407092964419559b0bc0, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:32.748029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa91814-9bdd-4b81-92c5-0ad4f79dfc3e admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:32.772406 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1237/2490] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:32 2022] PUT /identity/v3/projects/10eede43befe4af293580450335f3f5c/users/8e5efc123196407092964419559b0bc0/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:32.776468 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354fb54-70d8-455e-87df-84e3bccefd1a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:32.795094 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354fb54-70d8-455e-87df-84e3bccefd1a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:32.913832 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619e2ba-ccef-4b39-9ee2-1420182509a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:32.915413 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619e2ba-ccef-4b39-9ee2-1420182509a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:32.915810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619e2ba-ccef-4b39-9ee2-1420182509a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:32.916090 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619e2ba-ccef-4b39-9ee2-1420182509a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:32.916849 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619e2ba-ccef-4b39-9ee2-1420182509a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:32.918717 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619e2ba-ccef-4b39-9ee2-1420182509a2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:32.931982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1254/2491] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:32.939097 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa91814-9bdd-4b81-92c5-0ad4f79dfc3e admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:32.961000 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa91814-9bdd-4b81-92c5-0ad4f79dfc3e admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:32.970599 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b045e12-6ae8-4ccd-bbd7-4cfbaf606489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:32.972727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b045e12-6ae8-4ccd-bbd7-4cfbaf606489 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:32.972727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b045e12-6ae8-4ccd-bbd7-4cfbaf606489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:32.972727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b045e12-6ae8-4ccd-bbd7-4cfbaf606489 admin admin] PATH_INFO: `/v3/projects/10eede43befe4af293580450335f3f5c/users/8e5efc123196407092964419559b0bc0/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:32.976791 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b045e12-6ae8-4ccd-bbd7-4cfbaf606489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10eede43befe4af293580450335f3f5c, user_id=8e5efc123196407092964419559b0bc0, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:32.980039 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f03ce-9000-4753-b05e-343ae711f13c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:32.980317 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f03ce-9000-4753-b05e-343ae711f13c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:32.989433 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f03ce-9000-4753-b05e-343ae711f13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:32.989763 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b045e12-6ae8-4ccd-bbd7-4cfbaf606489 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:33.007982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1238/2492] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:32 2022] PUT /identity/v3/projects/10eede43befe4af293580450335f3f5c/users/8e5efc123196407092964419559b0bc0/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:33.015464 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7b9f03ce-9000-4753-b05e-343ae711f13c None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:33.017567 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7b9f03ce-9000-4753-b05e-343ae711f13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:33.021213 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d0ac1-7b39-43b2-9f96-8a1a31835399 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:33.021607 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d0ac1-7b39-43b2-9f96-8a1a31835399 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:33.022100 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d0ac1-7b39-43b2-9f96-8a1a31835399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:33.056974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:33.080773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-a83d0ac1-7b39-43b2-9f96-8a1a31835399 None None] MFA Rules not processed for user `8e5efc123196407092964419559b0bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:33.082658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-a83d0ac1-7b39-43b2-9f96-8a1a31835399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:33.118680 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1255/2493] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Aug 10 13:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:33.147281 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f03ce-9000-4753-b05e-343ae711f13c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:33.150465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7b9f03ce-9000-4753-b05e-343ae711f13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:33.229691 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1239/2494] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:22:33.252818 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d0ac1-7b39-43b2-9f96-8a1a31835399 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:33.255914 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-a83d0ac1-7b39-43b2-9f96-8a1a31835399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:33.263899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f03ce-9000-4753-b05e-343ae711f13c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:33.272207 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f0c0e-d75c-4d99-beef-fcd2cb228f62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:33.272936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f0c0e-d75c-4d99-beef-fcd2cb228f62 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:33.273294 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f0c0e-d75c-4d99-beef-fcd2cb228f62 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:33.273644 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f0c0e-d75c-4d99-beef-fcd2cb228f62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:33.285707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f0c0e-d75c-4d99-beef-fcd2cb228f62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:33.287769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f0c0e-d75c-4d99-beef-fcd2cb228f62 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:33.300238 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1256/2495] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:33.365021 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d0ac1-7b39-43b2-9f96-8a1a31835399 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:33.369614 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcb1d9-72d4-4923-a44b-cac937f89c31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:33.370089 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcb1d9-72d4-4923-a44b-cac937f89c31 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:33.370388 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcb1d9-72d4-4923-a44b-cac937f89c31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:33.370644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcb1d9-72d4-4923-a44b-cac937f89c31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:33.379725 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:33.383407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dcb1d9-72d4-4923-a44b-cac937f89c31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:33.387316 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dcb1d9-72d4-4923-a44b-cac937f89c31 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:33.404392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1240/2496] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:33.560512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edccbd4-8fbc-4161-b669-3b6e395cea28 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:33.560796 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edccbd4-8fbc-4161-b669-3b6e395cea28 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:33.561075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edccbd4-8fbc-4161-b669-3b6e395cea28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:33.594677 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0edccbd4-8fbc-4161-b669-3b6e395cea28 None None] MFA Rules not processed for user `1116ad3982cb45288026846f9c3e5fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:33.596714 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0edccbd4-8fbc-4161-b669-3b6e395cea28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:33.683854 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1257/2497] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:33 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:22:33.689293 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcb1d9-72d4-4923-a44b-cac937f89c31 service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:33.709921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcb1d9-72d4-4923-a44b-cac937f89c31 service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:33.716097 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d185f8-0a18-4a6b-9315-2353b59c486f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:33.716812 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d185f8-0a18-4a6b-9315-2353b59c486f admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:33.717041 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d185f8-0a18-4a6b-9315-2353b59c486f admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:33.717350 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d185f8-0a18-4a6b-9315-2353b59c486f admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:33.718099 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d185f8-0a18-4a6b-9315-2353b59c486f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:33.720145 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d185f8-0a18-4a6b-9315-2353b59c486f admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:33.760480 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1241/2498] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:22:33 2022] POST /identity/v3/projects => generated 405 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:33.763120 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edccbd4-8fbc-4161-b669-3b6e395cea28 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:33.785458 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edccbd4-8fbc-4161-b669-3b6e395cea28 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:33.853712 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:33.889593 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76416513-ed7e-4bca-873b-1eca876e3a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:33.890303 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76416513-ed7e-4bca-873b-1eca876e3a5b admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:33.903605 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76416513-ed7e-4bca-873b-1eca876e3a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:33.903605 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76416513-ed7e-4bca-873b-1eca876e3a5b admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:33.903605 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76416513-ed7e-4bca-873b-1eca876e3a5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:33.903605 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76416513-ed7e-4bca-873b-1eca876e3a5b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:33.903920 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d185f8-0a18-4a6b-9315-2353b59c486f admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:33.918729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1258/2499] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:22:33 2022] POST /identity/v3/users => generated 309 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:33.922979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76416513-ed7e-4bca-873b-1eca876e3a5b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:33.934392 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76416513-ed7e-4bca-873b-1eca876e3a5b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:33.939789 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cb7b0-66b9-46ff-8d04-6b4a70c4086a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:33.940418 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cb7b0-66b9-46ff-8d04-6b4a70c4086a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:33.940712 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cb7b0-66b9-46ff-8d04-6b4a70c4086a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:33.940956 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cb7b0-66b9-46ff-8d04-6b4a70c4086a admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:33.941597 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cb7b0-66b9-46ff-8d04-6b4a70c4086a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:33.943293 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cb7b0-66b9-46ff-8d04-6b4a70c4086a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:33.963054 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1259/2500] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:22:33.964480 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cb7b0-66b9-46ff-8d04-6b4a70c4086a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:33.977559 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cb7b0-66b9-46ff-8d04-6b4a70c4086a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:33.982764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef24fd1-4be6-4c85-905e-3d60671ed5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:33.983486 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef24fd1-4be6-4c85-905e-3d60671ed5f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:33.984414 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef24fd1-4be6-4c85-905e-3d60671ed5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:33.984727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef24fd1-4be6-4c85-905e-3d60671ed5f0 admin admin] PATH_INFO: `/v3/projects/1ef5638bdfcc41f4a943ad0b083ebaef/users/3be155fe94e041b29da054962ccd3a62/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:34.002344 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef24fd1-4be6-4c85-905e-3d60671ed5f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef5638bdfcc41f4a943ad0b083ebaef, user_id=3be155fe94e041b29da054962ccd3a62, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:34.005111 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef24fd1-4be6-4c85-905e-3d60671ed5f0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:34.014876 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d185f8-0a18-4a6b-9315-2353b59c486f admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:34.017901 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f84c8-bdc0-4839-93df-cf847bdb4cb7 tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5efc123196407092964419559b0bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10eede43befe4af293580450335f3f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:34.018882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f84c8-bdc0-4839-93df-cf847bdb4cb7 tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:34.019201 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f84c8-bdc0-4839-93df-cf847bdb4cb7 tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:34.019483 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f84c8-bdc0-4839-93df-cf847bdb4cb7 tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:34.020155 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f84c8-bdc0-4839-93df-cf847bdb4cb7 tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:22:34.020588 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f84c8-bdc0-4839-93df-cf847bdb4cb7 tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:34.022347 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f84c8-bdc0-4839-93df-cf847bdb4cb7 tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:34.031675 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1260/2501] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:33 2022] PUT /identity/v3/projects/1ef5638bdfcc41f4a943ad0b083ebaef/users/3be155fe94e041b29da054962ccd3a62/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:34.038120 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef24fd1-4be6-4c85-905e-3d60671ed5f0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:34.039607 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1242/2502] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:22:34.045006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f84c8-bdc0-4839-93df-cf847bdb4cb7 tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:34.065010 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f84c8-bdc0-4839-93df-cf847bdb4cb7 tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:34.144658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef24fd1-4be6-4c85-905e-3d60671ed5f0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:34.151551 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d80960-f90c-4a15-ae84-5ed7436f6609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:34.152281 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d80960-f90c-4a15-ae84-5ed7436f6609 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:34.152880 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d80960-f90c-4a15-ae84-5ed7436f6609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:34.153209 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d80960-f90c-4a15-ae84-5ed7436f6609 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:34.153965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d80960-f90c-4a15-ae84-5ed7436f6609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:34.155738 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d80960-f90c-4a15-ae84-5ed7436f6609 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:34.168406 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1261/2503] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:22:34.172964 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d80960-f90c-4a15-ae84-5ed7436f6609 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:34.182831 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7082aa-09d3-4f7d-9671-8ac2a43c39cc tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5efc123196407092964419559b0bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10eede43befe4af293580450335f3f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:34.184041 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7082aa-09d3-4f7d-9671-8ac2a43c39cc tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:34.184730 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7082aa-09d3-4f7d-9671-8ac2a43c39cc tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:34.185150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d80960-f90c-4a15-ae84-5ed7436f6609 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:34.185450 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7082aa-09d3-4f7d-9671-8ac2a43c39cc tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:34.186715 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7082aa-09d3-4f7d-9671-8ac2a43c39cc tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:34.190566 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7082aa-09d3-4f7d-9671-8ac2a43c39cc tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:34.191996 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f321b5-eb76-4c75-a35a-f8a248e7d2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:34.191996 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f321b5-eb76-4c75-a35a-f8a248e7d2a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:34.192527 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f321b5-eb76-4c75-a35a-f8a248e7d2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:34.193529 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f321b5-eb76-4c75-a35a-f8a248e7d2a6 admin admin] PATH_INFO: `/v3/projects/1ef5638bdfcc41f4a943ad0b083ebaef/users/3be155fe94e041b29da054962ccd3a62/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:34.195574 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f321b5-eb76-4c75-a35a-f8a248e7d2a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef5638bdfcc41f4a943ad0b083ebaef, user_id=3be155fe94e041b29da054962ccd3a62, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:34.198450 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f321b5-eb76-4c75-a35a-f8a248e7d2a6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:34.211070 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1262/2504] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:34 2022] PUT /identity/v3/projects/1ef5638bdfcc41f4a943ad0b083ebaef/users/3be155fe94e041b29da054962ccd3a62/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:22:34.242049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1243/2505] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:22:34 2022] POST /identity/v3/projects => generated 352 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:22:34.245602 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f321b5-eb76-4c75-a35a-f8a248e7d2a6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:34.371044 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f321b5-eb76-4c75-a35a-f8a248e7d2a6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:34.395972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:34.455498 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ccf8e-abc7-40c5-82aa-f2cd8529055e tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5efc123196407092964419559b0bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10eede43befe4af293580450335f3f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:34.455936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ccf8e-abc7-40c5-82aa-f2cd8529055e tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:34.456227 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ccf8e-abc7-40c5-82aa-f2cd8529055e tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:34.456570 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ccf8e-abc7-40c5-82aa-f2cd8529055e tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:34.457664 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ccf8e-abc7-40c5-82aa-f2cd8529055e tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:22:34.457971 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ccf8e-abc7-40c5-82aa-f2cd8529055e tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:34.459766 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ccf8e-abc7-40c5-82aa-f2cd8529055e tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:34.474957 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1263/2506] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:22:34.532770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7082aa-09d3-4f7d-9671-8ac2a43c39cc tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:34.546219 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7082aa-09d3-4f7d-9671-8ac2a43c39cc tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:34.551859 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729362f-f1d1-410c-bc7d-6b35c451cce4 tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5efc123196407092964419559b0bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10eede43befe4af293580450335f3f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:34.552521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729362f-f1d1-410c-bc7d-6b35c451cce4 tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:34.552801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729362f-f1d1-410c-bc7d-6b35c451cce4 tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:34.553072 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729362f-f1d1-410c-bc7d-6b35c451cce4 tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] PATH_INFO: `/v3/projects/392ce3c0f6404de4aea596f8fb51184d` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:34.554346 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729362f-f1d1-410c-bc7d-6b35c451cce4 tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] RBAC: Authorizing `identity:delete_project(project_id=392ce3c0f6404de4aea596f8fb51184d)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:34.556373 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729362f-f1d1-410c-bc7d-6b35c451cce4 tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:34.623229 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:34.624852 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-4729362f-f1d1-410c-bc7d-6b35c451cce4 tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '392ce3c0f6404de4aea596f8fb51184d', 'request_id': 'req-4729362f-f1d1-410c-bc7d-6b35c451cce4'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:34.632940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-4729362f-f1d1-410c-bc7d-6b35c451cce4 tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '392ce3c0f6404de4aea596f8fb51184d', 'request_id': 'req-4729362f-f1d1-410c-bc7d-6b35c451cce4'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:34.645577 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-4729362f-f1d1-410c-bc7d-6b35c451cce4 tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '392ce3c0f6404de4aea596f8fb51184d', 'request_id': 'req-4729362f-f1d1-410c-bc7d-6b35c451cce4'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:34.685448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-4729362f-f1d1-410c-bc7d-6b35c451cce4 tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] The token cache is being invalidate because project 392ce3c0f6404de4aea596f8fb51184d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:22:34.685953 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-4729362f-f1d1-410c-bc7d-6b35c451cce4 tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:34.686815 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-4729362f-f1d1-410c-bc7d-6b35c451cce4 tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:34.688506 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1244/2507] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:22:34 2022] DELETE /identity/v3/projects/392ce3c0f6404de4aea596f8fb51184d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:35.024995 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ccf8e-abc7-40c5-82aa-f2cd8529055e tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:35.028699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d24ccf8e-abc7-40c5-82aa-f2cd8529055e tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:35.120143 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ccf8e-abc7-40c5-82aa-f2cd8529055e tempest-VolumeQuotaClassesTest-1882671793 tempest-VolumeQuotaClassesTest-1882671793-project-admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:35.194953 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0437c-2184-4d25-8375-b4790cc0990e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:35.196741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0437c-2184-4d25-8375-b4790cc0990e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:35.197216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0437c-2184-4d25-8375-b4790cc0990e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:35.197704 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0437c-2184-4d25-8375-b4790cc0990e admin admin] PATH_INFO: `/v3/users/6a255a73562b40db91d88cbe6f3815b6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:35.199961 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0437c-2184-4d25-8375-b4790cc0990e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a255a73562b40db91d88cbe6f3815b6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:35.203796 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0437c-2184-4d25-8375-b4790cc0990e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:35.269905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e1f0437c-2184-4d25-8375-b4790cc0990e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a255a73562b40db91d88cbe6f3815b6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:35.270977 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e1f0437c-2184-4d25-8375-b4790cc0990e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a255a73562b40db91d88cbe6f3815b6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:35.280830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e1f0437c-2184-4d25-8375-b4790cc0990e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a255a73562b40db91d88cbe6f3815b6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:35.290053 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e1f0437c-2184-4d25-8375-b4790cc0990e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a255a73562b40db91d88cbe6f3815b6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:35.296012 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:35.310381 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e1f0437c-2184-4d25-8375-b4790cc0990e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a255a73562b40db91d88cbe6f3815b6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:35.320480 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1264/2508] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:22:35 2022] DELETE /identity/v3/users/6a255a73562b40db91d88cbe6f3815b6 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:35.326706 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2438e15-0b74-4ec7-8f8e-29a8c4392acc None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:35.327533 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2438e15-0b74-4ec7-8f8e-29a8c4392acc None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:35.328301 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2438e15-0b74-4ec7-8f8e-29a8c4392acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:35.363626 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-d2438e15-0b74-4ec7-8f8e-29a8c4392acc None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:35.364539 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d2438e15-0b74-4ec7-8f8e-29a8c4392acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:35.392375 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e70c9b-1e5f-4fce-8c4c-1fb7ef92a5d4 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:35.393144 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e70c9b-1e5f-4fce-8c4c-1fb7ef92a5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:35.393848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e70c9b-1e5f-4fce-8c4c-1fb7ef92a5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:35.459041 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1245/2509] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:35.481364 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-68e70c9b-1e5f-4fce-8c4c-1fb7ef92a5d4 None None] MFA Rules not processed for user `3be155fe94e041b29da054962ccd3a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:35.481364 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-68e70c9b-1e5f-4fce-8c4c-1fb7ef92a5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:35.481870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2438e15-0b74-4ec7-8f8e-29a8c4392acc None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:35.481870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d2438e15-0b74-4ec7-8f8e-29a8c4392acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:35.615147 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1265/2510] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:35 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:22:35.685712 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2438e15-0b74-4ec7-8f8e-29a8c4392acc None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:35.694035 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc56c1-246d-41ed-a6d8-91cdb6ff8d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:35.695032 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc56c1-246d-41ed-a6d8-91cdb6ff8d8a service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:35.695622 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc56c1-246d-41ed-a6d8-91cdb6ff8d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:35.696625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc56c1-246d-41ed-a6d8-91cdb6ff8d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:35.717638 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc56c1-246d-41ed-a6d8-91cdb6ff8d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:35.720716 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc56c1-246d-41ed-a6d8-91cdb6ff8d8a service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:35.751423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1246/2511] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:36.197154 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e70c9b-1e5f-4fce-8c4c-1fb7ef92a5d4 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:36.199384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-68e70c9b-1e5f-4fce-8c4c-1fb7ef92a5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:36.230497 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e70c9b-1e5f-4fce-8c4c-1fb7ef92a5d4 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:36.242056 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31b015-204f-4e01-a9ef-83f511389f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:36.242797 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31b015-204f-4e01-a9ef-83f511389f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:36.243136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31b015-204f-4e01-a9ef-83f511389f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:36.243412 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31b015-204f-4e01-a9ef-83f511389f76 admin admin] PATH_INFO: `/v3/projects/2682026c02aa4a619c8da07ca8e4ff82` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:36.245642 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31b015-204f-4e01-a9ef-83f511389f76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2682026c02aa4a619c8da07ca8e4ff82)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:36.248068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31b015-204f-4e01-a9ef-83f511389f76 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:36.309342 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8c31b015-204f-4e01-a9ef-83f511389f76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2682026c02aa4a619c8da07ca8e4ff82', 'request_id': 'req-8c31b015-204f-4e01-a9ef-83f511389f76'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:36.319609 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8c31b015-204f-4e01-a9ef-83f511389f76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2682026c02aa4a619c8da07ca8e4ff82', 'request_id': 'req-8c31b015-204f-4e01-a9ef-83f511389f76'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:36.324862 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0654bdf-fa87-4dd9-b4ff-c41066fbe85b None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:36.325147 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0654bdf-fa87-4dd9-b4ff-c41066fbe85b None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:36.325419 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0654bdf-fa87-4dd9-b4ff-c41066fbe85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:36.336301 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8c31b015-204f-4e01-a9ef-83f511389f76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2682026c02aa4a619c8da07ca8e4ff82', 'request_id': 'req-8c31b015-204f-4e01-a9ef-83f511389f76'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:36.352646 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-d0654bdf-fa87-4dd9-b4ff-c41066fbe85b None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:36.354320 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d0654bdf-fa87-4dd9-b4ff-c41066fbe85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:36.356905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8c31b015-204f-4e01-a9ef-83f511389f76 admin admin] The token cache is being invalidate because project 2682026c02aa4a619c8da07ca8e4ff82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:22:36.357523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8c31b015-204f-4e01-a9ef-83f511389f76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:36.358677 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8c31b015-204f-4e01-a9ef-83f511389f76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:36.362018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1266/2512] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:22:36 2022] DELETE /identity/v3/projects/2682026c02aa4a619c8da07ca8e4ff82 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:36.366459 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31b015-204f-4e01-a9ef-83f511389f76 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:36.369929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8c31b015-204f-4e01-a9ef-83f511389f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:36.475861 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1247/2513] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Aug 10 13:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:36.476259 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:36.501589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31b015-204f-4e01-a9ef-83f511389f76 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:36.503930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0654bdf-fa87-4dd9-b4ff-c41066fbe85b None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:36.506380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d0654bdf-fa87-4dd9-b4ff-c41066fbe85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:36.510970 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3ecf6-1dc5-4446-adfd-5109d4191ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:36.512123 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3ecf6-1dc5-4446-adfd-5109d4191ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:36.512614 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3ecf6-1dc5-4446-adfd-5109d4191ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:36.513087 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3ecf6-1dc5-4446-adfd-5109d4191ab6 admin admin] PATH_INFO: `/v3/users/8e5efc123196407092964419559b0bc0` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:36.515249 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3ecf6-1dc5-4446-adfd-5109d4191ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e5efc123196407092964419559b0bc0)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:36.519344 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3ecf6-1dc5-4446-adfd-5109d4191ab6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:36.543543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:36.602045 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-95d3ecf6-1dc5-4446-adfd-5109d4191ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e5efc123196407092964419559b0bc0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:36.603447 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-95d3ecf6-1dc5-4446-adfd-5109d4191ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e5efc123196407092964419559b0bc0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:36.610521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0654bdf-fa87-4dd9-b4ff-c41066fbe85b None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:36.612305 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-95d3ecf6-1dc5-4446-adfd-5109d4191ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e5efc123196407092964419559b0bc0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:36.616467 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a446c1d-c08a-42a8-9fdb-3415a162d11c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:36.617376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a446c1d-c08a-42a8-9fdb-3415a162d11c service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:36.617576 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a446c1d-c08a-42a8-9fdb-3415a162d11c service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:36.619043 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a446c1d-c08a-42a8-9fdb-3415a162d11c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:36.621561 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7a446c1d-c08a-42a8-9fdb-3415a162d11c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:36.624929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-95d3ecf6-1dc5-4446-adfd-5109d4191ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e5efc123196407092964419559b0bc0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:36.646587 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-95d3ecf6-1dc5-4446-adfd-5109d4191ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e5efc123196407092964419559b0bc0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:36.646846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a446c1d-c08a-42a8-9fdb-3415a162d11c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:36.650367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a446c1d-c08a-42a8-9fdb-3415a162d11c service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:36.660599 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1267/2514] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:22:36 2022] DELETE /identity/v3/users/8e5efc123196407092964419559b0bc0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:36.678584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1248/2515] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:22:37.156628 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3ecf6-1dc5-4446-adfd-5109d4191ab6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:37.163807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-95d3ecf6-1dc5-4446-adfd-5109d4191ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:37.168040 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a446c1d-c08a-42a8-9fdb-3415a162d11c service nova] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:37.169779 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7a446c1d-c08a-42a8-9fdb-3415a162d11c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:37.186600 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a446c1d-c08a-42a8-9fdb-3415a162d11c service nova] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:37.258449 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f81533-4737-4b78-bea8-48661dff49b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:37.259465 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f81533-4737-4b78-bea8-48661dff49b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:37.259744 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f81533-4737-4b78-bea8-48661dff49b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:37.260017 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f81533-4737-4b78-bea8-48661dff49b7 admin admin] PATH_INFO: `/v3/users/1116ad3982cb45288026846f9c3e5fd2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:37.261363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f81533-4737-4b78-bea8-48661dff49b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1116ad3982cb45288026846f9c3e5fd2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:37.263305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f81533-4737-4b78-bea8-48661dff49b7 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:37.318225 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3ecf6-1dc5-4446-adfd-5109d4191ab6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:37.323665 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dfaaf-5093-4a61-9383-63a6787da218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:37.324321 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dfaaf-5093-4a61-9383-63a6787da218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:37.324605 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dfaaf-5093-4a61-9383-63a6787da218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:37.324879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dfaaf-5093-4a61-9383-63a6787da218 admin admin] PATH_INFO: `/v3/projects/10eede43befe4af293580450335f3f5c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:37.326627 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dfaaf-5093-4a61-9383-63a6787da218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10eede43befe4af293580450335f3f5c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:37.328776 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dfaaf-5093-4a61-9383-63a6787da218 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:37.345217 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-32f81533-4737-4b78-bea8-48661dff49b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1116ad3982cb45288026846f9c3e5fd2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:37.345957 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-32f81533-4737-4b78-bea8-48661dff49b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1116ad3982cb45288026846f9c3e5fd2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:37.356702 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-32f81533-4737-4b78-bea8-48661dff49b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1116ad3982cb45288026846f9c3e5fd2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:37.366263 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-32f81533-4737-4b78-bea8-48661dff49b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1116ad3982cb45288026846f9c3e5fd2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:37.384320 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-32f81533-4737-4b78-bea8-48661dff49b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1116ad3982cb45288026846f9c3e5fd2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:37.391733 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1249/2516] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:22:37 2022] DELETE /identity/v3/users/1116ad3982cb45288026846f9c3e5fd2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:37.411116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5e6dfaaf-5093-4a61-9383-63a6787da218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10eede43befe4af293580450335f3f5c', 'request_id': 'req-5e6dfaaf-5093-4a61-9383-63a6787da218'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:37.420688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5e6dfaaf-5093-4a61-9383-63a6787da218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10eede43befe4af293580450335f3f5c', 'request_id': 'req-5e6dfaaf-5093-4a61-9383-63a6787da218'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:37.428623 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5e6dfaaf-5093-4a61-9383-63a6787da218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10eede43befe4af293580450335f3f5c', 'request_id': 'req-5e6dfaaf-5093-4a61-9383-63a6787da218'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:37.441092 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5e6dfaaf-5093-4a61-9383-63a6787da218 admin admin] The token cache is being invalidate because project 10eede43befe4af293580450335f3f5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:22:37.441435 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5e6dfaaf-5093-4a61-9383-63a6787da218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:37.442049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5e6dfaaf-5093-4a61-9383-63a6787da218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:37.443637 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1268/2517] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:22:37 2022] DELETE /identity/v3/projects/10eede43befe4af293580450335f3f5c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:22:37.450772 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da8c0e-504e-4dd3-98a1-cc67299333e6 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:37.451087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da8c0e-504e-4dd3-98a1-cc67299333e6 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:37.453135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da8c0e-504e-4dd3-98a1-cc67299333e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:37.476032 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-05da8c0e-504e-4dd3-98a1-cc67299333e6 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:37.477834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-05da8c0e-504e-4dd3-98a1-cc67299333e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:37.500907 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:37.571461 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1250/2518] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:37.576587 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da8c0e-504e-4dd3-98a1-cc67299333e6 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:37.577042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e9199-98f8-4f58-9bf3-439adc176709 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:37.577377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e9199-98f8-4f58-9bf3-439adc176709 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:37.577655 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e9199-98f8-4f58-9bf3-439adc176709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:37.578842 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-05da8c0e-504e-4dd3-98a1-cc67299333e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:37.587421 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:37.594541 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da8c0e-504e-4dd3-98a1-cc67299333e6 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:37.600337 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a187b-b109-4820-a2cc-15812b79a55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:37.601193 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a187b-b109-4820-a2cc-15812b79a55d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:37.601571 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a187b-b109-4820-a2cc-15812b79a55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:37.601922 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a187b-b109-4820-a2cc-15812b79a55d admin admin] PATH_INFO: `/v3/users/ab5473abfec94015abe51ec51ac6afd4` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:37.603921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a187b-b109-4820-a2cc-15812b79a55d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab5473abfec94015abe51ec51ac6afd4)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:37.605952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a187b-b109-4820-a2cc-15812b79a55d admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:37.607491 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7e2e9199-98f8-4f58-9bf3-439adc176709 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:37.609558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7e2e9199-98f8-4f58-9bf3-439adc176709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:37.619546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1269/2519] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:37.623554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e9199-98f8-4f58-9bf3-439adc176709 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:37.635060 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e9199-98f8-4f58-9bf3-439adc176709 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:37.640997 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ea0d0-070a-4ec8-b92c-85666edaf643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:37.641623 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ea0d0-070a-4ec8-b92c-85666edaf643 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:37.642002 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ea0d0-070a-4ec8-b92c-85666edaf643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:37.642155 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ea0d0-070a-4ec8-b92c-85666edaf643 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:37.642863 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ea0d0-070a-4ec8-b92c-85666edaf643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:22:37.643254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ea0d0-070a-4ec8-b92c-85666edaf643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:37.645138 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ea0d0-070a-4ec8-b92c-85666edaf643 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:37.660407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1270/2520] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:22:37.666178 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ea0d0-070a-4ec8-b92c-85666edaf643 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:37.677578 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ea0d0-070a-4ec8-b92c-85666edaf643 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:37.682865 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887a06f-654e-418e-a6c5-d4194acc0463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:37.683540 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887a06f-654e-418e-a6c5-d4194acc0463 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:37.683903 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887a06f-654e-418e-a6c5-d4194acc0463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:37.684216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887a06f-654e-418e-a6c5-d4194acc0463 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:37.684854 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887a06f-654e-418e-a6c5-d4194acc0463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:37.686974 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887a06f-654e-418e-a6c5-d4194acc0463 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:37.689370 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-6d2a187b-b109-4820-a2cc-15812b79a55d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab5473abfec94015abe51ec51ac6afd4'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:37.690440 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-6d2a187b-b109-4820-a2cc-15812b79a55d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab5473abfec94015abe51ec51ac6afd4'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:37.702683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-6d2a187b-b109-4820-a2cc-15812b79a55d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab5473abfec94015abe51ec51ac6afd4'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:37.716722 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-6d2a187b-b109-4820-a2cc-15812b79a55d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab5473abfec94015abe51ec51ac6afd4'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:37.732268 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-6d2a187b-b109-4820-a2cc-15812b79a55d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab5473abfec94015abe51ec51ac6afd4'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:37.742356 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1271/2521] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:22:37 2022] POST /identity/v3/projects => generated 409 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:22:37.742356 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887a06f-654e-418e-a6c5-d4194acc0463 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:37.742899 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1251/2522] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:22:37 2022] DELETE /identity/v3/users/ab5473abfec94015abe51ec51ac6afd4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:37.744189 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a187b-b109-4820-a2cc-15812b79a55d admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:37.744485 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5887a06f-654e-418e-a6c5-d4194acc0463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:37.745597 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-6d2a187b-b109-4820-a2cc-15812b79a55d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:37.816087 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887a06f-654e-418e-a6c5-d4194acc0463 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:37.841834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a187b-b109-4820-a2cc-15812b79a55d admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:37.848577 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5b932-5916-4cd9-a045-bfb266389dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:37.849198 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5b932-5916-4cd9-a045-bfb266389dcb admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:37.849477 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5b932-5916-4cd9-a045-bfb266389dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:37.849750 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5b932-5916-4cd9-a045-bfb266389dcb admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:37.850399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5b932-5916-4cd9-a045-bfb266389dcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:37.852373 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5b932-5916-4cd9-a045-bfb266389dcb admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:37.875682 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1252/2523] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:22:37 2022] POST /identity/v3/users => generated 305 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:37.876887 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49be6e-d3aa-4668-ae4a-c77045efab8b None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:37.877164 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49be6e-d3aa-4668-ae4a-c77045efab8b None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:37.877435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49be6e-d3aa-4668-ae4a-c77045efab8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:37.889283 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bd98a-7170-4957-8c04-cb4b0ab65f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:37.890111 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bd98a-7170-4957-8c04-cb4b0ab65f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:37.890497 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bd98a-7170-4957-8c04-cb4b0ab65f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:37.891083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bd98a-7170-4957-8c04-cb4b0ab65f82 admin admin] PATH_INFO: `/v3/projects/fa43704eef4245f9820dac54b52b9a69` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:37.892396 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bd98a-7170-4957-8c04-cb4b0ab65f82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa43704eef4245f9820dac54b52b9a69)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:37.894455 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bd98a-7170-4957-8c04-cb4b0ab65f82 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:37.898799 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-aa49be6e-d3aa-4668-ae4a-c77045efab8b None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:37.900672 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-aa49be6e-d3aa-4668-ae4a-c77045efab8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:37.910094 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1253/2524] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:37.911909 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49be6e-d3aa-4668-ae4a-c77045efab8b None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:37.923310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49be6e-d3aa-4668-ae4a-c77045efab8b None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:37.931168 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7d9d3-dfc6-4801-a02a-8a202529e0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:37.932307 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7d9d3-dfc6-4801-a02a-8a202529e0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:37.932723 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7d9d3-dfc6-4801-a02a-8a202529e0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:37.933158 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7d9d3-dfc6-4801-a02a-8a202529e0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:37.934687 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7d9d3-dfc6-4801-a02a-8a202529e0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:37.937693 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7d9d3-dfc6-4801-a02a-8a202529e0d5 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:37.957253 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1254/2525] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:37.957253 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7d9d3-dfc6-4801-a02a-8a202529e0d5 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:37.958982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-24d7d9d3-dfc6-4801-a02a-8a202529e0d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:37.960391 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-923bd98a-7170-4957-8c04-cb4b0ab65f82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa43704eef4245f9820dac54b52b9a69', 'request_id': 'req-923bd98a-7170-4957-8c04-cb4b0ab65f82'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:37.973547 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-923bd98a-7170-4957-8c04-cb4b0ab65f82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa43704eef4245f9820dac54b52b9a69', 'request_id': 'req-923bd98a-7170-4957-8c04-cb4b0ab65f82'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:37.974922 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:38.001851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-923bd98a-7170-4957-8c04-cb4b0ab65f82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa43704eef4245f9820dac54b52b9a69', 'request_id': 'req-923bd98a-7170-4957-8c04-cb4b0ab65f82'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:38.013235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:38.020831 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-923bd98a-7170-4957-8c04-cb4b0ab65f82 admin admin] The token cache is being invalidate because project fa43704eef4245f9820dac54b52b9a69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:22:38.021753 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-923bd98a-7170-4957-8c04-cb4b0ab65f82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:38.022830 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-923bd98a-7170-4957-8c04-cb4b0ab65f82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:38.025420 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1272/2526] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:22:37 2022] DELETE /identity/v3/projects/fa43704eef4245f9820dac54b52b9a69 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:38.032314 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bd98a-7170-4957-8c04-cb4b0ab65f82 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:38.034824 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-923bd98a-7170-4957-8c04-cb4b0ab65f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:38.060604 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7d9d3-dfc6-4801-a02a-8a202529e0d5 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:38.124263 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bd98a-7170-4957-8c04-cb4b0ab65f82 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:38.129496 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c7fb3-ac83-4a34-8541-819914eac0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:38.130052 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c7fb3-ac83-4a34-8541-819914eac0be admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:38.130332 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c7fb3-ac83-4a34-8541-819914eac0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:38.130606 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c7fb3-ac83-4a34-8541-819914eac0be admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:38.131292 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c7fb3-ac83-4a34-8541-819914eac0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:38.132911 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c7fb3-ac83-4a34-8541-819914eac0be admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:38.136320 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f24f2-76f6-41e4-aa68-e577bc41c231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:38.136888 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f24f2-76f6-41e4-aa68-e577bc41c231 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:38.137249 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f24f2-76f6-41e4-aa68-e577bc41c231 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:38.137672 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f24f2-76f6-41e4-aa68-e577bc41c231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:38.140584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-9e8f24f2-76f6-41e4-aa68-e577bc41c231 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:38.145315 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1273/2527] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:38.146546 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c7fb3-ac83-4a34-8541-819914eac0be admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:38.151375 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dc7c7fb3-ac83-4a34-8541-819914eac0be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:38.160986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f24f2-76f6-41e4-aa68-e577bc41c231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:38.162444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f24f2-76f6-41e4-aa68-e577bc41c231 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:38.164289 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c7fb3-ac83-4a34-8541-819914eac0be admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:38.170904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af182b-e2d4-485e-bf1f-440f4ce3d800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:38.171785 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af182b-e2d4-485e-bf1f-440f4ce3d800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:38.172173 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af182b-e2d4-485e-bf1f-440f4ce3d800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:38.172547 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af182b-e2d4-485e-bf1f-440f4ce3d800 admin admin] PATH_INFO: `/v3/users/3be155fe94e041b29da054962ccd3a62` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:38.173851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af182b-e2d4-485e-bf1f-440f4ce3d800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3be155fe94e041b29da054962ccd3a62)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:38.175973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af182b-e2d4-485e-bf1f-440f4ce3d800 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:38.176460 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1255/2528] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:38.181519 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f24f2-76f6-41e4-aa68-e577bc41c231 service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:38.192753 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f24f2-76f6-41e4-aa68-e577bc41c231 service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:38.198725 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbf315-1034-4785-860a-ac0e7f2aaafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:38.199545 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbf315-1034-4785-860a-ac0e7f2aaafb admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:38.199894 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbf315-1034-4785-860a-ac0e7f2aaafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:38.200446 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbf315-1034-4785-860a-ac0e7f2aaafb admin admin] PATH_INFO: `/v3/projects/ac38987d5b324909a8aec80b26623f66/users/88080eae1e4b45b8861e24f8afdc925d/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:38.222701 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbf315-1034-4785-860a-ac0e7f2aaafb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac38987d5b324909a8aec80b26623f66, user_id=88080eae1e4b45b8861e24f8afdc925d, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:38.225973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbf315-1034-4785-860a-ac0e7f2aaafb admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:38.243216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-01af182b-e2d4-485e-bf1f-440f4ce3d800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3be155fe94e041b29da054962ccd3a62'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:38.244317 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-01af182b-e2d4-485e-bf1f-440f4ce3d800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3be155fe94e041b29da054962ccd3a62'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:38.250370 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1256/2529] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:38 2022] PUT /identity/v3/projects/ac38987d5b324909a8aec80b26623f66/users/88080eae1e4b45b8861e24f8afdc925d/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:38.256407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-01af182b-e2d4-485e-bf1f-440f4ce3d800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3be155fe94e041b29da054962ccd3a62'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:38.261753 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874a074-fa46-48d5-8004-0c76c2aee4c5 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:38.262016 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874a074-fa46-48d5-8004-0c76c2aee4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:38.262382 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874a074-fa46-48d5-8004-0c76c2aee4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:38.271473 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-01af182b-e2d4-485e-bf1f-440f4ce3d800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3be155fe94e041b29da054962ccd3a62'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:38.289883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-01af182b-e2d4-485e-bf1f-440f4ce3d800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3be155fe94e041b29da054962ccd3a62'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:38.296364 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-3874a074-fa46-48d5-8004-0c76c2aee4c5 None None] MFA Rules not processed for user `88080eae1e4b45b8861e24f8afdc925d`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:38.297618 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3874a074-fa46-48d5-8004-0c76c2aee4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:38.301656 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1274/2530] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:22:38 2022] DELETE /identity/v3/users/3be155fe94e041b29da054962ccd3a62 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:38.442975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1257/2531] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:38 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:22:38.447931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af182b-e2d4-485e-bf1f-440f4ce3d800 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:38.449866 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-01af182b-e2d4-485e-bf1f-440f4ce3d800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:38.539110 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874a074-fa46-48d5-8004-0c76c2aee4c5 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:38.543875 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3874a074-fa46-48d5-8004-0c76c2aee4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:38.569648 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af182b-e2d4-485e-bf1f-440f4ce3d800 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:38.577939 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b755ee-affc-45bd-b912-45c811484d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:38.579295 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b755ee-affc-45bd-b912-45c811484d8f admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:38.580083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b755ee-affc-45bd-b912-45c811484d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:38.580645 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b755ee-affc-45bd-b912-45c811484d8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:38.581704 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b755ee-affc-45bd-b912-45c811484d8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:38.585260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b755ee-affc-45bd-b912-45c811484d8f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:38.597858 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:38.601319 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:38.624217 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1275/2532] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:22:38 2022] POST /identity/v3/projects => generated 407 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:22:38.625098 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b755ee-affc-45bd-b912-45c811484d8f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:38.626761 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a2b755ee-affc-45bd-b912-45c811484d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:38.653569 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874a074-fa46-48d5-8004-0c76c2aee4c5 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:38.706507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b755ee-affc-45bd-b912-45c811484d8f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:38.712410 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed64fe2-90ba-4a9d-9c47-e0a207e8ebe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:38.713337 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed64fe2-90ba-4a9d-9c47-e0a207e8ebe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:38.713779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed64fe2-90ba-4a9d-9c47-e0a207e8ebe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:38.714101 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed64fe2-90ba-4a9d-9c47-e0a207e8ebe4 admin admin] PATH_INFO: `/v3/projects/1ef5638bdfcc41f4a943ad0b083ebaef` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:38.715629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed64fe2-90ba-4a9d-9c47-e0a207e8ebe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef5638bdfcc41f4a943ad0b083ebaef)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:38.717623 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed64fe2-90ba-4a9d-9c47-e0a207e8ebe4 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:38.737101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477d888-1b1b-47b4-a2b7-49ebab2339bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:38.738055 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477d888-1b1b-47b4-a2b7-49ebab2339bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:38.738508 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477d888-1b1b-47b4-a2b7-49ebab2339bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:38.738938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477d888-1b1b-47b4-a2b7-49ebab2339bc admin admin] PATH_INFO: `/v3/projects/b5901b84626b42008d30df496f48c834` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:38.740821 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477d888-1b1b-47b4-a2b7-49ebab2339bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5901b84626b42008d30df496f48c834)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:38.745029 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477d888-1b1b-47b4-a2b7-49ebab2339bc admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:38.778996 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7ed64fe2-90ba-4a9d-9c47-e0a207e8ebe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef5638bdfcc41f4a943ad0b083ebaef', 'request_id': 'req-7ed64fe2-90ba-4a9d-9c47-e0a207e8ebe4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:38.788241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7ed64fe2-90ba-4a9d-9c47-e0a207e8ebe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef5638bdfcc41f4a943ad0b083ebaef', 'request_id': 'req-7ed64fe2-90ba-4a9d-9c47-e0a207e8ebe4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:38.798080 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7ed64fe2-90ba-4a9d-9c47-e0a207e8ebe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef5638bdfcc41f4a943ad0b083ebaef', 'request_id': 'req-7ed64fe2-90ba-4a9d-9c47-e0a207e8ebe4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:38.809197 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e477d888-1b1b-47b4-a2b7-49ebab2339bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5901b84626b42008d30df496f48c834', 'request_id': 'req-e477d888-1b1b-47b4-a2b7-49ebab2339bc'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:38.813105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7ed64fe2-90ba-4a9d-9c47-e0a207e8ebe4 admin admin] The token cache is being invalidate because project 1ef5638bdfcc41f4a943ad0b083ebaef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:22:38.813581 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7ed64fe2-90ba-4a9d-9c47-e0a207e8ebe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:38.814410 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7ed64fe2-90ba-4a9d-9c47-e0a207e8ebe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:38.816945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1276/2533] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:22:38 2022] DELETE /identity/v3/projects/1ef5638bdfcc41f4a943ad0b083ebaef => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:38.817829 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed64fe2-90ba-4a9d-9c47-e0a207e8ebe4 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:38.819577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7ed64fe2-90ba-4a9d-9c47-e0a207e8ebe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:38.819710 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e477d888-1b1b-47b4-a2b7-49ebab2339bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5901b84626b42008d30df496f48c834', 'request_id': 'req-e477d888-1b1b-47b4-a2b7-49ebab2339bc'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:38.830323 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e477d888-1b1b-47b4-a2b7-49ebab2339bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5901b84626b42008d30df496f48c834', 'request_id': 'req-e477d888-1b1b-47b4-a2b7-49ebab2339bc'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:38.851269 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e477d888-1b1b-47b4-a2b7-49ebab2339bc admin admin] The token cache is being invalidate because project b5901b84626b42008d30df496f48c834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:22:38.852586 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e477d888-1b1b-47b4-a2b7-49ebab2339bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:38.853903 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e477d888-1b1b-47b4-a2b7-49ebab2339bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:38.856888 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1258/2534] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:22:38 2022] DELETE /identity/v3/projects/b5901b84626b42008d30df496f48c834 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:38.859336 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0bd62-83d1-4890-adef-cc6e16e8e9e7 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:38.859828 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0bd62-83d1-4890-adef-cc6e16e8e9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:38.860357 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0bd62-83d1-4890-adef-cc6e16e8e9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:38.889854 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-dce0bd62-83d1-4890-adef-cc6e16e8e9e7 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:38.891625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-dce0bd62-83d1-4890-adef-cc6e16e8e9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:38.921484 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed64fe2-90ba-4a9d-9c47-e0a207e8ebe4 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:38.966746 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:38.969489 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1259/2535] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:38.970382 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0bd62-83d1-4890-adef-cc6e16e8e9e7 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:38.971879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-dce0bd62-83d1-4890-adef-cc6e16e8e9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:38.989348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0bd62-83d1-4890-adef-cc6e16e8e9e7 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:39.001245 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff125a8-cbec-4fa8-adde-b0db3d03d4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:39.002444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff125a8-cbec-4fa8-adde-b0db3d03d4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:39.002984 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff125a8-cbec-4fa8-adde-b0db3d03d4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:39.003553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff125a8-cbec-4fa8-adde-b0db3d03d4d0 admin admin] PATH_INFO: `/v3/users/482c444f06ea43d793037e2e6dee8720` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:39.005650 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff125a8-cbec-4fa8-adde-b0db3d03d4d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=482c444f06ea43d793037e2e6dee8720)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:39.008810 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8fd76-2a05-401e-a335-5f4ae6dfda1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:39.009335 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff125a8-cbec-4fa8-adde-b0db3d03d4d0 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:39.009462 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8fd76-2a05-401e-a335-5f4ae6dfda1a admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:39.009687 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8fd76-2a05-401e-a335-5f4ae6dfda1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:39.010063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8fd76-2a05-401e-a335-5f4ae6dfda1a admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:39.010596 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8fd76-2a05-401e-a335-5f4ae6dfda1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:39.012665 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8fd76-2a05-401e-a335-5f4ae6dfda1a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:39.019073 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:39.043274 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1277/2536] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:22:38 2022] POST /identity/v3/users => generated 310 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:39.045321 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0920652-5fcc-488e-93d9-024c26ed244c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:39.045775 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0920652-5fcc-488e-93d9-024c26ed244c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:39.046288 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0920652-5fcc-488e-93d9-024c26ed244c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:39.073880 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e0920652-5fcc-488e-93d9-024c26ed244c None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:39.075186 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e0920652-5fcc-488e-93d9-024c26ed244c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:39.091372 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1278/2537] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:39.091372 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0920652-5fcc-488e-93d9-024c26ed244c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:39.091815 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-2ff125a8-cbec-4fa8-adde-b0db3d03d4d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '482c444f06ea43d793037e2e6dee8720'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:39.091815 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-2ff125a8-cbec-4fa8-adde-b0db3d03d4d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '482c444f06ea43d793037e2e6dee8720'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:39.092101 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e0920652-5fcc-488e-93d9-024c26ed244c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:39.103867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-2ff125a8-cbec-4fa8-adde-b0db3d03d4d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '482c444f06ea43d793037e2e6dee8720'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:39.109921 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0920652-5fcc-488e-93d9-024c26ed244c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:39.114334 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-2ff125a8-cbec-4fa8-adde-b0db3d03d4d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '482c444f06ea43d793037e2e6dee8720'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:39.116282 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d21492-ac98-4c85-b853-cdbbdeee765a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:39.117715 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d21492-ac98-4c85-b853-cdbbdeee765a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:39.117715 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d21492-ac98-4c85-b853-cdbbdeee765a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:39.118090 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d21492-ac98-4c85-b853-cdbbdeee765a admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:39.119045 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d21492-ac98-4c85-b853-cdbbdeee765a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:39.122386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d21492-ac98-4c85-b853-cdbbdeee765a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:39.131385 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-2ff125a8-cbec-4fa8-adde-b0db3d03d4d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '482c444f06ea43d793037e2e6dee8720'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:39.137005 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1279/2538] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:39.138170 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d21492-ac98-4c85-b853-cdbbdeee765a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:39.140876 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-68d21492-ac98-4c85-b853-cdbbdeee765a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:39.141220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1260/2539] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:22:38 2022] DELETE /identity/v3/users/482c444f06ea43d793037e2e6dee8720 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:39.142116 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff125a8-cbec-4fa8-adde-b0db3d03d4d0 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:39.143727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-2ff125a8-cbec-4fa8-adde-b0db3d03d4d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:39.159143 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d21492-ac98-4c85-b853-cdbbdeee765a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:39.242462 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff125a8-cbec-4fa8-adde-b0db3d03d4d0 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:39.245363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609eb4b1-6678-42d9-bb21-47f867dea474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:39.246412 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609eb4b1-6678-42d9-bb21-47f867dea474 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:39.246905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609eb4b1-6678-42d9-bb21-47f867dea474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:39.247432 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609eb4b1-6678-42d9-bb21-47f867dea474 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:39.248837 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609eb4b1-6678-42d9-bb21-47f867dea474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:22:39.248963 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97419675-57be-4583-b719-8ad22270eed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:39.249397 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609eb4b1-6678-42d9-bb21-47f867dea474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:39.250776 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97419675-57be-4583-b719-8ad22270eed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:39.250776 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97419675-57be-4583-b719-8ad22270eed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:39.250776 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97419675-57be-4583-b719-8ad22270eed9 admin admin] PATH_INFO: `/v3/projects/120dbf15bd5e4c519bf11e1af0e73b8e/users/2745cada391e4248822e6d7b8b871405/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:39.252782 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609eb4b1-6678-42d9-bb21-47f867dea474 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:39.275911 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97419675-57be-4583-b719-8ad22270eed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=120dbf15bd5e4c519bf11e1af0e73b8e, user_id=2745cada391e4248822e6d7b8b871405, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:39.276712 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1280/2540] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:22:39.279140 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97419675-57be-4583-b719-8ad22270eed9 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:39.281615 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609eb4b1-6678-42d9-bb21-47f867dea474 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:39.297836 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609eb4b1-6678-42d9-bb21-47f867dea474 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:39.299900 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1261/2541] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:39 2022] PUT /identity/v3/projects/120dbf15bd5e4c519bf11e1af0e73b8e/users/2745cada391e4248822e6d7b8b871405/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:39.304770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97419675-57be-4583-b719-8ad22270eed9 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:39.385129 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97419675-57be-4583-b719-8ad22270eed9 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:39.390376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc4676-d5f0-47a8-b74c-819bad0a569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:39.391031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc4676-d5f0-47a8-b74c-819bad0a569b admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:39.391307 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc4676-d5f0-47a8-b74c-819bad0a569b admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:39.391587 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc4676-d5f0-47a8-b74c-819bad0a569b admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:39.392237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc4676-d5f0-47a8-b74c-819bad0a569b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:39.393899 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc4676-d5f0-47a8-b74c-819bad0a569b admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:39.407461 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1262/2542] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:22:39.416125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc4676-d5f0-47a8-b74c-819bad0a569b admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:39.431081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:39.444736 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444898f7-9c8d-47fe-be33-4af494849caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:39.445135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc4676-d5f0-47a8-b74c-819bad0a569b admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:39.446665 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444898f7-9c8d-47fe-be33-4af494849caf admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:39.447500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444898f7-9c8d-47fe-be33-4af494849caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:39.447880 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444898f7-9c8d-47fe-be33-4af494849caf admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:39.449229 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444898f7-9c8d-47fe-be33-4af494849caf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:39.451431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444898f7-9c8d-47fe-be33-4af494849caf admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:39.452136 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626166b0-2659-4666-94e9-6003d60f7046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:39.452819 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626166b0-2659-4666-94e9-6003d60f7046 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:39.453105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626166b0-2659-4666-94e9-6003d60f7046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:39.453642 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626166b0-2659-4666-94e9-6003d60f7046 admin admin] PATH_INFO: `/v3/projects/120dbf15bd5e4c519bf11e1af0e73b8e/users/2745cada391e4248822e6d7b8b871405/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:39.457174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626166b0-2659-4666-94e9-6003d60f7046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=120dbf15bd5e4c519bf11e1af0e73b8e, user_id=2745cada391e4248822e6d7b8b871405, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:39.462456 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626166b0-2659-4666-94e9-6003d60f7046 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:39.481008 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1263/2543] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:39 2022] PUT /identity/v3/projects/120dbf15bd5e4c519bf11e1af0e73b8e/users/2745cada391e4248822e6d7b8b871405/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:39.490465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1281/2544] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:22:39 2022] POST /identity/v3/projects => generated 357 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:22:39.492264 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799bd11-17de-4b4a-8cdd-d8210cf23790 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:39.496806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799bd11-17de-4b4a-8cdd-d8210cf23790 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:39.496806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799bd11-17de-4b4a-8cdd-d8210cf23790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:39.499346 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444898f7-9c8d-47fe-be33-4af494849caf admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:39.531142 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:39.549550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-b799bd11-17de-4b4a-8cdd-d8210cf23790 None None] MFA Rules not processed for user `2745cada391e4248822e6d7b8b871405`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:39.550871 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-b799bd11-17de-4b4a-8cdd-d8210cf23790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:39.580870 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444898f7-9c8d-47fe-be33-4af494849caf admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:39.586077 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19580b-1106-484f-bd08-affec6024ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:39.587321 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19580b-1106-484f-bd08-affec6024ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:39.587604 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19580b-1106-484f-bd08-affec6024ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:39.587875 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19580b-1106-484f-bd08-affec6024ad3 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:39.588505 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19580b-1106-484f-bd08-affec6024ad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:39.590463 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19580b-1106-484f-bd08-affec6024ad3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:39.616265 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1282/2545] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:22:39 2022] POST /identity/v3/users => generated 279 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:39.619044 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19580b-1106-484f-bd08-affec6024ad3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:39.621682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6d19580b-1106-484f-bd08-affec6024ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:39.631754 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1264/2546] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:39 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:39.634161 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b244fa-c099-41dc-94b8-ee14692ef28f None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:39.634451 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b244fa-c099-41dc-94b8-ee14692ef28f None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:39.634732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b244fa-c099-41dc-94b8-ee14692ef28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:39.648236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19580b-1106-484f-bd08-affec6024ad3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:39.653117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21923aac-8744-4ac6-9fb4-96ab0d0a0189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:39.653757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21923aac-8744-4ac6-9fb4-96ab0d0a0189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:39.654035 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21923aac-8744-4ac6-9fb4-96ab0d0a0189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:39.654310 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21923aac-8744-4ac6-9fb4-96ab0d0a0189 admin admin] PATH_INFO: `/v3/projects/217633d6ec3d4912a4b5faa1b8b2c2e1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:39.655645 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21923aac-8744-4ac6-9fb4-96ab0d0a0189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=217633d6ec3d4912a4b5faa1b8b2c2e1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:39.657924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21923aac-8744-4ac6-9fb4-96ab0d0a0189 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:39.660794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-a1b244fa-c099-41dc-94b8-ee14692ef28f None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:39.661985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-a1b244fa-c099-41dc-94b8-ee14692ef28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:39.671680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1265/2547] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Aug 10 13:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:39.672536 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b244fa-c099-41dc-94b8-ee14692ef28f None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:39.682753 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b244fa-c099-41dc-94b8-ee14692ef28f None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:39.688549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19482412-3747-4125-81d0-4c352fb3a4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:39.689380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19482412-3747-4125-81d0-4c352fb3a4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:39.689651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19482412-3747-4125-81d0-4c352fb3a4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:39.689998 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19482412-3747-4125-81d0-4c352fb3a4f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:39.690649 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19482412-3747-4125-81d0-4c352fb3a4f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:39.692476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19482412-3747-4125-81d0-4c352fb3a4f6 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:39.703763 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1266/2548] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:39.704882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19482412-3747-4125-81d0-4c352fb3a4f6 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:39.706892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-19482412-3747-4125-81d0-4c352fb3a4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:39.708734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-21923aac-8744-4ac6-9fb4-96ab0d0a0189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '217633d6ec3d4912a4b5faa1b8b2c2e1', 'request_id': 'req-21923aac-8744-4ac6-9fb4-96ab0d0a0189'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:39.717510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-21923aac-8744-4ac6-9fb4-96ab0d0a0189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '217633d6ec3d4912a4b5faa1b8b2c2e1', 'request_id': 'req-21923aac-8744-4ac6-9fb4-96ab0d0a0189'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:39.725333 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-21923aac-8744-4ac6-9fb4-96ab0d0a0189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '217633d6ec3d4912a4b5faa1b8b2c2e1', 'request_id': 'req-21923aac-8744-4ac6-9fb4-96ab0d0a0189'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:39.737795 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-21923aac-8744-4ac6-9fb4-96ab0d0a0189 admin admin] The token cache is being invalidate because project 217633d6ec3d4912a4b5faa1b8b2c2e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:22:39.738084 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-21923aac-8744-4ac6-9fb4-96ab0d0a0189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:39.738776 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-21923aac-8744-4ac6-9fb4-96ab0d0a0189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:39.740339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1283/2549] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:22:39 2022] DELETE /identity/v3/projects/217633d6ec3d4912a4b5faa1b8b2c2e1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:39.743879 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21923aac-8744-4ac6-9fb4-96ab0d0a0189 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:39.745453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-21923aac-8744-4ac6-9fb4-96ab0d0a0189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:39.772382 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19482412-3747-4125-81d0-4c352fb3a4f6 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:39.819443 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21923aac-8744-4ac6-9fb4-96ab0d0a0189 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:39.825621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf9691-1740-49fe-9e0d-ed95d8bb19b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:39.826243 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf9691-1740-49fe-9e0d-ed95d8bb19b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:39.826517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf9691-1740-49fe-9e0d-ed95d8bb19b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:39.826790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf9691-1740-49fe-9e0d-ed95d8bb19b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:39.827480 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf9691-1740-49fe-9e0d-ed95d8bb19b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:39.829110 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf9691-1740-49fe-9e0d-ed95d8bb19b2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:39.839187 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52eb4a-21da-4ca0-89de-bb74566404b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:39.840188 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52eb4a-21da-4ca0-89de-bb74566404b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:39.840312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1284/2550] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:39.840831 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf9691-1740-49fe-9e0d-ed95d8bb19b2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:39.842570 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3bcf9691-1740-49fe-9e0d-ed95d8bb19b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:39.843327 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52eb4a-21da-4ca0-89de-bb74566404b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:39.843635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52eb4a-21da-4ca0-89de-bb74566404b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:39.845468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-cf52eb4a-21da-4ca0-89de-bb74566404b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:39.874404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:39.879861 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:39.918464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52eb4a-21da-4ca0-89de-bb74566404b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:39.919961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52eb4a-21da-4ca0-89de-bb74566404b9 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:39.933423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1267/2551] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:39 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:39.935810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd78ba-ed52-4a4e-82d5-bca2e79085b3 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:39.936105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd78ba-ed52-4a4e-82d5-bca2e79085b3 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:39.936383 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd78ba-ed52-4a4e-82d5-bca2e79085b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:39.937320 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf9691-1740-49fe-9e0d-ed95d8bb19b2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:39.947147 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210c3b2-808e-437f-8d54-a4963e81782c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:39.948113 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210c3b2-808e-437f-8d54-a4963e81782c service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:39.948730 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210c3b2-808e-437f-8d54-a4963e81782c service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:39.949005 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210c3b2-808e-437f-8d54-a4963e81782c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:39.952030 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3210c3b2-808e-437f-8d54-a4963e81782c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:39.959680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-eedd78ba-ed52-4a4e-82d5-bca2e79085b3 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:39.961004 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-eedd78ba-ed52-4a4e-82d5-bca2e79085b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:39.969543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1268/2552] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:39.970188 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd78ba-ed52-4a4e-82d5-bca2e79085b3 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:39.978849 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210c3b2-808e-437f-8d54-a4963e81782c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:39.980734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210c3b2-808e-437f-8d54-a4963e81782c service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:39.987039 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd78ba-ed52-4a4e-82d5-bca2e79085b3 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:39.993649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1285/2553] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:39.994969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95a6ee-a271-4184-9a1a-14da20581bc1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:39.995279 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95a6ee-a271-4184-9a1a-14da20581bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:39.995622 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95a6ee-a271-4184-9a1a-14da20581bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:39.999105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31324816-3cd4-40c3-b6c2-ecc8d6aa136b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:39.999876 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31324816-3cd4-40c3-b6c2-ecc8d6aa136b admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:40.000236 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31324816-3cd4-40c3-b6c2-ecc8d6aa136b admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:40.000576 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31324816-3cd4-40c3-b6c2-ecc8d6aa136b admin admin] PATH_INFO: `/v3/projects/8e936d2764d9431fb35706caa104a31e/users/728f2b64aff14ac1a646422e0d3b61cb/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:40.019441 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4c95a6ee-a271-4184-9a1a-14da20581bc1 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:40.020905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4c95a6ee-a271-4184-9a1a-14da20581bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:40.025800 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31324816-3cd4-40c3-b6c2-ecc8d6aa136b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e936d2764d9431fb35706caa104a31e, user_id=728f2b64aff14ac1a646422e0d3b61cb, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:40.028963 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31324816-3cd4-40c3-b6c2-ecc8d6aa136b admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:40.035131 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1286/2554] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:40.037612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95a6ee-a271-4184-9a1a-14da20581bc1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:40.049593 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95a6ee-a271-4184-9a1a-14da20581bc1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:40.056729 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1269/2555] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:39 2022] PUT /identity/v3/projects/8e936d2764d9431fb35706caa104a31e/users/728f2b64aff14ac1a646422e0d3b61cb/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:40.072405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bb023-5eed-428a-8dba-8990a2478c17 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:40.072405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bb023-5eed-428a-8dba-8990a2478c17 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:40.072405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bb023-5eed-428a-8dba-8990a2478c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:40.121989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-ef9bb023-5eed-428a-8dba-8990a2478c17 None None] MFA Rules not processed for user `728f2b64aff14ac1a646422e0d3b61cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:40.123726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-ef9bb023-5eed-428a-8dba-8990a2478c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:40.136200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8268b91-f1f7-4e62-9bd8-127b57b3908a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:40.137132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8268b91-f1f7-4e62-9bd8-127b57b3908a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:40.137677 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8268b91-f1f7-4e62-9bd8-127b57b3908a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:40.138905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8268b91-f1f7-4e62-9bd8-127b57b3908a admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:40.139850 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8268b91-f1f7-4e62-9bd8-127b57b3908a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:22:40.140261 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8268b91-f1f7-4e62-9bd8-127b57b3908a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:40.142866 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8268b91-f1f7-4e62-9bd8-127b57b3908a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:40.165336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1287/2556] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:22:40.166455 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8268b91-f1f7-4e62-9bd8-127b57b3908a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:40.179212 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8268b91-f1f7-4e62-9bd8-127b57b3908a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:40.185973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721e11a-d023-42d3-a28d-8282655c01d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:40.187299 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721e11a-d023-42d3-a28d-8282655c01d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:40.187599 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721e11a-d023-42d3-a28d-8282655c01d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:40.187856 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721e11a-d023-42d3-a28d-8282655c01d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:40.188778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721e11a-d023-42d3-a28d-8282655c01d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:40.191109 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721e11a-d023-42d3-a28d-8282655c01d3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:40.221294 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1270/2557] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:22:40.225141 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bb023-5eed-428a-8dba-8990a2478c17 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:40.225419 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-ef9bb023-5eed-428a-8dba-8990a2478c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:40.241825 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1288/2558] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:22:40 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:40.247749 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721e11a-d023-42d3-a28d-8282655c01d3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:40.311737 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bb023-5eed-428a-8dba-8990a2478c17 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:40.322983 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721e11a-d023-42d3-a28d-8282655c01d3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:40.328082 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd1e34-520e-4464-85fb-584f01bb1af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:40.329074 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd1e34-520e-4464-85fb-584f01bb1af2 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:40.329652 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd1e34-520e-4464-85fb-584f01bb1af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:40.330710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd1e34-520e-4464-85fb-584f01bb1af2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:40.331726 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd1e34-520e-4464-85fb-584f01bb1af2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:40.334928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd1e34-520e-4464-85fb-584f01bb1af2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:40.349030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:40.365720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1289/2559] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:22:40 2022] POST /identity/v3/projects => generated 355 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:40.366540 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd1e34-520e-4464-85fb-584f01bb1af2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:40.370460 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60dfaca-c7ef-49a0-8a74-45c3a4844646 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:40.371101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60dfaca-c7ef-49a0-8a74-45c3a4844646 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:40.371400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60dfaca-c7ef-49a0-8a74-45c3a4844646 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:40.371653 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60dfaca-c7ef-49a0-8a74-45c3a4844646 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:40.373555 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-a60dfaca-c7ef-49a0-8a74-45c3a4844646 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:40.373698 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:40.438410 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60dfaca-c7ef-49a0-8a74-45c3a4844646 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:40.439886 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60dfaca-c7ef-49a0-8a74-45c3a4844646 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:40.440247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd1e34-520e-4464-85fb-584f01bb1af2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:40.445767 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87520a5-e1c2-4120-8489-cff6c36078eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:40.446400 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87520a5-e1c2-4120-8489-cff6c36078eb admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:40.446667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87520a5-e1c2-4120-8489-cff6c36078eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:40.446934 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87520a5-e1c2-4120-8489-cff6c36078eb admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:40.447587 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87520a5-e1c2-4120-8489-cff6c36078eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:40.449430 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1271/2560] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:40 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:40.450315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60dfaca-c7ef-49a0-8a74-45c3a4844646 service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:40.451269 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87520a5-e1c2-4120-8489-cff6c36078eb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:40.462511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60dfaca-c7ef-49a0-8a74-45c3a4844646 service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:40.468402 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d8650-6e69-4afe-a9b6-d1a2f82b7606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:40.469021 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d8650-6e69-4afe-a9b6-d1a2f82b7606 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:40.469305 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d8650-6e69-4afe-a9b6-d1a2f82b7606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:40.469580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d8650-6e69-4afe-a9b6-d1a2f82b7606 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:40.470199 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d8650-6e69-4afe-a9b6-d1a2f82b7606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:40.472174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d8650-6e69-4afe-a9b6-d1a2f82b7606 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:40.478988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1290/2561] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:22:40 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:40.484426 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87520a5-e1c2-4120-8489-cff6c36078eb admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:40.497256 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87520a5-e1c2-4120-8489-cff6c36078eb admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:40.499218 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1272/2562] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:22:40 2022] POST /identity/v3/users => generated 284 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:40.503155 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d8650-6e69-4afe-a9b6-d1a2f82b7606 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:40.504702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49778f8f-24b7-4100-9295-7cb866632d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:40.505326 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49778f8f-24b7-4100-9295-7cb866632d3a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:40.505606 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49778f8f-24b7-4100-9295-7cb866632d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:40.505882 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49778f8f-24b7-4100-9295-7cb866632d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:40.506535 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49778f8f-24b7-4100-9295-7cb866632d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:40.508196 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49778f8f-24b7-4100-9295-7cb866632d3a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:40.514122 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d8650-6e69-4afe-a9b6-d1a2f82b7606 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:40.519153 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8619fe-9df6-41e5-a8e5-e1ab3b982200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:40.519768 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8619fe-9df6-41e5-a8e5-e1ab3b982200 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:40.520050 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8619fe-9df6-41e5-a8e5-e1ab3b982200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:40.520159 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1291/2563] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:22:40.520323 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8619fe-9df6-41e5-a8e5-e1ab3b982200 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:40.521151 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8619fe-9df6-41e5-a8e5-e1ab3b982200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:40.522761 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8619fe-9df6-41e5-a8e5-e1ab3b982200 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:40.527220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49778f8f-24b7-4100-9295-7cb866632d3a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:40.538349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1273/2564] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:22:40.539341 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8619fe-9df6-41e5-a8e5-e1ab3b982200 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:40.548616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49778f8f-24b7-4100-9295-7cb866632d3a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:40.555690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8619fe-9df6-41e5-a8e5-e1ab3b982200 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:40.558585 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b08a8-2a7b-4445-8dff-e15416dac83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:40.559238 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b08a8-2a7b-4445-8dff-e15416dac83f admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:40.559512 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b08a8-2a7b-4445-8dff-e15416dac83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:40.559789 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b08a8-2a7b-4445-8dff-e15416dac83f admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:40.560442 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b08a8-2a7b-4445-8dff-e15416dac83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:40.562045 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b08a8-2a7b-4445-8dff-e15416dac83f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:40.566877 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634ec1e-6f41-4ef4-b943-cce7c0d0715d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:40.569066 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634ec1e-6f41-4ef4-b943-cce7c0d0715d admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:40.569479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634ec1e-6f41-4ef4-b943-cce7c0d0715d admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:40.570397 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634ec1e-6f41-4ef4-b943-cce7c0d0715d admin admin] PATH_INFO: `/v3/projects/e5fc6b6ebfcf44b78cd2280cc4ff3106/users/ad283f5198424fd0882bfb1742c1cd16/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:40.573950 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1292/2565] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:22:40.579520 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b08a8-2a7b-4445-8dff-e15416dac83f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:40.601801 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b08a8-2a7b-4445-8dff-e15416dac83f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:40.607436 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634ec1e-6f41-4ef4-b943-cce7c0d0715d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5fc6b6ebfcf44b78cd2280cc4ff3106, user_id=ad283f5198424fd0882bfb1742c1cd16, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:40.610703 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634ec1e-6f41-4ef4-b943-cce7c0d0715d admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:40.611928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34146dde-7102-4cb9-b2f3-e23cb1affb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:40.613051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34146dde-7102-4cb9-b2f3-e23cb1affb8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:40.613535 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34146dde-7102-4cb9-b2f3-e23cb1affb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:40.614062 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34146dde-7102-4cb9-b2f3-e23cb1affb8a admin admin] PATH_INFO: `/v3/projects/b8f815ce0229429db40a6462daa1aaae/users/0bbbc64313be4b97ae403cb98f78391a/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:40.628649 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1274/2566] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:40 2022] PUT /identity/v3/projects/e5fc6b6ebfcf44b78cd2280cc4ff3106/users/ad283f5198424fd0882bfb1742c1cd16/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:22:40.632659 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634ec1e-6f41-4ef4-b943-cce7c0d0715d admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:40.636982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34146dde-7102-4cb9-b2f3-e23cb1affb8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8f815ce0229429db40a6462daa1aaae, user_id=0bbbc64313be4b97ae403cb98f78391a, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:40.642665 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34146dde-7102-4cb9-b2f3-e23cb1affb8a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:40.670694 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1293/2567] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:40 2022] PUT /identity/v3/projects/b8f815ce0229429db40a6462daa1aaae/users/0bbbc64313be4b97ae403cb98f78391a/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:22:40.684771 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f18628-38c2-47d0-a28c-195baa1872a6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:40.685123 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f18628-38c2-47d0-a28c-195baa1872a6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:40.685595 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f18628-38c2-47d0-a28c-195baa1872a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:40.716856 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634ec1e-6f41-4ef4-b943-cce7c0d0715d admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:40.725266 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-41f18628-38c2-47d0-a28c-195baa1872a6 None None] MFA Rules not processed for user `0bbbc64313be4b97ae403cb98f78391a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:40.727053 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-41f18628-38c2-47d0-a28c-195baa1872a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:40.803328 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:40.832222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafe991-2de8-4b79-a4cc-d462b54bdef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:40.833727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafe991-2de8-4b79-a4cc-d462b54bdef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:40.834223 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafe991-2de8-4b79-a4cc-d462b54bdef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:40.834708 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafe991-2de8-4b79-a4cc-d462b54bdef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:40.835982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafe991-2de8-4b79-a4cc-d462b54bdef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:40.839512 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafe991-2de8-4b79-a4cc-d462b54bdef0 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:40.859765 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1275/2568] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:40.860926 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafe991-2de8-4b79-a4cc-d462b54bdef0 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:40.866289 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1294/2569] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:40.873296 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafe991-2de8-4b79-a4cc-d462b54bdef0 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:40.880224 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba169a65-2375-4040-aecf-b48a7a130f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:40.880999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba169a65-2375-4040-aecf-b48a7a130f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:40.881164 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba169a65-2375-4040-aecf-b48a7a130f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:40.881414 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba169a65-2375-4040-aecf-b48a7a130f1c admin admin] PATH_INFO: `/v3/projects/e5fc6b6ebfcf44b78cd2280cc4ff3106/users/ad283f5198424fd0882bfb1742c1cd16/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:40.884003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba169a65-2375-4040-aecf-b48a7a130f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5fc6b6ebfcf44b78cd2280cc4ff3106, user_id=ad283f5198424fd0882bfb1742c1cd16, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:40.886753 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba169a65-2375-4040-aecf-b48a7a130f1c admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:40.889593 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f18628-38c2-47d0-a28c-195baa1872a6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:40.902553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1276/2570] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:40 2022] PUT /identity/v3/projects/e5fc6b6ebfcf44b78cd2280cc4ff3106/users/ad283f5198424fd0882bfb1742c1cd16/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:40.913332 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8be0d-2bc0-4a23-90cb-f75d0d4a78be None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:40.913620 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8be0d-2bc0-4a23-90cb-f75d0d4a78be None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:40.913899 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8be0d-2bc0-4a23-90cb-f75d0d4a78be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:40.951954 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-acd8be0d-2bc0-4a23-90cb-f75d0d4a78be None None] MFA Rules not processed for user `ad283f5198424fd0882bfb1742c1cd16`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:40.953721 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-acd8be0d-2bc0-4a23-90cb-f75d0d4a78be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:40.956347 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:40.980474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f18628-38c2-47d0-a28c-195baa1872a6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:41.038579 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1277/2571] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:40 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:41.042312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06cd26-bd38-43b0-a8f9-64c75d2dea14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:41.042965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06cd26-bd38-43b0-a8f9-64c75d2dea14 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:41.043279 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06cd26-bd38-43b0-a8f9-64c75d2dea14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:41.043547 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06cd26-bd38-43b0-a8f9-64c75d2dea14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:41.050432 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8be0d-2bc0-4a23-90cb-f75d0d4a78be None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:41.051866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-acd8be0d-2bc0-4a23-90cb-f75d0d4a78be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:41.065031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8be0d-2bc0-4a23-90cb-f75d0d4a78be None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:41.068780 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bae6d-1a2b-4d63-bfc6-67d25f0254e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:41.069354 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bae6d-1a2b-4d63-bfc6-67d25f0254e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:41.069661 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bae6d-1a2b-4d63-bfc6-67d25f0254e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:41.069933 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bae6d-1a2b-4d63-bfc6-67d25f0254e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:41.079583 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602bae6d-1a2b-4d63-bfc6-67d25f0254e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:41.081021 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602bae6d-1a2b-4d63-bfc6-67d25f0254e7 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:41.091518 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1278/2572] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:41 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:22:41.107857 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06cd26-bd38-43b0-a8f9-64c75d2dea14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:41.109308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06cd26-bd38-43b0-a8f9-64c75d2dea14 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:41.119695 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1295/2573] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:41.172983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bae6d-1a2b-4d63-bfc6-67d25f0254e7 service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:41.182846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bae6d-1a2b-4d63-bfc6-67d25f0254e7 service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:41.187401 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4520f-2090-4fd8-a1d1-566e57a2c67b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:41.188009 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4520f-2090-4fd8-a1d1-566e57a2c67b service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:41.188314 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4520f-2090-4fd8-a1d1-566e57a2c67b service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:41.188730 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4520f-2090-4fd8-a1d1-566e57a2c67b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:41.252987 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4520f-2090-4fd8-a1d1-566e57a2c67b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:41.254867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4520f-2090-4fd8-a1d1-566e57a2c67b service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:41.265658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1279/2574] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:41 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:45.924710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06cd26-bd38-43b0-a8f9-64c75d2dea14 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:45.926173 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6e06cd26-bd38-43b0-a8f9-64c75d2dea14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:45.996785 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06cd26-bd38-43b0-a8f9-64c75d2dea14 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:46.001466 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912cf260-0e00-4ebc-829a-86fdf571151a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:46.002105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912cf260-0e00-4ebc-829a-86fdf571151a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:46.002386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912cf260-0e00-4ebc-829a-86fdf571151a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:46.002662 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912cf260-0e00-4ebc-829a-86fdf571151a admin admin] PATH_INFO: `/v3/users/88080eae1e4b45b8861e24f8afdc925d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:46.003911 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912cf260-0e00-4ebc-829a-86fdf571151a admin admin] RBAC: Authorizing `identity:delete_user(user_id=88080eae1e4b45b8861e24f8afdc925d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:46.005822 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912cf260-0e00-4ebc-829a-86fdf571151a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:46.053951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-912cf260-0e00-4ebc-829a-86fdf571151a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88080eae1e4b45b8861e24f8afdc925d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:46.054962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-912cf260-0e00-4ebc-829a-86fdf571151a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88080eae1e4b45b8861e24f8afdc925d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:46.058376 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:46.065698 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-912cf260-0e00-4ebc-829a-86fdf571151a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88080eae1e4b45b8861e24f8afdc925d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:46.073584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-912cf260-0e00-4ebc-829a-86fdf571151a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88080eae1e4b45b8861e24f8afdc925d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:46.087363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-912cf260-0e00-4ebc-829a-86fdf571151a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88080eae1e4b45b8861e24f8afdc925d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:46.094621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1296/2575] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:22:45 2022] DELETE /identity/v3/users/88080eae1e4b45b8861e24f8afdc925d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:46.099058 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf41f9-f351-499a-a65a-2fbdc8a971a9 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:46.099525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf41f9-f351-499a-a65a-2fbdc8a971a9 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:46.099642 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf41f9-f351-499a-a65a-2fbdc8a971a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:46.119678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-8ecf41f9-f351-499a-a65a-2fbdc8a971a9 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:46.120911 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-8ecf41f9-f351-499a-a65a-2fbdc8a971a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:46.153346 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:46.179937 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1280/2576] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:46.193955 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912cf260-0e00-4ebc-829a-86fdf571151a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:46.195822 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-912cf260-0e00-4ebc-829a-86fdf571151a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:46.253988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912cf260-0e00-4ebc-829a-86fdf571151a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:46.257685 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f7e92-01aa-418a-b6e2-4b05fc9bdf41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:46.258286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f7e92-01aa-418a-b6e2-4b05fc9bdf41 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:46.258569 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f7e92-01aa-418a-b6e2-4b05fc9bdf41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:46.258847 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f7e92-01aa-418a-b6e2-4b05fc9bdf41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:46.268990 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f7e92-01aa-418a-b6e2-4b05fc9bdf41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:46.270429 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f7e92-01aa-418a-b6e2-4b05fc9bdf41 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:46.281204 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1297/2577] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:46.581143 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf41f9-f351-499a-a65a-2fbdc8a971a9 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:46.583075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-8ecf41f9-f351-499a-a65a-2fbdc8a971a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:46.598146 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf41f9-f351-499a-a65a-2fbdc8a971a9 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:46.604682 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa816b-ce05-4abd-848f-e6ed7bfe7130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:46.605468 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa816b-ce05-4abd-848f-e6ed7bfe7130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:46.605816 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa816b-ce05-4abd-848f-e6ed7bfe7130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:46.606261 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa816b-ce05-4abd-848f-e6ed7bfe7130 admin admin] PATH_INFO: `/v3/projects/ac38987d5b324909a8aec80b26623f66` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:46.607723 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa816b-ce05-4abd-848f-e6ed7bfe7130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac38987d5b324909a8aec80b26623f66)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:46.610662 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa816b-ce05-4abd-848f-e6ed7bfe7130 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:46.695635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-afaa816b-ce05-4abd-848f-e6ed7bfe7130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac38987d5b324909a8aec80b26623f66', 'request_id': 'req-afaa816b-ce05-4abd-848f-e6ed7bfe7130'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:46.703764 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-afaa816b-ce05-4abd-848f-e6ed7bfe7130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac38987d5b324909a8aec80b26623f66', 'request_id': 'req-afaa816b-ce05-4abd-848f-e6ed7bfe7130'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:46.715261 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-afaa816b-ce05-4abd-848f-e6ed7bfe7130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac38987d5b324909a8aec80b26623f66', 'request_id': 'req-afaa816b-ce05-4abd-848f-e6ed7bfe7130'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:46.733273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-afaa816b-ce05-4abd-848f-e6ed7bfe7130 admin admin] The token cache is being invalidate because project ac38987d5b324909a8aec80b26623f66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:22:46.733563 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-afaa816b-ce05-4abd-848f-e6ed7bfe7130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:46.735391 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-afaa816b-ce05-4abd-848f-e6ed7bfe7130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:46.738036 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1281/2578] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:22:46 2022] DELETE /identity/v3/projects/ac38987d5b324909a8aec80b26623f66 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:46.742039 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f7e92-01aa-418a-b6e2-4b05fc9bdf41 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:46.753693 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f7e92-01aa-418a-b6e2-4b05fc9bdf41 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:46.822951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23394331-c8e9-491f-8495-a3b435b34179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:46.823621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23394331-c8e9-491f-8495-a3b435b34179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:46.823900 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23394331-c8e9-491f-8495-a3b435b34179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:46.824185 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23394331-c8e9-491f-8495-a3b435b34179 admin admin] PATH_INFO: `/v3/users/2745cada391e4248822e6d7b8b871405` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:46.825452 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23394331-c8e9-491f-8495-a3b435b34179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2745cada391e4248822e6d7b8b871405)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:46.827447 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23394331-c8e9-491f-8495-a3b435b34179 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:46.890898 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-23394331-c8e9-491f-8495-a3b435b34179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2745cada391e4248822e6d7b8b871405'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:46.891596 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-23394331-c8e9-491f-8495-a3b435b34179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2745cada391e4248822e6d7b8b871405'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:46.901649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-23394331-c8e9-491f-8495-a3b435b34179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2745cada391e4248822e6d7b8b871405'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:46.909907 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-23394331-c8e9-491f-8495-a3b435b34179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2745cada391e4248822e6d7b8b871405'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:46.917688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:46.924061 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-23394331-c8e9-491f-8495-a3b435b34179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2745cada391e4248822e6d7b8b871405'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:46.930849 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1298/2579] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:22:46 2022] DELETE /identity/v3/users/2745cada391e4248822e6d7b8b871405 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:47.264189 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa816b-ce05-4abd-848f-e6ed7bfe7130 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:47.266932 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-afaa816b-ce05-4abd-848f-e6ed7bfe7130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:47.281126 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa816b-ce05-4abd-848f-e6ed7bfe7130 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:47.343762 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df932e-2bc2-4cf7-bb64-db3059fcc582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:47.344392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df932e-2bc2-4cf7-bb64-db3059fcc582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:47.344668 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df932e-2bc2-4cf7-bb64-db3059fcc582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:47.344934 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df932e-2bc2-4cf7-bb64-db3059fcc582 admin admin] PATH_INFO: `/v3/projects/120dbf15bd5e4c519bf11e1af0e73b8e` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:47.346041 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df932e-2bc2-4cf7-bb64-db3059fcc582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=120dbf15bd5e4c519bf11e1af0e73b8e)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:47.347976 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df932e-2bc2-4cf7-bb64-db3059fcc582 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:47.396323 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-31df932e-2bc2-4cf7-bb64-db3059fcc582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '120dbf15bd5e4c519bf11e1af0e73b8e', 'request_id': 'req-31df932e-2bc2-4cf7-bb64-db3059fcc582'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:47.402452 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-31df932e-2bc2-4cf7-bb64-db3059fcc582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '120dbf15bd5e4c519bf11e1af0e73b8e', 'request_id': 'req-31df932e-2bc2-4cf7-bb64-db3059fcc582'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:47.409656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-31df932e-2bc2-4cf7-bb64-db3059fcc582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '120dbf15bd5e4c519bf11e1af0e73b8e', 'request_id': 'req-31df932e-2bc2-4cf7-bb64-db3059fcc582'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:47.410863 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:47.424435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-31df932e-2bc2-4cf7-bb64-db3059fcc582 admin admin] The token cache is being invalidate because project 120dbf15bd5e4c519bf11e1af0e73b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:22:47.424723 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-31df932e-2bc2-4cf7-bb64-db3059fcc582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:47.425437 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-31df932e-2bc2-4cf7-bb64-db3059fcc582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:47.426963 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1282/2580] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:22:47 2022] DELETE /identity/v3/projects/120dbf15bd5e4c519bf11e1af0e73b8e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:47.432113 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233fa48-63aa-40fd-aa92-5f05c7615312 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:47.432400 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233fa48-63aa-40fd-aa92-5f05c7615312 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:47.432667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233fa48-63aa-40fd-aa92-5f05c7615312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:47.452386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c233fa48-63aa-40fd-aa92-5f05c7615312 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:47.453695 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c233fa48-63aa-40fd-aa92-5f05c7615312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:47.515096 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1299/2581] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:47.523135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45eb41-1a89-420d-911f-8a84250108f9 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:47.523423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45eb41-1a89-420d-911f-8a84250108f9 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:47.523727 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45eb41-1a89-420d-911f-8a84250108f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:47.544647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-2d45eb41-1a89-420d-911f-8a84250108f9 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:47.545815 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-2d45eb41-1a89-420d-911f-8a84250108f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:47.554231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1283/2582] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:47.558744 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233fa48-63aa-40fd-aa92-5f05c7615312 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:47.568785 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233fa48-63aa-40fd-aa92-5f05c7615312 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:47.573896 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236369dd-d5d6-42b5-90f9-06b8cb02cb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:47.574501 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236369dd-d5d6-42b5-90f9-06b8cb02cb53 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:47.574775 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236369dd-d5d6-42b5-90f9-06b8cb02cb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:47.575071 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236369dd-d5d6-42b5-90f9-06b8cb02cb53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:47.575723 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236369dd-d5d6-42b5-90f9-06b8cb02cb53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:22:47.576025 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236369dd-d5d6-42b5-90f9-06b8cb02cb53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:47.577637 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236369dd-d5d6-42b5-90f9-06b8cb02cb53 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:47.591256 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1300/2583] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:22:47.595106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45eb41-1a89-420d-911f-8a84250108f9 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:47.605584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45eb41-1a89-420d-911f-8a84250108f9 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:47.611718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b39aac-7743-404f-a7ec-b600e8036b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:47.612533 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b39aac-7743-404f-a7ec-b600e8036b6b admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:47.612867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b39aac-7743-404f-a7ec-b600e8036b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:47.613135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b39aac-7743-404f-a7ec-b600e8036b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:47.613825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b39aac-7743-404f-a7ec-b600e8036b6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:47.615944 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b39aac-7743-404f-a7ec-b600e8036b6b admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:47.657866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1284/2584] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:22:47 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:22:47.659291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236369dd-d5d6-42b5-90f9-06b8cb02cb53 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:47.669761 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236369dd-d5d6-42b5-90f9-06b8cb02cb53 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:47.735241 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687039a-04ff-42ec-ac67-51f814be572a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:47.735881 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687039a-04ff-42ec-ac67-51f814be572a admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:47.736313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687039a-04ff-42ec-ac67-51f814be572a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:47.736584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687039a-04ff-42ec-ac67-51f814be572a admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:47.737214 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687039a-04ff-42ec-ac67-51f814be572a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:47.739180 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687039a-04ff-42ec-ac67-51f814be572a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:47.768692 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1301/2585] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:22:47 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:47.769263 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b39aac-7743-404f-a7ec-b600e8036b6b admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:47.788081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b39aac-7743-404f-a7ec-b600e8036b6b admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:47.793983 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d785ccb-757a-4785-b9a4-b455fe37e963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:47.795094 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d785ccb-757a-4785-b9a4-b455fe37e963 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:47.795094 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d785ccb-757a-4785-b9a4-b455fe37e963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:47.795286 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d785ccb-757a-4785-b9a4-b455fe37e963 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:47.796498 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d785ccb-757a-4785-b9a4-b455fe37e963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:47.797919 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d785ccb-757a-4785-b9a4-b455fe37e963 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:47.814174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1285/2586] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:47.815213 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687039a-04ff-42ec-ac67-51f814be572a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:47.831727 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687039a-04ff-42ec-ac67-51f814be572a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:47.839694 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384967e1-7450-4c00-8a44-826fb54b6310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:47.840369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384967e1-7450-4c00-8a44-826fb54b6310 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:47.840651 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384967e1-7450-4c00-8a44-826fb54b6310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:47.840993 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384967e1-7450-4c00-8a44-826fb54b6310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:47.841677 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384967e1-7450-4c00-8a44-826fb54b6310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:47.843556 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384967e1-7450-4c00-8a44-826fb54b6310 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:47.867068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1302/2587] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:47.870522 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d785ccb-757a-4785-b9a4-b455fe37e963 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:47.881303 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d785ccb-757a-4785-b9a4-b455fe37e963 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:47.887079 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1a7dc-c923-4ca4-9df4-9049132bba97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:47.887775 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1a7dc-c923-4ca4-9df4-9049132bba97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:47.888157 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1a7dc-c923-4ca4-9df4-9049132bba97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:47.888322 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1a7dc-c923-4ca4-9df4-9049132bba97 admin admin] PATH_INFO: `/v3/projects/039a58dd9bf4494280cc0e8c14f0dd78/users/f2f1bc98be594f2eaa316e05b10fb35b/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:47.907988 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1a7dc-c923-4ca4-9df4-9049132bba97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=039a58dd9bf4494280cc0e8c14f0dd78, user_id=f2f1bc98be594f2eaa316e05b10fb35b, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:47.910679 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1a7dc-c923-4ca4-9df4-9049132bba97 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:47.927698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1286/2588] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:47 2022] PUT /identity/v3/projects/039a58dd9bf4494280cc0e8c14f0dd78/users/f2f1bc98be594f2eaa316e05b10fb35b/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:22:47.950304 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee91344-747a-48ab-bf16-98ffd32c2413 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:47.950852 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee91344-747a-48ab-bf16-98ffd32c2413 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:47.951052 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee91344-747a-48ab-bf16-98ffd32c2413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:47.982097 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0ee91344-747a-48ab-bf16-98ffd32c2413 None None] MFA Rules not processed for user `f2f1bc98be594f2eaa316e05b10fb35b`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:47.983394 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0ee91344-747a-48ab-bf16-98ffd32c2413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:48.034070 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:48.059427 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1303/2589] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:22:48.063848 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1a7dc-c923-4ca4-9df4-9049132bba97 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:48.265092 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1a7dc-c923-4ca4-9df4-9049132bba97 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:48.270829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d994d-f7f0-49ea-8b89-82444e5a700b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:48.271488 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d994d-f7f0-49ea-8b89-82444e5a700b admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:48.271766 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d994d-f7f0-49ea-8b89-82444e5a700b admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:48.272034 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d994d-f7f0-49ea-8b89-82444e5a700b admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:48.272668 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d994d-f7f0-49ea-8b89-82444e5a700b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:48.274561 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d994d-f7f0-49ea-8b89-82444e5a700b admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:48.304138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1287/2590] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:22:48 2022] POST /identity/v3/projects => generated 385 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:48.308525 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee91344-747a-48ab-bf16-98ffd32c2413 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:48.319995 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee91344-747a-48ab-bf16-98ffd32c2413 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:48.383718 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696307cb-4f4f-41bb-bbd5-a962552b091f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:48.384854 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696307cb-4f4f-41bb-bbd5-a962552b091f admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:48.385137 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696307cb-4f4f-41bb-bbd5-a962552b091f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:48.385408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696307cb-4f4f-41bb-bbd5-a962552b091f admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:48.386055 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696307cb-4f4f-41bb-bbd5-a962552b091f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:48.388026 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696307cb-4f4f-41bb-bbd5-a962552b091f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:48.416757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1304/2591] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:22:48 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:48.421021 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d994d-f7f0-49ea-8b89-82444e5a700b admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:48.438235 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d994d-f7f0-49ea-8b89-82444e5a700b admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:48.446042 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58db23a-e928-4d1a-844f-aeb3adc8ec88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:48.447649 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58db23a-e928-4d1a-844f-aeb3adc8ec88 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:48.447649 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58db23a-e928-4d1a-844f-aeb3adc8ec88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:48.448113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58db23a-e928-4d1a-844f-aeb3adc8ec88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:48.449527 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58db23a-e928-4d1a-844f-aeb3adc8ec88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:48.452946 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58db23a-e928-4d1a-844f-aeb3adc8ec88 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:48.471940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1288/2592] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:48.476371 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696307cb-4f4f-41bb-bbd5-a962552b091f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:48.487916 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696307cb-4f4f-41bb-bbd5-a962552b091f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:48.492733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b83bb9-fff5-4a07-86bd-d4faa10d9e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:48.493444 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b83bb9-fff5-4a07-86bd-d4faa10d9e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:48.494240 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b83bb9-fff5-4a07-86bd-d4faa10d9e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:48.494515 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b83bb9-fff5-4a07-86bd-d4faa10d9e09 admin admin] PATH_INFO: `/v3/projects/25f42d0671994d9a9d64e307d98a8d16/users/f19895db9d0040e8b4645098bca48873/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:48.511603 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b83bb9-fff5-4a07-86bd-d4faa10d9e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f42d0671994d9a9d64e307d98a8d16, user_id=f19895db9d0040e8b4645098bca48873, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:48.514968 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b83bb9-fff5-4a07-86bd-d4faa10d9e09 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:48.531037 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1305/2593] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:48 2022] PUT /identity/v3/projects/25f42d0671994d9a9d64e307d98a8d16/users/f19895db9d0040e8b4645098bca48873/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:48.534617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58db23a-e928-4d1a-844f-aeb3adc8ec88 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:48.546301 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58db23a-e928-4d1a-844f-aeb3adc8ec88 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:48.608162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe7824-c77c-4081-b596-ccd6c13d3345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:48.608683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe7824-c77c-4081-b596-ccd6c13d3345 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:48.608959 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe7824-c77c-4081-b596-ccd6c13d3345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:48.609228 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe7824-c77c-4081-b596-ccd6c13d3345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:48.609864 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe7824-c77c-4081-b596-ccd6c13d3345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:48.611494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe7824-c77c-4081-b596-ccd6c13d3345 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:48.616875 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:48.623737 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1289/2594] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:48.627397 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b83bb9-fff5-4a07-86bd-d4faa10d9e09 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:48.638060 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b83bb9-fff5-4a07-86bd-d4faa10d9e09 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:48.643174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944168a-7808-438c-9cd3-80e607f8a25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:48.643921 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944168a-7808-438c-9cd3-80e607f8a25b admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:48.644276 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944168a-7808-438c-9cd3-80e607f8a25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:48.644623 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944168a-7808-438c-9cd3-80e607f8a25b admin admin] PATH_INFO: `/v3/projects/25f42d0671994d9a9d64e307d98a8d16/users/f19895db9d0040e8b4645098bca48873/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:48.646679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944168a-7808-438c-9cd3-80e607f8a25b admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f42d0671994d9a9d64e307d98a8d16, user_id=f19895db9d0040e8b4645098bca48873, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:48.649338 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944168a-7808-438c-9cd3-80e607f8a25b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:48.660681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1306/2595] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:48 2022] PUT /identity/v3/projects/25f42d0671994d9a9d64e307d98a8d16/users/f19895db9d0040e8b4645098bca48873/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:48.672480 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64847655-eb43-40a0-bbb4-08fe10c7f5e9 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:48.672791 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64847655-eb43-40a0-bbb4-08fe10c7f5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:48.673094 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64847655-eb43-40a0-bbb4-08fe10c7f5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:48.701807 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-64847655-eb43-40a0-bbb4-08fe10c7f5e9 None None] MFA Rules not processed for user `f19895db9d0040e8b4645098bca48873`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:48.703043 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-64847655-eb43-40a0-bbb4-08fe10c7f5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:48.783359 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1290/2596] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:48.798619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944168a-7808-438c-9cd3-80e607f8a25b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:48.798619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7944168a-7808-438c-9cd3-80e607f8a25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:48.862826 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944168a-7808-438c-9cd3-80e607f8a25b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:48.867930 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a7ccd-8a34-4faf-b496-4149cfdf648a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:48.868631 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a7ccd-8a34-4faf-b496-4149cfdf648a service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:48.868933 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a7ccd-8a34-4faf-b496-4149cfdf648a service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:48.869205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a7ccd-8a34-4faf-b496-4149cfdf648a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:48.929689 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:48.944621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a7ccd-8a34-4faf-b496-4149cfdf648a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:48.946324 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a7ccd-8a34-4faf-b496-4149cfdf648a service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:48.957710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1307/2597] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:53.004260 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64847655-eb43-40a0-bbb4-08fe10c7f5e9 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:53.005669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-64847655-eb43-40a0-bbb4-08fe10c7f5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:53.070030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64847655-eb43-40a0-bbb4-08fe10c7f5e9 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:53.074543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414ae97-c978-436d-9492-b62d1a347606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:53.075194 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414ae97-c978-436d-9492-b62d1a347606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:53.075471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414ae97-c978-436d-9492-b62d1a347606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:53.075738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414ae97-c978-436d-9492-b62d1a347606 admin admin] PATH_INFO: `/v3/users/0bbbc64313be4b97ae403cb98f78391a` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:53.076846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414ae97-c978-436d-9492-b62d1a347606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bbbc64313be4b97ae403cb98f78391a)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:53.078744 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414ae97-c978-436d-9492-b62d1a347606 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:53.124209 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b414ae97-c978-436d-9492-b62d1a347606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bbbc64313be4b97ae403cb98f78391a'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:53.124853 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b414ae97-c978-436d-9492-b62d1a347606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bbbc64313be4b97ae403cb98f78391a'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:53.132383 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b414ae97-c978-436d-9492-b62d1a347606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bbbc64313be4b97ae403cb98f78391a'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:53.139602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b414ae97-c978-436d-9492-b62d1a347606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bbbc64313be4b97ae403cb98f78391a'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:53.151756 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b414ae97-c978-436d-9492-b62d1a347606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bbbc64313be4b97ae403cb98f78391a'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:53.157694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1291/2598] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:22:53 2022] DELETE /identity/v3/users/0bbbc64313be4b97ae403cb98f78391a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:53.162605 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e989851-c574-44e5-b0bf-8b47c8cc2055 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:53.163113 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e989851-c574-44e5-b0bf-8b47c8cc2055 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:53.163239 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e989851-c574-44e5-b0bf-8b47c8cc2055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:53.182334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6e989851-c574-44e5-b0bf-8b47c8cc2055 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:53.183561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6e989851-c574-44e5-b0bf-8b47c8cc2055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:53.240407 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1308/2599] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:53.250205 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414ae97-c978-436d-9492-b62d1a347606 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:53.251658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-b414ae97-c978-436d-9492-b62d1a347606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:53.258148 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:53.310410 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414ae97-c978-436d-9492-b62d1a347606 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:53.314007 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6a89a-47dd-4c71-8248-94b9a6436ba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:53.314598 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6a89a-47dd-4c71-8248-94b9a6436ba3 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:53.314872 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6a89a-47dd-4c71-8248-94b9a6436ba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:53.315178 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6a89a-47dd-4c71-8248-94b9a6436ba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:53.324080 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6a89a-47dd-4c71-8248-94b9a6436ba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:53.325416 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6a89a-47dd-4c71-8248-94b9a6436ba3 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:53.335179 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1292/2600] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:53.463963 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e989851-c574-44e5-b0bf-8b47c8cc2055 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:53.465461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6e989851-c574-44e5-b0bf-8b47c8cc2055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:53.527055 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e989851-c574-44e5-b0bf-8b47c8cc2055 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:53.531329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe051f-03de-496d-9d34-c55727c01b3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:53.531329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe051f-03de-496d-9d34-c55727c01b3e service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:53.535243 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe051f-03de-496d-9d34-c55727c01b3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:53.535556 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe051f-03de-496d-9d34-c55727c01b3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:53.537401 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cbbe051f-03de-496d-9d34-c55727c01b3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:53.615724 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe051f-03de-496d-9d34-c55727c01b3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:53.617214 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe051f-03de-496d-9d34-c55727c01b3e service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:53.630052 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6a89a-47dd-4c71-8248-94b9a6436ba3 service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:53.630566 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1309/2601] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:53.640965 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-f3d6a89a-47dd-4c71-8248-94b9a6436ba3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:53.660749 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6a89a-47dd-4c71-8248-94b9a6436ba3 service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:53.665985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0797782-1e33-4b79-babf-81baa14ee168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:53.666703 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0797782-1e33-4b79-babf-81baa14ee168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:53.667067 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0797782-1e33-4b79-babf-81baa14ee168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:53.667446 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0797782-1e33-4b79-babf-81baa14ee168 admin admin] PATH_INFO: `/v3/projects/b8f815ce0229429db40a6462daa1aaae` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:53.668735 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0797782-1e33-4b79-babf-81baa14ee168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8f815ce0229429db40a6462daa1aaae)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:53.672420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0797782-1e33-4b79-babf-81baa14ee168 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:53.735796 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b0797782-1e33-4b79-babf-81baa14ee168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8f815ce0229429db40a6462daa1aaae', 'request_id': 'req-b0797782-1e33-4b79-babf-81baa14ee168'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:53.741717 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b0797782-1e33-4b79-babf-81baa14ee168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8f815ce0229429db40a6462daa1aaae', 'request_id': 'req-b0797782-1e33-4b79-babf-81baa14ee168'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:53.751315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b0797782-1e33-4b79-babf-81baa14ee168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8f815ce0229429db40a6462daa1aaae', 'request_id': 'req-b0797782-1e33-4b79-babf-81baa14ee168'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:53.767811 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b0797782-1e33-4b79-babf-81baa14ee168 admin admin] The token cache is being invalidate because project b8f815ce0229429db40a6462daa1aaae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:22:53.768088 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b0797782-1e33-4b79-babf-81baa14ee168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:53.768888 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b0797782-1e33-4b79-babf-81baa14ee168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:53.771634 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1293/2602] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:22:53 2022] DELETE /identity/v3/projects/b8f815ce0229429db40a6462daa1aaae => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:22:53.777289 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd3c70-2f19-4733-990b-1ea08f9ee638 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:53.777664 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd3c70-2f19-4733-990b-1ea08f9ee638 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:53.778012 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd3c70-2f19-4733-990b-1ea08f9ee638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:53.811842 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2fbd3c70-2f19-4733-990b-1ea08f9ee638 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:53.813069 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2fbd3c70-2f19-4733-990b-1ea08f9ee638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:53.856563 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:53.886051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1310/2603] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:53.897510 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a58e7-3147-426d-8f75-97e5ad93e366 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:53.897510 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a58e7-3147-426d-8f75-97e5ad93e366 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:53.897510 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a58e7-3147-426d-8f75-97e5ad93e366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:53.902592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200b919-6ba1-4289-ad90-bd1cf510930a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:53.903097 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200b919-6ba1-4289-ad90-bd1cf510930a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:53.903538 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200b919-6ba1-4289-ad90-bd1cf510930a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:53.924893 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-9c9a58e7-3147-426d-8f75-97e5ad93e366 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:53.926392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-9c9a58e7-3147-426d-8f75-97e5ad93e366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:53.934596 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3200b919-6ba1-4289-ad90-bd1cf510930a None None] MFA Rules not processed for user `1d0c375aeddb41c5bb7a8174b6efcc4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:53.935912 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3200b919-6ba1-4289-ad90-bd1cf510930a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:53.941781 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1294/2604] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:53.946330 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a58e7-3147-426d-8f75-97e5ad93e366 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:53.961145 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a58e7-3147-426d-8f75-97e5ad93e366 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:53.968699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de253ad4-a3ec-4969-a17f-28c5bc1fbe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:53.969710 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de253ad4-a3ec-4969-a17f-28c5bc1fbe19 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:53.969990 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de253ad4-a3ec-4969-a17f-28c5bc1fbe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:53.970257 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de253ad4-a3ec-4969-a17f-28c5bc1fbe19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:53.971556 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de253ad4-a3ec-4969-a17f-28c5bc1fbe19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:22:53.971870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de253ad4-a3ec-4969-a17f-28c5bc1fbe19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:53.974558 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de253ad4-a3ec-4969-a17f-28c5bc1fbe19 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:54.005486 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1295/2605] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:22:54.009816 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de253ad4-a3ec-4969-a17f-28c5bc1fbe19 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:54.017141 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1311/2606] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:54.020697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de253ad4-a3ec-4969-a17f-28c5bc1fbe19 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:54.025435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7779c7-d249-4a61-ac38-3b94b09e573e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:54.026081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7779c7-d249-4a61-ac38-3b94b09e573e admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:54.026360 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7779c7-d249-4a61-ac38-3b94b09e573e admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:54.026632 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7779c7-d249-4a61-ac38-3b94b09e573e admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:54.027293 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7779c7-d249-4a61-ac38-3b94b09e573e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:54.029153 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7779c7-d249-4a61-ac38-3b94b09e573e admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:54.063378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1296/2607] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:22:54 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:22:54.067523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200b919-6ba1-4289-ad90-bd1cf510930a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:54.080126 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200b919-6ba1-4289-ad90-bd1cf510930a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:54.146008 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b947c16-95f6-4da2-bd7c-a0e3caeb2007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:54.146724 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b947c16-95f6-4da2-bd7c-a0e3caeb2007 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:54.147135 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b947c16-95f6-4da2-bd7c-a0e3caeb2007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:54.147471 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b947c16-95f6-4da2-bd7c-a0e3caeb2007 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:54.148168 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b947c16-95f6-4da2-bd7c-a0e3caeb2007 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:54.150155 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b947c16-95f6-4da2-bd7c-a0e3caeb2007 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:54.171997 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1312/2608] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:22:54 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:54.176284 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7779c7-d249-4a61-ac38-3b94b09e573e admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:54.188144 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7779c7-d249-4a61-ac38-3b94b09e573e admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:54.193327 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76692193-1651-4b3a-97f5-8cface74eaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:54.193919 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76692193-1651-4b3a-97f5-8cface74eaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:54.194192 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76692193-1651-4b3a-97f5-8cface74eaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:54.194454 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76692193-1651-4b3a-97f5-8cface74eaa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:54.195113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76692193-1651-4b3a-97f5-8cface74eaa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:54.196831 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76692193-1651-4b3a-97f5-8cface74eaa6 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:54.207946 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1297/2609] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:54.212092 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b947c16-95f6-4da2-bd7c-a0e3caeb2007 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:54.222725 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b947c16-95f6-4da2-bd7c-a0e3caeb2007 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:54.227524 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab008e25-1e89-4c46-9449-d5d522bbb4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:54.228165 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab008e25-1e89-4c46-9449-d5d522bbb4da admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:54.228447 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab008e25-1e89-4c46-9449-d5d522bbb4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:54.229270 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab008e25-1e89-4c46-9449-d5d522bbb4da admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:54.229915 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab008e25-1e89-4c46-9449-d5d522bbb4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:54.231547 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab008e25-1e89-4c46-9449-d5d522bbb4da admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:54.242446 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1313/2610] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:54.247435 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76692193-1651-4b3a-97f5-8cface74eaa6 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:54.257860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76692193-1651-4b3a-97f5-8cface74eaa6 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:54.262758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fb0c5-7118-4b07-bd98-fb44e9efbbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:54.263535 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fb0c5-7118-4b07-bd98-fb44e9efbbfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:54.263807 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fb0c5-7118-4b07-bd98-fb44e9efbbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:54.264073 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fb0c5-7118-4b07-bd98-fb44e9efbbfa admin admin] PATH_INFO: `/v3/projects/9e31e9029cb24c649675ec33bed20dbf/users/45913ce89fdd4041a927ba9aedbe3806/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:54.279174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fb0c5-7118-4b07-bd98-fb44e9efbbfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e31e9029cb24c649675ec33bed20dbf, user_id=45913ce89fdd4041a927ba9aedbe3806, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:54.281783 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fb0c5-7118-4b07-bd98-fb44e9efbbfa admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:54.296175 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1298/2611] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:54 2022] PUT /identity/v3/projects/9e31e9029cb24c649675ec33bed20dbf/users/45913ce89fdd4041a927ba9aedbe3806/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:54.306654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd12be-a005-48b2-a9d2-4f91bcd03e3b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:54.307700 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd12be-a005-48b2-a9d2-4f91bcd03e3b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:54.307979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd12be-a005-48b2-a9d2-4f91bcd03e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:54.337984 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8ccd12be-a005-48b2-a9d2-4f91bcd03e3b None None] MFA Rules not processed for user `45913ce89fdd4041a927ba9aedbe3806`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:54.339243 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8ccd12be-a005-48b2-a9d2-4f91bcd03e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:54.399482 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:54.415147 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1314/2612] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:54.416736 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fb0c5-7118-4b07-bd98-fb44e9efbbfa admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:54.429838 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:54.487716 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fb0c5-7118-4b07-bd98-fb44e9efbbfa admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:54.493761 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcc027-1548-4330-b755-1ebcdf5acf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:54.495147 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcc027-1548-4330-b755-1ebcdf5acf0e admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:54.495670 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcc027-1548-4330-b755-1ebcdf5acf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:54.496028 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcc027-1548-4330-b755-1ebcdf5acf0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:54.496730 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcc027-1548-4330-b755-1ebcdf5acf0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:54.498868 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcc027-1548-4330-b755-1ebcdf5acf0e admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:54.531853 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1299/2613] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:22:54 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:22:54.533401 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd12be-a005-48b2-a9d2-4f91bcd03e3b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:54.545592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd12be-a005-48b2-a9d2-4f91bcd03e3b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:54.627671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ae6ef-0282-438d-9602-445161da6a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:54.628296 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ae6ef-0282-438d-9602-445161da6a29 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:54.628703 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ae6ef-0282-438d-9602-445161da6a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:54.629048 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ae6ef-0282-438d-9602-445161da6a29 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:54.629747 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ae6ef-0282-438d-9602-445161da6a29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:54.631767 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ae6ef-0282-438d-9602-445161da6a29 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:54.662375 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1315/2614] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:22:54 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:54.667093 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcc027-1548-4330-b755-1ebcdf5acf0e admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:54.677625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcc027-1548-4330-b755-1ebcdf5acf0e admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:54.682354 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d3187-8f24-451b-9ed1-664dd80e110e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:54.682952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d3187-8f24-451b-9ed1-664dd80e110e admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:54.683255 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d3187-8f24-451b-9ed1-664dd80e110e admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:54.683524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d3187-8f24-451b-9ed1-664dd80e110e admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:54.684199 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d3187-8f24-451b-9ed1-664dd80e110e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:54.685826 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d3187-8f24-451b-9ed1-664dd80e110e admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:54.696882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1300/2615] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:54.701119 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ae6ef-0282-438d-9602-445161da6a29 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:54.712840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ae6ef-0282-438d-9602-445161da6a29 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:54.718203 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de347db1-b25d-47c8-b05d-541076d7d9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:54.718894 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de347db1-b25d-47c8-b05d-541076d7d9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:54.719276 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de347db1-b25d-47c8-b05d-541076d7d9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:54.719622 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de347db1-b25d-47c8-b05d-541076d7d9e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:54.720339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de347db1-b25d-47c8-b05d-541076d7d9e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:54.722027 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de347db1-b25d-47c8-b05d-541076d7d9e2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:54.733408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1316/2616] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:54.737525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d3187-8f24-451b-9ed1-664dd80e110e admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:54.747657 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d3187-8f24-451b-9ed1-664dd80e110e admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:54.752301 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446b1f1-1762-45e0-9952-5f7b9ae3e162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:54.752944 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446b1f1-1762-45e0-9952-5f7b9ae3e162 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:54.753222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446b1f1-1762-45e0-9952-5f7b9ae3e162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:54.753494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446b1f1-1762-45e0-9952-5f7b9ae3e162 admin admin] PATH_INFO: `/v3/projects/944c23a1cef7432f8da708e82709e5e0/users/206bdf0ea30844d5891a8df8aa650e74/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:54.772905 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446b1f1-1762-45e0-9952-5f7b9ae3e162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=944c23a1cef7432f8da708e82709e5e0, user_id=206bdf0ea30844d5891a8df8aa650e74, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:54.776461 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446b1f1-1762-45e0-9952-5f7b9ae3e162 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:54.795963 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1301/2617] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:54 2022] PUT /identity/v3/projects/944c23a1cef7432f8da708e82709e5e0/users/206bdf0ea30844d5891a8df8aa650e74/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:54.816724 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d806d-8b80-41f4-a522-88570276def5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:54.817213 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d806d-8b80-41f4-a522-88570276def5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:54.817494 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d806d-8b80-41f4-a522-88570276def5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:54.855669 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f28d806d-8b80-41f4-a522-88570276def5 None None] MFA Rules not processed for user `206bdf0ea30844d5891a8df8aa650e74`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:54.857093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f28d806d-8b80-41f4-a522-88570276def5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:54.929508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1317/2618] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:54.938372 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446b1f1-1762-45e0-9952-5f7b9ae3e162 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:55.034078 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446b1f1-1762-45e0-9952-5f7b9ae3e162 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:55.053268 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218998f2-cfdb-4c64-9e81-7709376338cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:55.053900 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218998f2-cfdb-4c64-9e81-7709376338cf admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:55.054683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218998f2-cfdb-4c64-9e81-7709376338cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:55.054965 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218998f2-cfdb-4c64-9e81-7709376338cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:55.055732 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218998f2-cfdb-4c64-9e81-7709376338cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:55.058250 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218998f2-cfdb-4c64-9e81-7709376338cf admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:55.096986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1302/2619] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:22:54 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:55.101247 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d806d-8b80-41f4-a522-88570276def5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:55.113695 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d806d-8b80-41f4-a522-88570276def5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:55.195134 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d892e-f669-40f4-bc16-f146f1280871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:55.196678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d892e-f669-40f4-bc16-f146f1280871 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:55.197055 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d892e-f669-40f4-bc16-f146f1280871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:55.197979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d892e-f669-40f4-bc16-f146f1280871 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:55.198705 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d892e-f669-40f4-bc16-f146f1280871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:55.201572 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d892e-f669-40f4-bc16-f146f1280871 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:55.216654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:55.238752 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1318/2620] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:22:55 2022] POST /identity/v3/users => generated 298 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:55.242373 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218998f2-cfdb-4c64-9e81-7709376338cf admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:55.252897 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218998f2-cfdb-4c64-9e81-7709376338cf admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:55.257671 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df32163-9817-4ca0-8693-57cdd53ed64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:55.258366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df32163-9817-4ca0-8693-57cdd53ed64f admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:55.258632 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df32163-9817-4ca0-8693-57cdd53ed64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:55.258952 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df32163-9817-4ca0-8693-57cdd53ed64f admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:55.259670 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df32163-9817-4ca0-8693-57cdd53ed64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:55.262234 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df32163-9817-4ca0-8693-57cdd53ed64f admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:55.284273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1303/2621] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:55.285330 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d892e-f669-40f4-bc16-f146f1280871 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:55.298645 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d892e-f669-40f4-bc16-f146f1280871 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:55.303840 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5362a69-94ee-4ec8-aab4-7c712ae3a073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:55.304529 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5362a69-94ee-4ec8-aab4-7c712ae3a073 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:55.304826 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5362a69-94ee-4ec8-aab4-7c712ae3a073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:55.305236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5362a69-94ee-4ec8-aab4-7c712ae3a073 admin admin] PATH_INFO: `/v3/projects/d1cac850b3d946e9ac65d39c0ca79121/users/2b144f26934b476b8673e8382dd65f1b/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:55.326595 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5362a69-94ee-4ec8-aab4-7c712ae3a073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1cac850b3d946e9ac65d39c0ca79121, user_id=2b144f26934b476b8673e8382dd65f1b, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:55.329374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5362a69-94ee-4ec8-aab4-7c712ae3a073 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:55.349502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1319/2622] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:55 2022] PUT /identity/v3/projects/d1cac850b3d946e9ac65d39c0ca79121/users/2b144f26934b476b8673e8382dd65f1b/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:55.354096 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df32163-9817-4ca0-8693-57cdd53ed64f admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:55.366979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df32163-9817-4ca0-8693-57cdd53ed64f admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:55.417279 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:55.441453 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc0801-f58b-454a-998e-478fe34c904f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:55.442316 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc0801-f58b-454a-998e-478fe34c904f admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:55.442671 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc0801-f58b-454a-998e-478fe34c904f admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:55.442953 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc0801-f58b-454a-998e-478fe34c904f admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:55.443879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc0801-f58b-454a-998e-478fe34c904f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:55.445773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc0801-f58b-454a-998e-478fe34c904f admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:55.456171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1304/2623] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:22:55.460759 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5362a69-94ee-4ec8-aab4-7c712ae3a073 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:55.471928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5362a69-94ee-4ec8-aab4-7c712ae3a073 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:55.476550 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c9023-8d19-4ef6-9442-e84dbe8a4410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:55.477201 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c9023-8d19-4ef6-9442-e84dbe8a4410 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:55.477483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c9023-8d19-4ef6-9442-e84dbe8a4410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:55.477758 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c9023-8d19-4ef6-9442-e84dbe8a4410 admin admin] PATH_INFO: `/v3/projects/d1cac850b3d946e9ac65d39c0ca79121/users/2b144f26934b476b8673e8382dd65f1b/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:55.480317 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c9023-8d19-4ef6-9442-e84dbe8a4410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1cac850b3d946e9ac65d39c0ca79121, user_id=2b144f26934b476b8673e8382dd65f1b, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:55.482951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c9023-8d19-4ef6-9442-e84dbe8a4410 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:55.493575 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1320/2624] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:55 2022] PUT /identity/v3/projects/d1cac850b3d946e9ac65d39c0ca79121/users/2b144f26934b476b8673e8382dd65f1b/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:55.503816 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021525d-8853-47bd-bf9e-9812a972c7d8 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:55.504105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021525d-8853-47bd-bf9e-9812a972c7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:55.504382 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021525d-8853-47bd-bf9e-9812a972c7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:55.532899 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-1021525d-8853-47bd-bf9e-9812a972c7d8 None None] MFA Rules not processed for user `2b144f26934b476b8673e8382dd65f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:55.534177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-1021525d-8853-47bd-bf9e-9812a972c7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:55.606119 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1305/2625] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:55.618542 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c9023-8d19-4ef6-9442-e84dbe8a4410 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:55.621617 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-961c9023-8d19-4ef6-9442-e84dbe8a4410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:55.695162 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c9023-8d19-4ef6-9442-e84dbe8a4410 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:55.700233 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6102cdb-a11d-4046-bae2-86705cfda265 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:55.700852 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6102cdb-a11d-4046-bae2-86705cfda265 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:55.701134 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6102cdb-a11d-4046-bae2-86705cfda265 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:55.701409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6102cdb-a11d-4046-bae2-86705cfda265 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:55.772926 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6102cdb-a11d-4046-bae2-86705cfda265 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:55.774452 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6102cdb-a11d-4046-bae2-86705cfda265 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:55.788861 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1321/2626] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:56.753095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021525d-8853-47bd-bf9e-9812a972c7d8 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:56.754497 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-1021525d-8853-47bd-bf9e-9812a972c7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:56.834452 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021525d-8853-47bd-bf9e-9812a972c7d8 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:56.838945 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a91be-0e50-4c38-9ecb-68fb030df511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:56.839596 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a91be-0e50-4c38-9ecb-68fb030df511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:56.839879 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a91be-0e50-4c38-9ecb-68fb030df511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:56.840150 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a91be-0e50-4c38-9ecb-68fb030df511 admin admin] PATH_INFO: `/v3/users/728f2b64aff14ac1a646422e0d3b61cb` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:56.841257 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a91be-0e50-4c38-9ecb-68fb030df511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=728f2b64aff14ac1a646422e0d3b61cb)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:56.843221 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a91be-0e50-4c38-9ecb-68fb030df511 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:56.900507 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a53a91be-0e50-4c38-9ecb-68fb030df511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '728f2b64aff14ac1a646422e0d3b61cb'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:56.901244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a53a91be-0e50-4c38-9ecb-68fb030df511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '728f2b64aff14ac1a646422e0d3b61cb'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:56.911306 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a53a91be-0e50-4c38-9ecb-68fb030df511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '728f2b64aff14ac1a646422e0d3b61cb'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:56.918619 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:56.921254 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a53a91be-0e50-4c38-9ecb-68fb030df511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '728f2b64aff14ac1a646422e0d3b61cb'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:56.939188 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a53a91be-0e50-4c38-9ecb-68fb030df511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '728f2b64aff14ac1a646422e0d3b61cb'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:56.946020 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1306/2627] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:22:56 2022] DELETE /identity/v3/users/728f2b64aff14ac1a646422e0d3b61cb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:56.951139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769621e-4a2d-4781-9e51-d23aac897abf None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:56.951632 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769621e-4a2d-4781-9e51-d23aac897abf None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:56.951812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769621e-4a2d-4781-9e51-d23aac897abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:56.972017 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8769621e-4a2d-4781-9e51-d23aac897abf None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:56.973424 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8769621e-4a2d-4781-9e51-d23aac897abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:57.041681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1322/2628] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:22:57.051232 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a91be-0e50-4c38-9ecb-68fb030df511 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:57.052627 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-a53a91be-0e50-4c38-9ecb-68fb030df511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:57.111613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a91be-0e50-4c38-9ecb-68fb030df511 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:57.115241 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580efb4-3145-4fb5-97ba-5b9a502dd59b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:57.115829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580efb4-3145-4fb5-97ba-5b9a502dd59b service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:57.116117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580efb4-3145-4fb5-97ba-5b9a502dd59b service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:57.116362 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580efb4-3145-4fb5-97ba-5b9a502dd59b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:57.125801 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580efb4-3145-4fb5-97ba-5b9a502dd59b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:57.127230 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580efb4-3145-4fb5-97ba-5b9a502dd59b service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:57.138051 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1307/2629] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:22:57.401082 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769621e-4a2d-4781-9e51-d23aac897abf None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:57.402582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8769621e-4a2d-4781-9e51-d23aac897abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:57.418333 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:57.467881 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580efb4-3145-4fb5-97ba-5b9a502dd59b service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:57.470560 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-0580efb4-3145-4fb5-97ba-5b9a502dd59b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:57.499236 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580efb4-3145-4fb5-97ba-5b9a502dd59b service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:57.505118 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3059b25-9109-4f77-baa2-a46901881ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:57.505769 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3059b25-9109-4f77-baa2-a46901881ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:57.506091 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3059b25-9109-4f77-baa2-a46901881ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:57.506363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3059b25-9109-4f77-baa2-a46901881ad7 admin admin] PATH_INFO: `/v3/projects/8e936d2764d9431fb35706caa104a31e` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:57.511638 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3059b25-9109-4f77-baa2-a46901881ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e936d2764d9431fb35706caa104a31e)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:57.513746 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3059b25-9109-4f77-baa2-a46901881ad7 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:57.515139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769621e-4a2d-4781-9e51-d23aac897abf None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:57.523030 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f3adf-0806-4dc5-8b1e-85d3f2ae8cf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:57.523780 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f3adf-0806-4dc5-8b1e-85d3f2ae8cf3 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:57.524136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f3adf-0806-4dc5-8b1e-85d3f2ae8cf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:57.524477 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f3adf-0806-4dc5-8b1e-85d3f2ae8cf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:57.526344 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-629f3adf-0806-4dc5-8b1e-85d3f2ae8cf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:57.581889 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a3059b25-9109-4f77-baa2-a46901881ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e936d2764d9431fb35706caa104a31e', 'request_id': 'req-a3059b25-9109-4f77-baa2-a46901881ad7'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:57.587511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a3059b25-9109-4f77-baa2-a46901881ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e936d2764d9431fb35706caa104a31e', 'request_id': 'req-a3059b25-9109-4f77-baa2-a46901881ad7'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:57.597245 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a3059b25-9109-4f77-baa2-a46901881ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e936d2764d9431fb35706caa104a31e', 'request_id': 'req-a3059b25-9109-4f77-baa2-a46901881ad7'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:57.605917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f3adf-0806-4dc5-8b1e-85d3f2ae8cf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:57.607432 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f3adf-0806-4dc5-8b1e-85d3f2ae8cf3 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:57.610259 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a3059b25-9109-4f77-baa2-a46901881ad7 admin admin] The token cache is being invalidate because project 8e936d2764d9431fb35706caa104a31e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:22:57.610553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a3059b25-9109-4f77-baa2-a46901881ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:57.611789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a3059b25-9109-4f77-baa2-a46901881ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:57.617251 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1308/2630] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:22:57 2022] DELETE /identity/v3/projects/8e936d2764d9431fb35706caa104a31e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:57.618234 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1323/2631] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:57.621668 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3059b25-9109-4f77-baa2-a46901881ad7 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:57.623087 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-a3059b25-9109-4f77-baa2-a46901881ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:57.715566 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3059b25-9109-4f77-baa2-a46901881ad7 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:57.730327 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065d0ef-3b3f-4d74-8522-e96f1f10caa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:57.730327 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065d0ef-3b3f-4d74-8522-e96f1f10caa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:57.730716 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065d0ef-3b3f-4d74-8522-e96f1f10caa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:57.730971 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065d0ef-3b3f-4d74-8522-e96f1f10caa5 admin admin] PATH_INFO: `/v3/users/ad283f5198424fd0882bfb1742c1cd16` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:57.732960 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065d0ef-3b3f-4d74-8522-e96f1f10caa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad283f5198424fd0882bfb1742c1cd16)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:57.735671 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065d0ef-3b3f-4d74-8522-e96f1f10caa5 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:57.741198 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:57.812075 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c065d0ef-3b3f-4d74-8522-e96f1f10caa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad283f5198424fd0882bfb1742c1cd16'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:57.813489 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c065d0ef-3b3f-4d74-8522-e96f1f10caa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad283f5198424fd0882bfb1742c1cd16'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:57.821884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c065d0ef-3b3f-4d74-8522-e96f1f10caa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad283f5198424fd0882bfb1742c1cd16'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:57.837635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c065d0ef-3b3f-4d74-8522-e96f1f10caa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad283f5198424fd0882bfb1742c1cd16'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:57.856214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c065d0ef-3b3f-4d74-8522-e96f1f10caa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad283f5198424fd0882bfb1742c1cd16'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:57.862662 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1309/2632] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:22:57 2022] DELETE /identity/v3/users/ad283f5198424fd0882bfb1742c1cd16 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:58.198824 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f3adf-0806-4dc5-8b1e-85d3f2ae8cf3 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:58.211800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f3adf-0806-4dc5-8b1e-85d3f2ae8cf3 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:58.277232 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a694dbe-5fe5-4702-97c8-4cb98f542e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:58.277864 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a694dbe-5fe5-4702-97c8-4cb98f542e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:58.278142 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a694dbe-5fe5-4702-97c8-4cb98f542e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:58.278473 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a694dbe-5fe5-4702-97c8-4cb98f542e3f admin admin] PATH_INFO: `/v3/projects/e5fc6b6ebfcf44b78cd2280cc4ff3106` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:58.279632 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a694dbe-5fe5-4702-97c8-4cb98f542e3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5fc6b6ebfcf44b78cd2280cc4ff3106)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:58.281584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a694dbe-5fe5-4702-97c8-4cb98f542e3f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:58.284835 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065d0ef-3b3f-4d74-8522-e96f1f10caa5 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:58.286208 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c065d0ef-3b3f-4d74-8522-e96f1f10caa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:58.333433 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9a694dbe-5fe5-4702-97c8-4cb98f542e3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5fc6b6ebfcf44b78cd2280cc4ff3106', 'request_id': 'req-9a694dbe-5fe5-4702-97c8-4cb98f542e3f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:58.341997 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9a694dbe-5fe5-4702-97c8-4cb98f542e3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5fc6b6ebfcf44b78cd2280cc4ff3106', 'request_id': 'req-9a694dbe-5fe5-4702-97c8-4cb98f542e3f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:58.345550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065d0ef-3b3f-4d74-8522-e96f1f10caa5 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:58.348869 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9a694dbe-5fe5-4702-97c8-4cb98f542e3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5fc6b6ebfcf44b78cd2280cc4ff3106', 'request_id': 'req-9a694dbe-5fe5-4702-97c8-4cb98f542e3f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:58.355144 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:58.361200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9a694dbe-5fe5-4702-97c8-4cb98f542e3f admin admin] The token cache is being invalidate because project e5fc6b6ebfcf44b78cd2280cc4ff3106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:22:58.361894 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9a694dbe-5fe5-4702-97c8-4cb98f542e3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:58.362770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9a694dbe-5fe5-4702-97c8-4cb98f542e3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:58.364818 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1324/2633] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:22:58 2022] DELETE /identity/v3/projects/e5fc6b6ebfcf44b78cd2280cc4ff3106 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:58.370389 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f5000-356c-4328-b8e2-1ef7db1a790f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:58.370963 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f5000-356c-4328-b8e2-1ef7db1a790f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:58.371459 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f5000-356c-4328-b8e2-1ef7db1a790f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:58.390945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2a5f5000-356c-4328-b8e2-1ef7db1a790f None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:58.392168 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2a5f5000-356c-4328-b8e2-1ef7db1a790f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:58.396810 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75891090-1af1-412d-ae86-38506e09af6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:58.397441 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75891090-1af1-412d-ae86-38506e09af6b service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:58.397718 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75891090-1af1-412d-ae86-38506e09af6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:58.397982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75891090-1af1-412d-ae86-38506e09af6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:58.399706 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-75891090-1af1-412d-ae86-38506e09af6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:58.450674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1325/2634] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:22:58.450884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:58.458732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11bc1a-8093-4e20-9cb5-0b6f109db3fa None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:58.458947 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11bc1a-8093-4e20-9cb5-0b6f109db3fa None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:58.459245 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11bc1a-8093-4e20-9cb5-0b6f109db3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:58.466813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75891090-1af1-412d-ae86-38506e09af6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:58.468975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75891090-1af1-412d-ae86-38506e09af6b service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:58.479690 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1310/2635] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:22:58.482052 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-be11bc1a-8093-4e20-9cb5-0b6f109db3fa None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:58.483368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-be11bc1a-8093-4e20-9cb5-0b6f109db3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:58.491818 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1326/2636] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:22:58.496275 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75891090-1af1-412d-ae86-38506e09af6b service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:58.506438 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75891090-1af1-412d-ae86-38506e09af6b service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:58.511020 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b159a8c-c297-4198-b8be-2aecf7e9403a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:58.511616 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b159a8c-c297-4198-b8be-2aecf7e9403a admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:58.512669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b159a8c-c297-4198-b8be-2aecf7e9403a admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:58.512669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b159a8c-c297-4198-b8be-2aecf7e9403a admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:58.512869 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b159a8c-c297-4198-b8be-2aecf7e9403a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:22:58.513150 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b159a8c-c297-4198-b8be-2aecf7e9403a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:58.514863 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b159a8c-c297-4198-b8be-2aecf7e9403a admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:58.528786 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1311/2637] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:22:58.533654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11bc1a-8093-4e20-9cb5-0b6f109db3fa None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:58.545234 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11bc1a-8093-4e20-9cb5-0b6f109db3fa None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:58.549373 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b1f97-e0ec-4c6d-8c88-a6539caaa182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:58.550107 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b1f97-e0ec-4c6d-8c88-a6539caaa182 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:58.550451 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b1f97-e0ec-4c6d-8c88-a6539caaa182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:58.550816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b1f97-e0ec-4c6d-8c88-a6539caaa182 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:58.551554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b1f97-e0ec-4c6d-8c88-a6539caaa182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:58.553612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b1f97-e0ec-4c6d-8c88-a6539caaa182 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:58.592378 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1327/2638] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:22:58 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:58.596657 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b159a8c-c297-4198-b8be-2aecf7e9403a admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:58.608035 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b159a8c-c297-4198-b8be-2aecf7e9403a admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:58.669392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53172fd7-a666-43b0-9e3a-48036a4381b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:58.669986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53172fd7-a666-43b0-9e3a-48036a4381b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:58.670264 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53172fd7-a666-43b0-9e3a-48036a4381b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:58.670532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53172fd7-a666-43b0-9e3a-48036a4381b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:58.671187 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53172fd7-a666-43b0-9e3a-48036a4381b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:58.673071 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53172fd7-a666-43b0-9e3a-48036a4381b8 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:58.693640 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1312/2639] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:22:58 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:22:58.698556 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b1f97-e0ec-4c6d-8c88-a6539caaa182 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:58.709257 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b1f97-e0ec-4c6d-8c88-a6539caaa182 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:58.714778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dc49e-223b-46bf-ac72-027572dff449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:58.715414 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dc49e-223b-46bf-ac72-027572dff449 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:58.715694 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dc49e-223b-46bf-ac72-027572dff449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:58.716006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dc49e-223b-46bf-ac72-027572dff449 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:58.716652 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681dc49e-223b-46bf-ac72-027572dff449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:58.718243 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681dc49e-223b-46bf-ac72-027572dff449 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:58.728928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1328/2640] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:58.740779 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53172fd7-a666-43b0-9e3a-48036a4381b8 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:58.753237 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53172fd7-a666-43b0-9e3a-48036a4381b8 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:58.758496 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dc49e-223b-46bf-ac72-027572dff449 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:58.761136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-681dc49e-223b-46bf-ac72-027572dff449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:58.763102 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9145ff-ed58-4127-b44e-3eb7468b4328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:58.763813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9145ff-ed58-4127-b44e-3eb7468b4328 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:58.764153 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9145ff-ed58-4127-b44e-3eb7468b4328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:58.764485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9145ff-ed58-4127-b44e-3eb7468b4328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:58.765217 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9145ff-ed58-4127-b44e-3eb7468b4328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:58.767023 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9145ff-ed58-4127-b44e-3eb7468b4328 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:58.776189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dc49e-223b-46bf-ac72-027572dff449 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:58.781890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f4365-9912-4d5d-a357-d19df1f10732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:58.782234 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1313/2641] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:58.783398 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f4365-9912-4d5d-a357-d19df1f10732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:58.783715 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f4365-9912-4d5d-a357-d19df1f10732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:58.784111 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f4365-9912-4d5d-a357-d19df1f10732 admin admin] PATH_INFO: `/v3/users/f2f1bc98be594f2eaa316e05b10fb35b` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:58.785700 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f4365-9912-4d5d-a357-d19df1f10732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f1bc98be594f2eaa316e05b10fb35b)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:58.786662 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9145ff-ed58-4127-b44e-3eb7468b4328 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:58.788175 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f4365-9912-4d5d-a357-d19df1f10732 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:58.798076 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9145ff-ed58-4127-b44e-3eb7468b4328 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:58.808182 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146d823-2b19-45a5-974a-d6ee38a28fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:58.809162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146d823-2b19-45a5-974a-d6ee38a28fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:58.809636 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146d823-2b19-45a5-974a-d6ee38a28fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:58.811697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146d823-2b19-45a5-974a-d6ee38a28fbc admin admin] PATH_INFO: `/v3/projects/8a93443a87b64633aee027ebbe727104/users/0ca4f727bbe44fc0b4812414afb1dcca/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:58.850261 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a69f4365-9912-4d5d-a357-d19df1f10732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f1bc98be594f2eaa316e05b10fb35b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:58.850890 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a69f4365-9912-4d5d-a357-d19df1f10732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f1bc98be594f2eaa316e05b10fb35b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:58.852153 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146d823-2b19-45a5-974a-d6ee38a28fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a93443a87b64633aee027ebbe727104, user_id=0ca4f727bbe44fc0b4812414afb1dcca, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:58.859293 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146d823-2b19-45a5-974a-d6ee38a28fbc admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:58.861465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a69f4365-9912-4d5d-a357-d19df1f10732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f1bc98be594f2eaa316e05b10fb35b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:58.873756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a69f4365-9912-4d5d-a357-d19df1f10732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f1bc98be594f2eaa316e05b10fb35b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:58.878973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1314/2642] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:58 2022] PUT /identity/v3/projects/8a93443a87b64633aee027ebbe727104/users/0ca4f727bbe44fc0b4812414afb1dcca/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:58.888936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a69f4365-9912-4d5d-a357-d19df1f10732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f1bc98be594f2eaa316e05b10fb35b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:58.890188 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37027d98-ab7a-474f-892f-66b19732a6a1 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:58.890392 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37027d98-ab7a-474f-892f-66b19732a6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:58.890671 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37027d98-ab7a-474f-892f-66b19732a6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:58.898700 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1329/2643] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:22:58 2022] DELETE /identity/v3/users/f2f1bc98be594f2eaa316e05b10fb35b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:22:58.903637 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dc819-55c2-49d9-8945-fbf146607b97 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:58.903921 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dc819-55c2-49d9-8945-fbf146607b97 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:58.904193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dc819-55c2-49d9-8945-fbf146607b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:58.923247 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-37027d98-ab7a-474f-892f-66b19732a6a1 None None] MFA Rules not processed for user `0ca4f727bbe44fc0b4812414afb1dcca`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:58.924513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e70dc819-55c2-49d9-8945-fbf146607b97 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:58.924644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-37027d98-ab7a-474f-892f-66b19732a6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:58.925916 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e70dc819-55c2-49d9-8945-fbf146607b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:58.953071 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:59.001739 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1330/2644] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:22:59.010382 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1315/2645] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:22:59.011908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dc819-55c2-49d9-8945-fbf146607b97 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:59.013375 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e70dc819-55c2-49d9-8945-fbf146607b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:59.015105 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37027d98-ab7a-474f-892f-66b19732a6a1 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:59.016526 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-37027d98-ab7a-474f-892f-66b19732a6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:59.031116 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37027d98-ab7a-474f-892f-66b19732a6a1 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:59.035807 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4a4f9-a2f3-45bf-81a2-1b630bcd529f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:59.036422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4a4f9-a2f3-45bf-81a2-1b630bcd529f admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:59.036705 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4a4f9-a2f3-45bf-81a2-1b630bcd529f admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:59.036974 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4a4f9-a2f3-45bf-81a2-1b630bcd529f admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:59.037644 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f4a4f9-a2f3-45bf-81a2-1b630bcd529f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:59.039533 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f4a4f9-a2f3-45bf-81a2-1b630bcd529f admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:59.064174 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:59.077734 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1316/2646] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:22:59 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:59.078572 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4a4f9-a2f3-45bf-81a2-1b630bcd529f admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:59.081195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dc819-55c2-49d9-8945-fbf146607b97 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:59.140506 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26a549-54a4-49aa-870b-57a1cbb138d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:59.141125 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26a549-54a4-49aa-870b-57a1cbb138d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:59.141403 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26a549-54a4-49aa-870b-57a1cbb138d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:59.141674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26a549-54a4-49aa-870b-57a1cbb138d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:59.156113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4a4f9-a2f3-45bf-81a2-1b630bcd529f admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:59.161090 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e568c82-ca64-4ecc-8d2b-14eb64acbd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:59.161878 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e568c82-ca64-4ecc-8d2b-14eb64acbd32 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:59.162148 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e568c82-ca64-4ecc-8d2b-14eb64acbd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:59.162415 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e568c82-ca64-4ecc-8d2b-14eb64acbd32 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:59.163054 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e568c82-ca64-4ecc-8d2b-14eb64acbd32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:59.164946 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e568c82-ca64-4ecc-8d2b-14eb64acbd32 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:59.188404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1317/2647] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:22:59 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:22:59.192566 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e568c82-ca64-4ecc-8d2b-14eb64acbd32 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:59.203569 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e568c82-ca64-4ecc-8d2b-14eb64acbd32 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:59.208648 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089fbcb-8f31-49dc-bb81-7ceabaaade51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:59.209292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089fbcb-8f31-49dc-bb81-7ceabaaade51 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:59.209568 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089fbcb-8f31-49dc-bb81-7ceabaaade51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:59.209846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089fbcb-8f31-49dc-bb81-7ceabaaade51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:59.210546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089fbcb-8f31-49dc-bb81-7ceabaaade51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:59.212115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089fbcb-8f31-49dc-bb81-7ceabaaade51 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:59.220515 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26a549-54a4-49aa-870b-57a1cbb138d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:59.221998 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26a549-54a4-49aa-870b-57a1cbb138d3 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:59.225731 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1318/2648] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:59.230181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089fbcb-8f31-49dc-bb81-7ceabaaade51 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:59.233036 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1331/2649] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:59.242754 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089fbcb-8f31-49dc-bb81-7ceabaaade51 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:59.247534 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db049148-6087-4113-b66f-e1e4a708dca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:59.248188 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db049148-6087-4113-b66f-e1e4a708dca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:59.248551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db049148-6087-4113-b66f-e1e4a708dca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:59.248724 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db049148-6087-4113-b66f-e1e4a708dca2 admin admin] PATH_INFO: `/v3/projects/d6ddccc6be9c4cd3b34319419fb691d1/users/d0bbdbaa10274f9caafcccbe6f90f33a/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:59.264900 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db049148-6087-4113-b66f-e1e4a708dca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6ddccc6be9c4cd3b34319419fb691d1, user_id=d0bbdbaa10274f9caafcccbe6f90f33a, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:59.268457 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db049148-6087-4113-b66f-e1e4a708dca2 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:59.289086 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1319/2650] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:59 2022] PUT /identity/v3/projects/d6ddccc6be9c4cd3b34319419fb691d1/users/d0bbdbaa10274f9caafcccbe6f90f33a/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:22:59.293449 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26a549-54a4-49aa-870b-57a1cbb138d3 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:59.304700 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26a549-54a4-49aa-870b-57a1cbb138d3 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:59.353021 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:59.389846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6db14-5253-4990-8a88-8cafcb27cc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:59.390971 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6db14-5253-4990-8a88-8cafcb27cc56 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:59.391579 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6db14-5253-4990-8a88-8cafcb27cc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:59.391795 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6db14-5253-4990-8a88-8cafcb27cc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:59.392433 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6db14-5253-4990-8a88-8cafcb27cc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:59.394071 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6db14-5253-4990-8a88-8cafcb27cc56 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:59.411040 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1332/2651] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:22:59.415080 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db049148-6087-4113-b66f-e1e4a708dca2 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:59.427406 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db049148-6087-4113-b66f-e1e4a708dca2 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:59.432265 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3078e5a-33ca-4e23-a900-ecb206e0ca61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:59.433907 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3078e5a-33ca-4e23-a900-ecb206e0ca61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:59.433907 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3078e5a-33ca-4e23-a900-ecb206e0ca61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:59.434338 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3078e5a-33ca-4e23-a900-ecb206e0ca61 admin admin] PATH_INFO: `/v3/projects/d6ddccc6be9c4cd3b34319419fb691d1/users/d0bbdbaa10274f9caafcccbe6f90f33a/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:59.436503 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3078e5a-33ca-4e23-a900-ecb206e0ca61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6ddccc6be9c4cd3b34319419fb691d1, user_id=d0bbdbaa10274f9caafcccbe6f90f33a, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:59.439177 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3078e5a-33ca-4e23-a900-ecb206e0ca61 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:59.451501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1320/2652] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:22:59 2022] PUT /identity/v3/projects/d6ddccc6be9c4cd3b34319419fb691d1/users/d0bbdbaa10274f9caafcccbe6f90f33a/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:59.464466 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1837d-909b-4327-a081-27b6459f4970 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:59.464943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1837d-909b-4327-a081-27b6459f4970 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:59.465384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1837d-909b-4327-a081-27b6459f4970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:59.495955 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e2c1837d-909b-4327-a081-27b6459f4970 None None] MFA Rules not processed for user `d0bbdbaa10274f9caafcccbe6f90f33a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:22:59.497174 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e2c1837d-909b-4327-a081-27b6459f4970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:59.539999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3078e5a-33ca-4e23-a900-ecb206e0ca61 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:59.542283 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-e3078e5a-33ca-4e23-a900-ecb206e0ca61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:59.575154 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1333/2653] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:22:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:22:59.587427 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1837d-909b-4327-a081-27b6459f4970 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:59.592045 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e2c1837d-909b-4327-a081-27b6459f4970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:59.644802 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3078e5a-33ca-4e23-a900-ecb206e0ca61 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:59.652515 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a6f3f-0f21-49f4-8227-b63376494ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:59.653302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a6f3f-0f21-49f4-8227-b63376494ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:59.653687 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a6f3f-0f21-49f4-8227-b63376494ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:59.654349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a6f3f-0f21-49f4-8227-b63376494ac2 admin admin] PATH_INFO: `/v3/projects/039a58dd9bf4494280cc0e8c14f0dd78` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:59.655382 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a6f3f-0f21-49f4-8227-b63376494ac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=039a58dd9bf4494280cc0e8c14f0dd78)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:59.658725 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a6f3f-0f21-49f4-8227-b63376494ac2 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:59.676304 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1837d-909b-4327-a081-27b6459f4970 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:59.680779 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e00e54-c252-470d-93ea-96caed38f39c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:59.681627 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e00e54-c252-470d-93ea-96caed38f39c service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:59.682070 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e00e54-c252-470d-93ea-96caed38f39c service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:59.682500 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e00e54-c252-470d-93ea-96caed38f39c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:59.715771 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:59.726586 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-795a6f3f-0f21-49f4-8227-b63376494ac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '039a58dd9bf4494280cc0e8c14f0dd78', 'request_id': 'req-795a6f3f-0f21-49f4-8227-b63376494ac2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:59.735199 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-795a6f3f-0f21-49f4-8227-b63376494ac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '039a58dd9bf4494280cc0e8c14f0dd78', 'request_id': 'req-795a6f3f-0f21-49f4-8227-b63376494ac2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:59.746506 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-795a6f3f-0f21-49f4-8227-b63376494ac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '039a58dd9bf4494280cc0e8c14f0dd78', 'request_id': 'req-795a6f3f-0f21-49f4-8227-b63376494ac2'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:59.764248 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e00e54-c252-470d-93ea-96caed38f39c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:59.765065 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-795a6f3f-0f21-49f4-8227-b63376494ac2 admin admin] The token cache is being invalidate because project 039a58dd9bf4494280cc0e8c14f0dd78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:22:59.765357 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-795a6f3f-0f21-49f4-8227-b63376494ac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:59.765561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e00e54-c252-470d-93ea-96caed38f39c service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:59.766651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-795a6f3f-0f21-49f4-8227-b63376494ac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:59.768632 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1321/2654] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:22:59 2022] DELETE /identity/v3/projects/039a58dd9bf4494280cc0e8c14f0dd78 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:22:59.773204 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a6f3f-0f21-49f4-8227-b63376494ac2 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:22:59.775026 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-795a6f3f-0f21-49f4-8227-b63376494ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:22:59.779073 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1334/2655] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:22:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:22:59.853710 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a6f3f-0f21-49f4-8227-b63376494ac2 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:22:59.861085 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86fa85-0c4b-4ebc-a35f-68ba81a1e77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:22:59.862039 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86fa85-0c4b-4ebc-a35f-68ba81a1e77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:22:59.862425 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86fa85-0c4b-4ebc-a35f-68ba81a1e77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:22:59.862866 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86fa85-0c4b-4ebc-a35f-68ba81a1e77b admin admin] PATH_INFO: `/v3/users/f19895db9d0040e8b4645098bca48873` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:22:59.864575 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86fa85-0c4b-4ebc-a35f-68ba81a1e77b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f19895db9d0040e8b4645098bca48873)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:22:59.867217 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86fa85-0c4b-4ebc-a35f-68ba81a1e77b admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:22:59.955653 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3b86fa85-0c4b-4ebc-a35f-68ba81a1e77b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f19895db9d0040e8b4645098bca48873'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:59.956633 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3b86fa85-0c4b-4ebc-a35f-68ba81a1e77b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f19895db9d0040e8b4645098bca48873'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:59.981076 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3b86fa85-0c4b-4ebc-a35f-68ba81a1e77b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f19895db9d0040e8b4645098bca48873'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:22:59.993597 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3b86fa85-0c4b-4ebc-a35f-68ba81a1e77b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f19895db9d0040e8b4645098bca48873'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:00.012167 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3b86fa85-0c4b-4ebc-a35f-68ba81a1e77b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f19895db9d0040e8b4645098bca48873'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:00.026428 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1322/2656] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:22:59 2022] DELETE /identity/v3/users/f19895db9d0040e8b4645098bca48873 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:23:00.360385 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e00e54-c252-470d-93ea-96caed38f39c service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:00.375718 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e00e54-c252-470d-93ea-96caed38f39c service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:00.384185 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:00.436026 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b08c0-11e0-4de0-b56c-c0e0a49754bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:00.436652 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b08c0-11e0-4de0-b56c-c0e0a49754bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:00.436932 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b08c0-11e0-4de0-b56c-c0e0a49754bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:00.437203 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b08c0-11e0-4de0-b56c-c0e0a49754bd admin admin] PATH_INFO: `/v3/projects/25f42d0671994d9a9d64e307d98a8d16` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:00.438323 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b08c0-11e0-4de0-b56c-c0e0a49754bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f42d0671994d9a9d64e307d98a8d16)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:00.440271 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b08c0-11e0-4de0-b56c-c0e0a49754bd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:00.486514 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-101b08c0-11e0-4de0-b56c-c0e0a49754bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f42d0671994d9a9d64e307d98a8d16', 'request_id': 'req-101b08c0-11e0-4de0-b56c-c0e0a49754bd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:00.495245 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-101b08c0-11e0-4de0-b56c-c0e0a49754bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f42d0671994d9a9d64e307d98a8d16', 'request_id': 'req-101b08c0-11e0-4de0-b56c-c0e0a49754bd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:00.501923 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-101b08c0-11e0-4de0-b56c-c0e0a49754bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f42d0671994d9a9d64e307d98a8d16', 'request_id': 'req-101b08c0-11e0-4de0-b56c-c0e0a49754bd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:00.514907 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-101b08c0-11e0-4de0-b56c-c0e0a49754bd admin admin] The token cache is being invalidate because project 25f42d0671994d9a9d64e307d98a8d16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:23:00.515287 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-101b08c0-11e0-4de0-b56c-c0e0a49754bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:00.515912 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-101b08c0-11e0-4de0-b56c-c0e0a49754bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:00.519186 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1335/2657] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:23:00 2022] DELETE /identity/v3/projects/25f42d0671994d9a9d64e307d98a8d16 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:00.527384 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c0bce-6d13-4a61-886c-7288769f4750 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:00.527685 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c0bce-6d13-4a61-886c-7288769f4750 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:00.527960 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c0bce-6d13-4a61-886c-7288769f4750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:00.550716 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-6e3c0bce-6d13-4a61-886c-7288769f4750 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:00.551975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-6e3c0bce-6d13-4a61-886c-7288769f4750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:00.600757 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:00.621210 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1323/2658] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:23:00.629536 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48dcf5b-2f6f-4842-8bf7-6d29f50c971b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:00.629813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48dcf5b-2f6f-4842-8bf7-6d29f50c971b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:00.630090 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48dcf5b-2f6f-4842-8bf7-6d29f50c971b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:00.653197 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c48dcf5b-2f6f-4842-8bf7-6d29f50c971b None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:00.654479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c48dcf5b-2f6f-4842-8bf7-6d29f50c971b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:00.662800 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1336/2659] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:00.667706 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c0bce-6d13-4a61-886c-7288769f4750 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:00.678956 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c0bce-6d13-4a61-886c-7288769f4750 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:00.684026 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980f61c-3927-48b6-aa89-1c72c1a4f0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:00.684612 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980f61c-3927-48b6-aa89-1c72c1a4f0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:00.684909 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980f61c-3927-48b6-aa89-1c72c1a4f0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:00.685158 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980f61c-3927-48b6-aa89-1c72c1a4f0d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:00.685797 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980f61c-3927-48b6-aa89-1c72c1a4f0d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:23:00.686089 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980f61c-3927-48b6-aa89-1c72c1a4f0d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:00.687976 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980f61c-3927-48b6-aa89-1c72c1a4f0d5 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:00.700593 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1324/2660] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:23:00.705118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48dcf5b-2f6f-4842-8bf7-6d29f50c971b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:00.715260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48dcf5b-2f6f-4842-8bf7-6d29f50c971b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:00.719854 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1fb75-2e1d-45e9-a240-3f06eab8c4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:00.720440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1fb75-2e1d-45e9-a240-3f06eab8c4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:00.720719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1fb75-2e1d-45e9-a240-3f06eab8c4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:00.720990 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1fb75-2e1d-45e9-a240-3f06eab8c4c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:00.721612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1fb75-2e1d-45e9-a240-3f06eab8c4c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:00.723543 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1fb75-2e1d-45e9-a240-3f06eab8c4c5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:00.750589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1337/2661] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:23:00 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:23:00.754641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980f61c-3927-48b6-aa89-1c72c1a4f0d5 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:00.766594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980f61c-3927-48b6-aa89-1c72c1a4f0d5 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:00.824097 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef695cd-7b7d-4bc2-8121-712e12c3c1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:00.824751 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef695cd-7b7d-4bc2-8121-712e12c3c1cd admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:00.825022 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef695cd-7b7d-4bc2-8121-712e12c3c1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:00.825287 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef695cd-7b7d-4bc2-8121-712e12c3c1cd admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:00.825921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef695cd-7b7d-4bc2-8121-712e12c3c1cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:00.827923 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef695cd-7b7d-4bc2-8121-712e12c3c1cd admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:00.851214 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1325/2662] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:23:00 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:23:00.856731 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1fb75-2e1d-45e9-a240-3f06eab8c4c5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:00.867262 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1fb75-2e1d-45e9-a240-3f06eab8c4c5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:00.872382 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612854e7-ed0d-4b89-bc6e-24522285cb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:00.872975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612854e7-ed0d-4b89-bc6e-24522285cb8d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:00.873249 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612854e7-ed0d-4b89-bc6e-24522285cb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:00.873517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612854e7-ed0d-4b89-bc6e-24522285cb8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:00.874155 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612854e7-ed0d-4b89-bc6e-24522285cb8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:00.875768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612854e7-ed0d-4b89-bc6e-24522285cb8d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:00.886215 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1338/2663] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:23:00.890241 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef695cd-7b7d-4bc2-8121-712e12c3c1cd admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:00.900288 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef695cd-7b7d-4bc2-8121-712e12c3c1cd admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:00.905747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5b936-c1d5-492c-960f-9027621b1d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:00.906337 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5b936-c1d5-492c-960f-9027621b1d63 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:00.906610 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5b936-c1d5-492c-960f-9027621b1d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:00.906877 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5b936-c1d5-492c-960f-9027621b1d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:00.907535 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5b936-c1d5-492c-960f-9027621b1d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:00.909126 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5b936-c1d5-492c-960f-9027621b1d63 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:00.919901 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1326/2664] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:23:00.923979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612854e7-ed0d-4b89-bc6e-24522285cb8d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:00.934566 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612854e7-ed0d-4b89-bc6e-24522285cb8d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:00.939238 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9ce06-f742-4d6f-b0d6-5a4d20171d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:00.939878 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9ce06-f742-4d6f-b0d6-5a4d20171d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:00.940159 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9ce06-f742-4d6f-b0d6-5a4d20171d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:00.940436 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9ce06-f742-4d6f-b0d6-5a4d20171d06 admin admin] PATH_INFO: `/v3/projects/96e80f02bc6746e78fa85c433e21a582/users/f5e8d7c76a614af8885da8ab54b9c278/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:00.956740 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9ce06-f742-4d6f-b0d6-5a4d20171d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96e80f02bc6746e78fa85c433e21a582, user_id=f5e8d7c76a614af8885da8ab54b9c278, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:00.959724 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9ce06-f742-4d6f-b0d6-5a4d20171d06 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:00.972938 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1339/2665] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:23:00 2022] PUT /identity/v3/projects/96e80f02bc6746e78fa85c433e21a582/users/f5e8d7c76a614af8885da8ab54b9c278/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:00.985114 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f4e70-9547-41f8-91a8-cbffe1a70de7 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:00.985597 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f4e70-9547-41f8-91a8-cbffe1a70de7 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:00.985783 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f4e70-9547-41f8-91a8-cbffe1a70de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:01.016698 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-db8f4e70-9547-41f8-91a8-cbffe1a70de7 None None] MFA Rules not processed for user `f5e8d7c76a614af8885da8ab54b9c278`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:01.017928 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-db8f4e70-9547-41f8-91a8-cbffe1a70de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:01.087429 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1327/2666] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:01.100577 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9ce06-f742-4d6f-b0d6-5a4d20171d06 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:01.102395 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7bb9ce06-f742-4d6f-b0d6-5a4d20171d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:01.145127 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:01.164132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9ce06-f742-4d6f-b0d6-5a4d20171d06 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:01.168115 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3eee9-bb15-4584-b6ee-e8d4d5584a47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:01.168730 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3eee9-bb15-4584-b6ee-e8d4d5584a47 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:01.169013 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3eee9-bb15-4584-b6ee-e8d4d5584a47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:01.169286 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3eee9-bb15-4584-b6ee-e8d4d5584a47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:01.178010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3eee9-bb15-4584-b6ee-e8d4d5584a47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:01.179486 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3eee9-bb15-4584-b6ee-e8d4d5584a47 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:01.189075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1340/2667] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:23:01.214306 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f4e70-9547-41f8-91a8-cbffe1a70de7 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:01.263460 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:01.293579 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f4e70-9547-41f8-91a8-cbffe1a70de7 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:01.297741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3eee9-bb15-4584-b6ee-e8d4d5584a47 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:01.300622 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2063f-1c39-4846-9270-7e91b31b0539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:01.301517 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2063f-1c39-4846-9270-7e91b31b0539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:01.301894 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2063f-1c39-4846-9270-7e91b31b0539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:01.302265 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2063f-1c39-4846-9270-7e91b31b0539 admin admin] PATH_INFO: `/v3/users/f5e8d7c76a614af8885da8ab54b9c278` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:01.304706 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2063f-1c39-4846-9270-7e91b31b0539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5e8d7c76a614af8885da8ab54b9c278)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:01.307471 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2063f-1c39-4846-9270-7e91b31b0539 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:01.308151 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3eee9-bb15-4584-b6ee-e8d4d5584a47 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:01.312823 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa7a9c-ec5f-49bb-af0d-163817f27aff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:01.313702 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa7a9c-ec5f-49bb-af0d-163817f27aff service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:01.313995 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa7a9c-ec5f-49bb-af0d-163817f27aff service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:01.314271 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa7a9c-ec5f-49bb-af0d-163817f27aff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:01.316642 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-63fa7a9c-ec5f-49bb-af0d-163817f27aff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:01.368410 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-27d2063f-1c39-4846-9270-7e91b31b0539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5e8d7c76a614af8885da8ab54b9c278'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:01.369260 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-27d2063f-1c39-4846-9270-7e91b31b0539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5e8d7c76a614af8885da8ab54b9c278'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:01.381280 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-27d2063f-1c39-4846-9270-7e91b31b0539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5e8d7c76a614af8885da8ab54b9c278'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:01.390821 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-27d2063f-1c39-4846-9270-7e91b31b0539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5e8d7c76a614af8885da8ab54b9c278'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:01.404488 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa7a9c-ec5f-49bb-af0d-163817f27aff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:01.405953 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-27d2063f-1c39-4846-9270-7e91b31b0539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5e8d7c76a614af8885da8ab54b9c278'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:01.406125 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa7a9c-ec5f-49bb-af0d-163817f27aff service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:01.412186 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1328/2668] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:23:01 2022] DELETE /identity/v3/users/f5e8d7c76a614af8885da8ab54b9c278 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:01.416985 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1341/2669] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:23:01.417198 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc6b54-609e-41ab-a395-760de55a965f None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:01.417363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc6b54-609e-41ab-a395-760de55a965f None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:01.417646 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc6b54-609e-41ab-a395-760de55a965f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:01.436548 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-05fc6b54-609e-41ab-a395-760de55a965f None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:01.437813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-05fc6b54-609e-41ab-a395-760de55a965f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:01.501699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1329/2670] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:23:01.512276 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa7a9c-ec5f-49bb-af0d-163817f27aff service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:01.513902 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-63fa7a9c-ec5f-49bb-af0d-163817f27aff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:01.581367 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa7a9c-ec5f-49bb-af0d-163817f27aff service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:01.632389 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd540d-ef62-4d55-811b-7faefd6035ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:01.633081 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd540d-ef62-4d55-811b-7faefd6035ca service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:01.633427 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd540d-ef62-4d55-811b-7faefd6035ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:01.633790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd540d-ef62-4d55-811b-7faefd6035ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:01.644120 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd540d-ef62-4d55-811b-7faefd6035ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:01.645651 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd540d-ef62-4d55-811b-7faefd6035ca service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:01.658060 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1342/2671] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:23:01.998566 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc6b54-609e-41ab-a395-760de55a965f None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:02.000299 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-05fc6b54-609e-41ab-a395-760de55a965f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:02.012579 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc6b54-609e-41ab-a395-760de55a965f None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:02.020117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b29f4e-be0e-401b-9e1d-e7782c5de063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:02.020782 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b29f4e-be0e-401b-9e1d-e7782c5de063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:02.021123 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b29f4e-be0e-401b-9e1d-e7782c5de063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:02.021904 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b29f4e-be0e-401b-9e1d-e7782c5de063 admin admin] PATH_INFO: `/v3/projects/96e80f02bc6746e78fa85c433e21a582` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:02.023869 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b29f4e-be0e-401b-9e1d-e7782c5de063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96e80f02bc6746e78fa85c433e21a582)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:02.033877 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b29f4e-be0e-401b-9e1d-e7782c5de063 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:02.086319 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b0b29f4e-be0e-401b-9e1d-e7782c5de063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96e80f02bc6746e78fa85c433e21a582', 'request_id': 'req-b0b29f4e-be0e-401b-9e1d-e7782c5de063'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:02.092162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b0b29f4e-be0e-401b-9e1d-e7782c5de063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96e80f02bc6746e78fa85c433e21a582', 'request_id': 'req-b0b29f4e-be0e-401b-9e1d-e7782c5de063'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:02.093772 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:02.100269 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b0b29f4e-be0e-401b-9e1d-e7782c5de063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96e80f02bc6746e78fa85c433e21a582', 'request_id': 'req-b0b29f4e-be0e-401b-9e1d-e7782c5de063'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:02.112860 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b0b29f4e-be0e-401b-9e1d-e7782c5de063 admin admin] The token cache is being invalidate because project 96e80f02bc6746e78fa85c433e21a582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:23:02.113141 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b0b29f4e-be0e-401b-9e1d-e7782c5de063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:02.113761 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b0b29f4e-be0e-401b-9e1d-e7782c5de063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:02.115249 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1330/2672] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:23:01 2022] DELETE /identity/v3/projects/96e80f02bc6746e78fa85c433e21a582 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:02.120280 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097b2a7-2eab-4649-861c-7325226435b0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:02.120580 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097b2a7-2eab-4649-861c-7325226435b0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:02.120849 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097b2a7-2eab-4649-861c-7325226435b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:02.139453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2097b2a7-2eab-4649-861c-7325226435b0 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:02.140722 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2097b2a7-2eab-4649-861c-7325226435b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:02.172657 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:02.202428 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1343/2673] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:02.265613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd39e6-374b-4563-9c89-7af4f4d10359 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:02.265913 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd39e6-374b-4563-9c89-7af4f4d10359 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:02.266162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd39e6-374b-4563-9c89-7af4f4d10359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:02.286362 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-d7fd39e6-374b-4563-9c89-7af4f4d10359 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:02.287541 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-d7fd39e6-374b-4563-9c89-7af4f4d10359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:02.296050 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1331/2674] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:02.300372 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097b2a7-2eab-4649-861c-7325226435b0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:02.309969 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097b2a7-2eab-4649-861c-7325226435b0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:02.314544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750ce84-61a2-44ee-898f-f3439367fdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:02.315172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750ce84-61a2-44ee-898f-f3439367fdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:02.315455 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750ce84-61a2-44ee-898f-f3439367fdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:02.315728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750ce84-61a2-44ee-898f-f3439367fdc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:02.316369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750ce84-61a2-44ee-898f-f3439367fdc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:23:02.316672 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750ce84-61a2-44ee-898f-f3439367fdc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:02.318255 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750ce84-61a2-44ee-898f-f3439367fdc3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:02.329596 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1344/2675] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:23:02.334270 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd39e6-374b-4563-9c89-7af4f4d10359 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:02.344035 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd39e6-374b-4563-9c89-7af4f4d10359 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:02.349126 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85351e09-1133-40f8-9b81-d13a6434072c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:02.349747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85351e09-1133-40f8-9b81-d13a6434072c admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:02.350026 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85351e09-1133-40f8-9b81-d13a6434072c admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:02.350307 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85351e09-1133-40f8-9b81-d13a6434072c admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:02.350940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85351e09-1133-40f8-9b81-d13a6434072c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:02.352915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85351e09-1133-40f8-9b81-d13a6434072c admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:02.381090 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1332/2676] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:23:02 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:23:02.385313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750ce84-61a2-44ee-898f-f3439367fdc3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:02.395386 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750ce84-61a2-44ee-898f-f3439367fdc3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:02.455936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc347cd-b6ae-46f9-a722-2b6e6960dcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:02.456553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc347cd-b6ae-46f9-a722-2b6e6960dcfb admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:02.456822 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc347cd-b6ae-46f9-a722-2b6e6960dcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:02.457359 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc347cd-b6ae-46f9-a722-2b6e6960dcfb admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:02.458026 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc347cd-b6ae-46f9-a722-2b6e6960dcfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:02.460154 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc347cd-b6ae-46f9-a722-2b6e6960dcfb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:02.482049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85351e09-1133-40f8-9b81-d13a6434072c admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:02.483803 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-85351e09-1133-40f8-9b81-d13a6434072c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:02.484896 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1345/2677] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:23:02 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:23:02.489051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc347cd-b6ae-46f9-a722-2b6e6960dcfb admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:02.497909 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85351e09-1133-40f8-9b81-d13a6434072c admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:02.499301 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc347cd-b6ae-46f9-a722-2b6e6960dcfb admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:02.503329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d27a3-2c3d-414f-b42c-ef45178c0f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:02.504007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f11ffe-dc6d-48fe-af0a-ab07943087c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:02.504150 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d27a3-2c3d-414f-b42c-ef45178c0f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:02.504261 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d27a3-2c3d-414f-b42c-ef45178c0f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:02.504507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f11ffe-dc6d-48fe-af0a-ab07943087c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:02.504661 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d27a3-2c3d-414f-b42c-ef45178c0f29 admin admin] PATH_INFO: `/v3/users/45913ce89fdd4041a927ba9aedbe3806` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:02.504821 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f11ffe-dc6d-48fe-af0a-ab07943087c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:02.505163 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f11ffe-dc6d-48fe-af0a-ab07943087c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:02.505786 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d27a3-2c3d-414f-b42c-ef45178c0f29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45913ce89fdd4041a927ba9aedbe3806)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:02.505900 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f11ffe-dc6d-48fe-af0a-ab07943087c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:02.507555 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f11ffe-dc6d-48fe-af0a-ab07943087c1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:02.507742 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d27a3-2c3d-414f-b42c-ef45178c0f29 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:02.518813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1346/2678] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:23:02.522960 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f11ffe-dc6d-48fe-af0a-ab07943087c1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:02.533352 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f11ffe-dc6d-48fe-af0a-ab07943087c1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:02.539059 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd2f3b-1b51-416e-8030-3c0208470f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:02.540177 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd2f3b-1b51-416e-8030-3c0208470f33 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:02.540498 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd2f3b-1b51-416e-8030-3c0208470f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:02.541356 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd2f3b-1b51-416e-8030-3c0208470f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:02.542140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd2f3b-1b51-416e-8030-3c0208470f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:02.544204 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd2f3b-1b51-416e-8030-3c0208470f33 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:02.558567 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1347/2679] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:23:02.559691 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd2f3b-1b51-416e-8030-3c0208470f33 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:02.560166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-316d27a3-2c3d-414f-b42c-ef45178c0f29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45913ce89fdd4041a927ba9aedbe3806'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:02.560869 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-316d27a3-2c3d-414f-b42c-ef45178c0f29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45913ce89fdd4041a927ba9aedbe3806'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:02.567985 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-316d27a3-2c3d-414f-b42c-ef45178c0f29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45913ce89fdd4041a927ba9aedbe3806'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:02.570179 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd2f3b-1b51-416e-8030-3c0208470f33 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:02.574905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a81e3-1945-4fac-9aa3-c8a0c211bd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:02.575623 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a81e3-1945-4fac-9aa3-c8a0c211bd4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:02.575913 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-316d27a3-2c3d-414f-b42c-ef45178c0f29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45913ce89fdd4041a927ba9aedbe3806'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:02.576055 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a81e3-1945-4fac-9aa3-c8a0c211bd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:02.576290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a81e3-1945-4fac-9aa3-c8a0c211bd4d admin admin] PATH_INFO: `/v3/projects/f947d1c1c6924aa29d03ea4b7a99d660/users/33300f966cdd49b882f3e71c235f3ad4/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:02.591332 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-316d27a3-2c3d-414f-b42c-ef45178c0f29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45913ce89fdd4041a927ba9aedbe3806'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:02.595328 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a81e3-1945-4fac-9aa3-c8a0c211bd4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f947d1c1c6924aa29d03ea4b7a99d660, user_id=33300f966cdd49b882f3e71c235f3ad4, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:02.598149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1333/2680] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:23:02 2022] DELETE /identity/v3/users/45913ce89fdd4041a927ba9aedbe3806 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:23:02.598564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a81e3-1945-4fac-9aa3-c8a0c211bd4d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:02.604931 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2bc2b-b1ff-4b86-8a7f-a62f87069f00 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:02.607395 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2bc2b-b1ff-4b86-8a7f-a62f87069f00 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:02.607714 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2bc2b-b1ff-4b86-8a7f-a62f87069f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:02.615404 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1348/2681] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:23:02 2022] PUT /identity/v3/projects/f947d1c1c6924aa29d03ea4b7a99d660/users/33300f966cdd49b882f3e71c235f3ad4/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:23:02.625896 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae5349-3e8a-40be-8340-4472311ef83c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:02.626660 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae5349-3e8a-40be-8340-4472311ef83c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:02.627093 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae5349-3e8a-40be-8340-4472311ef83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:02.632734 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-3de2bc2b-b1ff-4b86-8a7f-a62f87069f00 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:02.634211 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3de2bc2b-b1ff-4b86-8a7f-a62f87069f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:02.655139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-79ae5349-3e8a-40be-8340-4472311ef83c None None] MFA Rules not processed for user `33300f966cdd49b882f3e71c235f3ad4`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:02.656284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-79ae5349-3e8a-40be-8340-4472311ef83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:02.702089 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1334/2682] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:23:02.713789 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2bc2b-b1ff-4b86-8a7f-a62f87069f00 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:02.715181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-3de2bc2b-b1ff-4b86-8a7f-a62f87069f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:02.718962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:02.730555 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1349/2683] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:23:02.742253 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae5349-3e8a-40be-8340-4472311ef83c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:02.743907 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-79ae5349-3e8a-40be-8340-4472311ef83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:02.757190 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:INSERT=3,keystone:DELETE=11,keystone:SELECT=86 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:02.789431 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2bc2b-b1ff-4b86-8a7f-a62f87069f00 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:02.793851 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02338d-3115-4756-bdac-46de0719e28b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:02.794757 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02338d-3115-4756-bdac-46de0719e28b service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:02.795224 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02338d-3115-4756-bdac-46de0719e28b service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:02.795643 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02338d-3115-4756-bdac-46de0719e28b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:02.805915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02338d-3115-4756-bdac-46de0719e28b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:02.808442 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02338d-3115-4756-bdac-46de0719e28b service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:02.817700 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae5349-3e8a-40be-8340-4472311ef83c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:02.819712 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1335/2684] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:23:02.823346 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20b7ad-96df-4efb-a3bc-da82c5937767 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:02.824117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20b7ad-96df-4efb-a3bc-da82c5937767 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:02.824471 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20b7ad-96df-4efb-a3bc-da82c5937767 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:02.824755 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20b7ad-96df-4efb-a3bc-da82c5937767 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:02.834103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20b7ad-96df-4efb-a3bc-da82c5937767 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:02.835788 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20b7ad-96df-4efb-a3bc-da82c5937767 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:02.847412 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1350/2685] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:23:03.260880 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02338d-3115-4756-bdac-46de0719e28b service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:03.262491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-4e02338d-3115-4756-bdac-46de0719e28b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:03.296039 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02338d-3115-4756-bdac-46de0719e28b service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:03.315112 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b021dc-6e66-4295-82c1-cf1cc742fdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:03.315785 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b021dc-6e66-4295-82c1-cf1cc742fdfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:03.316038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b021dc-6e66-4295-82c1-cf1cc742fdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:03.316330 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b021dc-6e66-4295-82c1-cf1cc742fdfa admin admin] PATH_INFO: `/v3/projects/9e31e9029cb24c649675ec33bed20dbf` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:03.317458 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b021dc-6e66-4295-82c1-cf1cc742fdfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e31e9029cb24c649675ec33bed20dbf)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:03.319478 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b021dc-6e66-4295-82c1-cf1cc742fdfa admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:03.401915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-81b021dc-6e66-4295-82c1-cf1cc742fdfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e31e9029cb24c649675ec33bed20dbf', 'request_id': 'req-81b021dc-6e66-4295-82c1-cf1cc742fdfa'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:03.407848 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-81b021dc-6e66-4295-82c1-cf1cc742fdfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e31e9029cb24c649675ec33bed20dbf', 'request_id': 'req-81b021dc-6e66-4295-82c1-cf1cc742fdfa'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:03.416303 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-81b021dc-6e66-4295-82c1-cf1cc742fdfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e31e9029cb24c649675ec33bed20dbf', 'request_id': 'req-81b021dc-6e66-4295-82c1-cf1cc742fdfa'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:03.427494 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-81b021dc-6e66-4295-82c1-cf1cc742fdfa admin admin] The token cache is being invalidate because project 9e31e9029cb24c649675ec33bed20dbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:23:03.427779 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-81b021dc-6e66-4295-82c1-cf1cc742fdfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:03.428453 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-81b021dc-6e66-4295-82c1-cf1cc742fdfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:03.429972 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1336/2686] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:23:03 2022] DELETE /identity/v3/projects/9e31e9029cb24c649675ec33bed20dbf => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:03.434745 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20b7ad-96df-4efb-a3bc-da82c5937767 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:03.446244 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20b7ad-96df-4efb-a3bc-da82c5937767 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:03.635464 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04c6de-3717-4349-baac-5015acfc9336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:03.636140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04c6de-3717-4349-baac-5015acfc9336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:03.636269 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04c6de-3717-4349-baac-5015acfc9336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:03.636538 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04c6de-3717-4349-baac-5015acfc9336 admin admin] PATH_INFO: `/v3/users/206bdf0ea30844d5891a8df8aa650e74` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:03.637663 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04c6de-3717-4349-baac-5015acfc9336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=206bdf0ea30844d5891a8df8aa650e74)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:03.639608 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04c6de-3717-4349-baac-5015acfc9336 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:03.687699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1b04c6de-3717-4349-baac-5015acfc9336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '206bdf0ea30844d5891a8df8aa650e74'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:03.688351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1b04c6de-3717-4349-baac-5015acfc9336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '206bdf0ea30844d5891a8df8aa650e74'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:03.695861 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1b04c6de-3717-4349-baac-5015acfc9336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '206bdf0ea30844d5891a8df8aa650e74'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:03.702964 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1b04c6de-3717-4349-baac-5015acfc9336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '206bdf0ea30844d5891a8df8aa650e74'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:03.715229 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1b04c6de-3717-4349-baac-5015acfc9336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '206bdf0ea30844d5891a8df8aa650e74'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:03.720887 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1351/2687] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:23:03 2022] DELETE /identity/v3/users/206bdf0ea30844d5891a8df8aa650e74 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:23:04.008930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b021dc-6e66-4295-82c1-cf1cc742fdfa admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:04.010912 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-81b021dc-6e66-4295-82c1-cf1cc742fdfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:04.024297 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b021dc-6e66-4295-82c1-cf1cc742fdfa admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:04.084211 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45362bd3-113a-45e1-a5df-b261855c6adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:04.084868 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45362bd3-113a-45e1-a5df-b261855c6adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:04.085182 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45362bd3-113a-45e1-a5df-b261855c6adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:04.085461 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45362bd3-113a-45e1-a5df-b261855c6adc admin admin] PATH_INFO: `/v3/projects/944c23a1cef7432f8da708e82709e5e0` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:04.086576 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45362bd3-113a-45e1-a5df-b261855c6adc admin admin] RBAC: Authorizing `identity:delete_project(project_id=944c23a1cef7432f8da708e82709e5e0)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:04.089145 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45362bd3-113a-45e1-a5df-b261855c6adc admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:04.137967 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-45362bd3-113a-45e1-a5df-b261855c6adc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '944c23a1cef7432f8da708e82709e5e0', 'request_id': 'req-45362bd3-113a-45e1-a5df-b261855c6adc'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:04.143896 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-45362bd3-113a-45e1-a5df-b261855c6adc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '944c23a1cef7432f8da708e82709e5e0', 'request_id': 'req-45362bd3-113a-45e1-a5df-b261855c6adc'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:04.145524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:04.152602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-45362bd3-113a-45e1-a5df-b261855c6adc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '944c23a1cef7432f8da708e82709e5e0', 'request_id': 'req-45362bd3-113a-45e1-a5df-b261855c6adc'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:04.165823 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-45362bd3-113a-45e1-a5df-b261855c6adc admin admin] The token cache is being invalidate because project 944c23a1cef7432f8da708e82709e5e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:23:04.166117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-45362bd3-113a-45e1-a5df-b261855c6adc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:04.166769 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-45362bd3-113a-45e1-a5df-b261855c6adc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:04.168318 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1337/2688] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:23:04 2022] DELETE /identity/v3/projects/944c23a1cef7432f8da708e82709e5e0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:04.172794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04c6de-3717-4349-baac-5015acfc9336 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:04.174138 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1b04c6de-3717-4349-baac-5015acfc9336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:04.187579 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04c6de-3717-4349-baac-5015acfc9336 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:04.214119 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:04.285891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2100205-1538-4d2b-840d-092ae48b37a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:04.286522 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2100205-1538-4d2b-840d-092ae48b37a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:04.286802 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2100205-1538-4d2b-840d-092ae48b37a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:04.287129 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2100205-1538-4d2b-840d-092ae48b37a2 admin admin] PATH_INFO: `/v3/users/2b144f26934b476b8673e8382dd65f1b` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:04.288268 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2100205-1538-4d2b-840d-092ae48b37a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b144f26934b476b8673e8382dd65f1b)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:04.290206 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2100205-1538-4d2b-840d-092ae48b37a2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:04.345476 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f2100205-1538-4d2b-840d-092ae48b37a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b144f26934b476b8673e8382dd65f1b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:04.346365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f2100205-1538-4d2b-840d-092ae48b37a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b144f26934b476b8673e8382dd65f1b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:04.356270 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f2100205-1538-4d2b-840d-092ae48b37a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b144f26934b476b8673e8382dd65f1b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:04.365660 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f2100205-1538-4d2b-840d-092ae48b37a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b144f26934b476b8673e8382dd65f1b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:04.382287 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f2100205-1538-4d2b-840d-092ae48b37a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b144f26934b476b8673e8382dd65f1b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:04.395140 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1352/2689] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:23:04 2022] DELETE /identity/v3/users/2b144f26934b476b8673e8382dd65f1b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:04.734981 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45362bd3-113a-45e1-a5df-b261855c6adc admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:04.736492 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-45362bd3-113a-45e1-a5df-b261855c6adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:04.764559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45362bd3-113a-45e1-a5df-b261855c6adc admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:04.833067 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee3e62-e2f0-4b4f-9e97-ae3e7dbd68f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:04.833694 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee3e62-e2f0-4b4f-9e97-ae3e7dbd68f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:04.833973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee3e62-e2f0-4b4f-9e97-ae3e7dbd68f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:04.834249 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee3e62-e2f0-4b4f-9e97-ae3e7dbd68f3 admin admin] PATH_INFO: `/v3/projects/d1cac850b3d946e9ac65d39c0ca79121` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:04.835466 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee3e62-e2f0-4b4f-9e97-ae3e7dbd68f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1cac850b3d946e9ac65d39c0ca79121)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:04.837380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee3e62-e2f0-4b4f-9e97-ae3e7dbd68f3 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:04.884096 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c5ee3e62-e2f0-4b4f-9e97-ae3e7dbd68f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1cac850b3d946e9ac65d39c0ca79121', 'request_id': 'req-c5ee3e62-e2f0-4b4f-9e97-ae3e7dbd68f3'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:04.891020 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c5ee3e62-e2f0-4b4f-9e97-ae3e7dbd68f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1cac850b3d946e9ac65d39c0ca79121', 'request_id': 'req-c5ee3e62-e2f0-4b4f-9e97-ae3e7dbd68f3'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:04.900137 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c5ee3e62-e2f0-4b4f-9e97-ae3e7dbd68f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1cac850b3d946e9ac65d39c0ca79121', 'request_id': 'req-c5ee3e62-e2f0-4b4f-9e97-ae3e7dbd68f3'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:04.912423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c5ee3e62-e2f0-4b4f-9e97-ae3e7dbd68f3 admin admin] The token cache is being invalidate because project d1cac850b3d946e9ac65d39c0ca79121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:23:04.912778 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c5ee3e62-e2f0-4b4f-9e97-ae3e7dbd68f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:04.914140 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c5ee3e62-e2f0-4b4f-9e97-ae3e7dbd68f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:04.916580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1338/2690] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:23:04 2022] DELETE /identity/v3/projects/d1cac850b3d946e9ac65d39c0ca79121 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:04.921584 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc92950-5d62-40b4-ba90-33809062ecba None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:04.922043 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc92950-5d62-40b4-ba90-33809062ecba None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:04.922269 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc92950-5d62-40b4-ba90-33809062ecba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:04.942356 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-dcc92950-5d62-40b4-ba90-33809062ecba None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:04.943643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dcc92950-5d62-40b4-ba90-33809062ecba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:05.007405 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1353/2691] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:05.016001 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b4e92-9773-480d-8b0f-eece1383e990 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:05.016283 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b4e92-9773-480d-8b0f-eece1383e990 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:05.016559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b4e92-9773-480d-8b0f-eece1383e990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:05.035994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-729b4e92-9773-480d-8b0f-eece1383e990 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:05.037180 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-729b4e92-9773-480d-8b0f-eece1383e990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:05.046426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1339/2692] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:05.050804 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc92950-5d62-40b4-ba90-33809062ecba None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:05.061151 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc92950-5d62-40b4-ba90-33809062ecba None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:05.065650 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539cf88-c34c-4406-b08a-c2b31c94b7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:05.066232 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539cf88-c34c-4406-b08a-c2b31c94b7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:05.066505 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539cf88-c34c-4406-b08a-c2b31c94b7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:05.066770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539cf88-c34c-4406-b08a-c2b31c94b7b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:05.067473 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539cf88-c34c-4406-b08a-c2b31c94b7b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:23:05.067763 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539cf88-c34c-4406-b08a-c2b31c94b7b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:05.069339 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539cf88-c34c-4406-b08a-c2b31c94b7b7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:05.080707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1354/2693] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:23:05.085501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b4e92-9773-480d-8b0f-eece1383e990 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:05.096379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b4e92-9773-480d-8b0f-eece1383e990 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:05.101041 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1741495-bc96-4f42-bd27-0ec7d9d83436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:05.101650 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1741495-bc96-4f42-bd27-0ec7d9d83436 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:05.101931 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1741495-bc96-4f42-bd27-0ec7d9d83436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:05.102202 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1741495-bc96-4f42-bd27-0ec7d9d83436 admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:05.102869 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1741495-bc96-4f42-bd27-0ec7d9d83436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:05.105321 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1741495-bc96-4f42-bd27-0ec7d9d83436 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:05.132306 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1340/2694] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:23:05 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:23:05.136487 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539cf88-c34c-4406-b08a-c2b31c94b7b7 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:05.146248 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539cf88-c34c-4406-b08a-c2b31c94b7b7 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:05.164427 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:05.205065 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fb482-36d4-4946-aba9-7c576fd840a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:05.205672 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fb482-36d4-4946-aba9-7c576fd840a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:05.205952 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fb482-36d4-4946-aba9-7c576fd840a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:05.206227 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fb482-36d4-4946-aba9-7c576fd840a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:05.207139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fb482-36d4-4946-aba9-7c576fd840a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:05.209053 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fb482-36d4-4946-aba9-7c576fd840a6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:05.230350 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1355/2695] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:23:05 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:23:05.234807 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1741495-bc96-4f42-bd27-0ec7d9d83436 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:05.250784 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1741495-bc96-4f42-bd27-0ec7d9d83436 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:05.256315 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a063a-a3f3-4c65-a81c-f5299aa7d235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:05.257340 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a063a-a3f3-4c65-a81c-f5299aa7d235 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:05.257839 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a063a-a3f3-4c65-a81c-f5299aa7d235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:05.258324 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a063a-a3f3-4c65-a81c-f5299aa7d235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:05.258988 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a063a-a3f3-4c65-a81c-f5299aa7d235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:05.261861 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a063a-a3f3-4c65-a81c-f5299aa7d235 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:05.273085 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1341/2696] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:23:05.277603 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fb482-36d4-4946-aba9-7c576fd840a6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:05.293834 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fb482-36d4-4946-aba9-7c576fd840a6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:05.301570 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d79e7c-dd95-43d2-86d9-f721ae40114c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:05.302169 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d79e7c-dd95-43d2-86d9-f721ae40114c admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:05.302443 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d79e7c-dd95-43d2-86d9-f721ae40114c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:05.302706 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d79e7c-dd95-43d2-86d9-f721ae40114c admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:05.303374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d79e7c-dd95-43d2-86d9-f721ae40114c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:05.309717 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d79e7c-dd95-43d2-86d9-f721ae40114c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:05.323826 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1356/2697] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:23:05.329555 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a063a-a3f3-4c65-a81c-f5299aa7d235 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:05.336682 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d79e7c-dd95-43d2-86d9-f721ae40114c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:05.339019 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-84d79e7c-dd95-43d2-86d9-f721ae40114c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:05.343031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a063a-a3f3-4c65-a81c-f5299aa7d235 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:05.347723 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1728a94-01e3-4d09-8ff6-85ebc567fe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:05.348376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1728a94-01e3-4d09-8ff6-85ebc567fe49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:05.348657 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1728a94-01e3-4d09-8ff6-85ebc567fe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:05.348935 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1728a94-01e3-4d09-8ff6-85ebc567fe49 admin admin] PATH_INFO: `/v3/projects/f25a217bbfa94630b894737a3538ef4b/users/4a80f7737d9c4ff7a444594fff50e4d5/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:05.351799 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d79e7c-dd95-43d2-86d9-f721ae40114c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:05.356886 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6705d-1315-42e1-ad9f-8263d15760e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:05.357496 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6705d-1315-42e1-ad9f-8263d15760e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:05.357770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6705d-1315-42e1-ad9f-8263d15760e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:05.358035 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6705d-1315-42e1-ad9f-8263d15760e5 admin admin] PATH_INFO: `/v3/users/0ca4f727bbe44fc0b4812414afb1dcca` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:05.359156 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6705d-1315-42e1-ad9f-8263d15760e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ca4f727bbe44fc0b4812414afb1dcca)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:05.361076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6705d-1315-42e1-ad9f-8263d15760e5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:05.364165 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1728a94-01e3-4d09-8ff6-85ebc567fe49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f25a217bbfa94630b894737a3538ef4b, user_id=4a80f7737d9c4ff7a444594fff50e4d5, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:05.366787 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1728a94-01e3-4d09-8ff6-85ebc567fe49 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:05.383961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1342/2698] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:23:05 2022] PUT /identity/v3/projects/f25a217bbfa94630b894737a3538ef4b/users/4a80f7737d9c4ff7a444594fff50e4d5/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:05.396221 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6d4a9-adf2-4c30-b5a7-0d4c53047750 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:05.396643 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6d4a9-adf2-4c30-b5a7-0d4c53047750 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:05.397084 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6d4a9-adf2-4c30-b5a7-0d4c53047750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:05.426235 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:05.430353 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-75c6d4a9-adf2-4c30-b5a7-0d4c53047750 None None] MFA Rules not processed for user `4a80f7737d9c4ff7a444594fff50e4d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:05.432016 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-66f6705d-1315-42e1-ad9f-8263d15760e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ca4f727bbe44fc0b4812414afb1dcca'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:05.432538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-75c6d4a9-adf2-4c30-b5a7-0d4c53047750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:05.432917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-66f6705d-1315-42e1-ad9f-8263d15760e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ca4f727bbe44fc0b4812414afb1dcca'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:05.444155 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-66f6705d-1315-42e1-ad9f-8263d15760e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ca4f727bbe44fc0b4812414afb1dcca'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:05.454147 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-66f6705d-1315-42e1-ad9f-8263d15760e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ca4f727bbe44fc0b4812414afb1dcca'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:05.468945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-66f6705d-1315-42e1-ad9f-8263d15760e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ca4f727bbe44fc0b4812414afb1dcca'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:05.475019 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1357/2699] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:23:05 2022] DELETE /identity/v3/users/0ca4f727bbe44fc0b4812414afb1dcca => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:23:05.479653 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b593a-5323-4148-b78f-b218b05f23d5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:05.480106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b593a-5323-4148-b78f-b218b05f23d5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:05.480484 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b593a-5323-4148-b78f-b218b05f23d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:05.500713 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-386b593a-5323-4148-b78f-b218b05f23d5 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:05.502166 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-386b593a-5323-4148-b78f-b218b05f23d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:05.506574 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1343/2700] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:05.518331 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6d4a9-adf2-4c30-b5a7-0d4c53047750 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:05.521248 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-75c6d4a9-adf2-4c30-b5a7-0d4c53047750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:05.567759 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1358/2701] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:23:05.577921 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b593a-5323-4148-b78f-b218b05f23d5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:05.579331 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-386b593a-5323-4148-b78f-b218b05f23d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:05.580796 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6d4a9-adf2-4c30-b5a7-0d4c53047750 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:05.594244 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:05.644729 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690e190-61b6-474e-b2cf-ea71be0346e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:05.645998 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690e190-61b6-474e-b2cf-ea71be0346e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:05.646283 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690e190-61b6-474e-b2cf-ea71be0346e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:05.646559 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690e190-61b6-474e-b2cf-ea71be0346e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:05.657399 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b593a-5323-4148-b78f-b218b05f23d5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:05.661222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491a4ba-1efc-465c-8e6f-d121fa4a3f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:05.661916 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491a4ba-1efc-465c-8e6f-d121fa4a3f4c service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:05.666395 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491a4ba-1efc-465c-8e6f-d121fa4a3f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:05.666679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491a4ba-1efc-465c-8e6f-d121fa4a3f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:05.685906 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491a4ba-1efc-465c-8e6f-d121fa4a3f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:05.690067 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491a4ba-1efc-465c-8e6f-d121fa4a3f4c service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:05.701876 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1359/2702] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:23:05.722488 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690e190-61b6-474e-b2cf-ea71be0346e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:05.724031 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690e190-61b6-474e-b2cf-ea71be0346e9 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:05.734881 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1344/2703] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:23:06.053869 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491a4ba-1efc-465c-8e6f-d121fa4a3f4c service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:06.056720 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6491a4ba-1efc-465c-8e6f-d121fa4a3f4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:06.090837 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491a4ba-1efc-465c-8e6f-d121fa4a3f4c service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:06.104799 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41279a33-6629-4ff9-b847-2ef492d68741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:06.105708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41279a33-6629-4ff9-b847-2ef492d68741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:06.106982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41279a33-6629-4ff9-b847-2ef492d68741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:06.107434 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41279a33-6629-4ff9-b847-2ef492d68741 admin admin] PATH_INFO: `/v3/projects/8a93443a87b64633aee027ebbe727104` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:06.110415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41279a33-6629-4ff9-b847-2ef492d68741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a93443a87b64633aee027ebbe727104)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:06.113496 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41279a33-6629-4ff9-b847-2ef492d68741 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:06.197871 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-41279a33-6629-4ff9-b847-2ef492d68741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a93443a87b64633aee027ebbe727104', 'request_id': 'req-41279a33-6629-4ff9-b847-2ef492d68741'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:06.213014 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-41279a33-6629-4ff9-b847-2ef492d68741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a93443a87b64633aee027ebbe727104', 'request_id': 'req-41279a33-6629-4ff9-b847-2ef492d68741'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:06.222675 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-41279a33-6629-4ff9-b847-2ef492d68741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a93443a87b64633aee027ebbe727104', 'request_id': 'req-41279a33-6629-4ff9-b847-2ef492d68741'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:06.234536 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-41279a33-6629-4ff9-b847-2ef492d68741 admin admin] The token cache is being invalidate because project 8a93443a87b64633aee027ebbe727104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:23:06.234892 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-41279a33-6629-4ff9-b847-2ef492d68741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:06.235793 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-41279a33-6629-4ff9-b847-2ef492d68741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:06.237325 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1360/2704] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:23:06 2022] DELETE /identity/v3/projects/8a93443a87b64633aee027ebbe727104 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:06.241428 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690e190-61b6-474e-b2cf-ea71be0346e9 service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:06.252804 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690e190-61b6-474e-b2cf-ea71be0346e9 service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:06.263351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:06.316116 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a94db-f44c-4e27-8886-1d1ad3d7f567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:06.316740 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a94db-f44c-4e27-8886-1d1ad3d7f567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:06.317011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a94db-f44c-4e27-8886-1d1ad3d7f567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:06.317274 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a94db-f44c-4e27-8886-1d1ad3d7f567 admin admin] PATH_INFO: `/v3/users/d0bbdbaa10274f9caafcccbe6f90f33a` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:06.318405 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a94db-f44c-4e27-8886-1d1ad3d7f567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0bbdbaa10274f9caafcccbe6f90f33a)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:06.320353 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a94db-f44c-4e27-8886-1d1ad3d7f567 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:06.378335 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-163a94db-f44c-4e27-8886-1d1ad3d7f567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0bbdbaa10274f9caafcccbe6f90f33a'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:06.379141 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-163a94db-f44c-4e27-8886-1d1ad3d7f567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0bbdbaa10274f9caafcccbe6f90f33a'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:06.389124 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-163a94db-f44c-4e27-8886-1d1ad3d7f567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0bbdbaa10274f9caafcccbe6f90f33a'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:06.401770 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-163a94db-f44c-4e27-8886-1d1ad3d7f567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0bbdbaa10274f9caafcccbe6f90f33a'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:06.418047 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-163a94db-f44c-4e27-8886-1d1ad3d7f567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0bbdbaa10274f9caafcccbe6f90f33a'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:06.424184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1345/2705] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:23:06 2022] DELETE /identity/v3/users/d0bbdbaa10274f9caafcccbe6f90f33a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:06.715858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41279a33-6629-4ff9-b847-2ef492d68741 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:06.718097 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-41279a33-6629-4ff9-b847-2ef492d68741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:06.732578 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41279a33-6629-4ff9-b847-2ef492d68741 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:06.789635 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fd723-86df-49b0-8abe-d6ef1fe223aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:06.790264 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fd723-86df-49b0-8abe-d6ef1fe223aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:06.790652 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fd723-86df-49b0-8abe-d6ef1fe223aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:06.791537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fd723-86df-49b0-8abe-d6ef1fe223aa admin admin] PATH_INFO: `/v3/projects/d6ddccc6be9c4cd3b34319419fb691d1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:06.792696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fd723-86df-49b0-8abe-d6ef1fe223aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6ddccc6be9c4cd3b34319419fb691d1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:06.794608 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fd723-86df-49b0-8abe-d6ef1fe223aa admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:06.833489 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:06.841175 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fe2fd723-86df-49b0-8abe-d6ef1fe223aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6ddccc6be9c4cd3b34319419fb691d1', 'request_id': 'req-fe2fd723-86df-49b0-8abe-d6ef1fe223aa'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:06.849799 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fe2fd723-86df-49b0-8abe-d6ef1fe223aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6ddccc6be9c4cd3b34319419fb691d1', 'request_id': 'req-fe2fd723-86df-49b0-8abe-d6ef1fe223aa'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:06.857616 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fe2fd723-86df-49b0-8abe-d6ef1fe223aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6ddccc6be9c4cd3b34319419fb691d1', 'request_id': 'req-fe2fd723-86df-49b0-8abe-d6ef1fe223aa'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:06.868467 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fe2fd723-86df-49b0-8abe-d6ef1fe223aa admin admin] The token cache is being invalidate because project d6ddccc6be9c4cd3b34319419fb691d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:23:06.868756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fe2fd723-86df-49b0-8abe-d6ef1fe223aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:06.869415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fe2fd723-86df-49b0-8abe-d6ef1fe223aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:06.870896 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1361/2706] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:23:06 2022] DELETE /identity/v3/projects/d6ddccc6be9c4cd3b34319419fb691d1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:06.876068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38a47a-59a9-4753-816b-b849894c0e1f None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:06.876365 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38a47a-59a9-4753-816b-b849894c0e1f None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:06.876651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38a47a-59a9-4753-816b-b849894c0e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:06.896200 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-fb38a47a-59a9-4753-816b-b849894c0e1f None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:06.897407 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-fb38a47a-59a9-4753-816b-b849894c0e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:06.966341 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1346/2707] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:06.974228 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5367677-6a56-4d50-a4c3-7b528892ab76 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:06.974528 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5367677-6a56-4d50-a4c3-7b528892ab76 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:06.974797 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5367677-6a56-4d50-a4c3-7b528892ab76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:07.005018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d5367677-6a56-4d50-a4c3-7b528892ab76 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:07.006626 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d5367677-6a56-4d50-a4c3-7b528892ab76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:07.015792 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1362/2708] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:07.020324 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38a47a-59a9-4753-816b-b849894c0e1f None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:07.034320 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38a47a-59a9-4753-816b-b849894c0e1f None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:07.039066 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13704e-01b9-41d2-949f-60a6dca1a415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:07.039670 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13704e-01b9-41d2-949f-60a6dca1a415 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:07.039948 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13704e-01b9-41d2-949f-60a6dca1a415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:07.040222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13704e-01b9-41d2-949f-60a6dca1a415 admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:07.041030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13704e-01b9-41d2-949f-60a6dca1a415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:23:07.041332 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13704e-01b9-41d2-949f-60a6dca1a415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:07.042915 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13704e-01b9-41d2-949f-60a6dca1a415 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:07.059329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1347/2709] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:23:07.060754 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5367677-6a56-4d50-a4c3-7b528892ab76 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:07.070448 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5367677-6a56-4d50-a4c3-7b528892ab76 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:07.075641 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b2e90-4380-4ec0-8cc1-184204535d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:07.076244 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b2e90-4380-4ec0-8cc1-184204535d32 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:07.076522 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b2e90-4380-4ec0-8cc1-184204535d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:07.076795 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b2e90-4380-4ec0-8cc1-184204535d32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:07.077425 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b2e90-4380-4ec0-8cc1-184204535d32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:07.079358 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b2e90-4380-4ec0-8cc1-184204535d32 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:07.121031 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1363/2710] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:23:07 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:23:07.122741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13704e-01b9-41d2-949f-60a6dca1a415 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:07.138951 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13704e-01b9-41d2-949f-60a6dca1a415 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:07.158250 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:07.199358 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6306c8-032d-4663-8c43-4769569174f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:07.199963 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6306c8-032d-4663-8c43-4769569174f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:07.200269 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6306c8-032d-4663-8c43-4769569174f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:07.200541 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6306c8-032d-4663-8c43-4769569174f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:07.201157 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6306c8-032d-4663-8c43-4769569174f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:07.203082 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6306c8-032d-4663-8c43-4769569174f4 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:07.226034 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1348/2711] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:23:07 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:23:07.229355 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b2e90-4380-4ec0-8cc1-184204535d32 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:07.242042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b2e90-4380-4ec0-8cc1-184204535d32 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:07.247382 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57595c-6ded-40b6-92cc-2994ab865a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:07.247996 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57595c-6ded-40b6-92cc-2994ab865a09 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:07.248273 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57595c-6ded-40b6-92cc-2994ab865a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:07.248542 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57595c-6ded-40b6-92cc-2994ab865a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:07.249213 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57595c-6ded-40b6-92cc-2994ab865a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:07.251583 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57595c-6ded-40b6-92cc-2994ab865a09 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:07.251731 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512521a-d6c7-4457-bc6c-193722d4d8c5 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:07.252192 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512521a-d6c7-4457-bc6c-193722d4d8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:07.252480 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512521a-d6c7-4457-bc6c-193722d4d8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:07.265917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1364/2712] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:23:07.267023 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57595c-6ded-40b6-92cc-2994ab865a09 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:07.286562 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-5512521a-d6c7-4457-bc6c-193722d4d8c5 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:07.286562 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-5512521a-d6c7-4457-bc6c-193722d4d8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:07.286796 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57595c-6ded-40b6-92cc-2994ab865a09 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:07.289219 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1349/2713] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Aug 10 13:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:07.289851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18595461-face-4ca0-8a61-8fadf0752d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:07.291660 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18595461-face-4ca0-8a61-8fadf0752d8b admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:07.291941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18595461-face-4ca0-8a61-8fadf0752d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:07.292296 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18595461-face-4ca0-8a61-8fadf0752d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:07.293004 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18595461-face-4ca0-8a61-8fadf0752d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:07.294798 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18595461-face-4ca0-8a61-8fadf0752d8b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:07.312738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512521a-d6c7-4457-bc6c-193722d4d8c5 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:07.314650 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-5512521a-d6c7-4457-bc6c-193722d4d8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:07.319732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1365/2714] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:23:07.325451 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18595461-face-4ca0-8a61-8fadf0752d8b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:07.337425 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18595461-face-4ca0-8a61-8fadf0752d8b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:07.342117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36150dec-c3f2-44d7-ad91-c20f14ff4e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:07.342755 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36150dec-c3f2-44d7-ad91-c20f14ff4e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:07.343123 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36150dec-c3f2-44d7-ad91-c20f14ff4e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:07.343593 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36150dec-c3f2-44d7-ad91-c20f14ff4e5e admin admin] PATH_INFO: `/v3/projects/e114b4bc85f043e0b833147d4640e1a8/users/0b04a5839fe74d5a967e88fbc90f08ab/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:07.361523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36150dec-c3f2-44d7-ad91-c20f14ff4e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e114b4bc85f043e0b833147d4640e1a8, user_id=0b04a5839fe74d5a967e88fbc90f08ab, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:07.364195 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36150dec-c3f2-44d7-ad91-c20f14ff4e5e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:07.391589 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1366/2715] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:23:07 2022] PUT /identity/v3/projects/e114b4bc85f043e0b833147d4640e1a8/users/0b04a5839fe74d5a967e88fbc90f08ab/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:23:07.394701 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88d3f1-3068-45f5-b01e-90f09f2cca29 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:07.394982 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88d3f1-3068-45f5-b01e-90f09f2cca29 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:07.395401 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88d3f1-3068-45f5-b01e-90f09f2cca29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:07.412030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512521a-d6c7-4457-bc6c-193722d4d8c5 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:07.426676 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8d88d3f1-3068-45f5-b01e-90f09f2cca29 None None] MFA Rules not processed for user `0b04a5839fe74d5a967e88fbc90f08ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:07.427926 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8d88d3f1-3068-45f5-b01e-90f09f2cca29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:07.510776 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c4217-e8c3-4382-98ff-b8c515826215 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:07.511578 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c4217-e8c3-4382-98ff-b8c515826215 service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:07.511920 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c4217-e8c3-4382-98ff-b8c515826215 service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:07.512267 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c4217-e8c3-4382-98ff-b8c515826215 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:07.521047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1367/2716] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:23:07.525342 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88d3f1-3068-45f5-b01e-90f09f2cca29 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:07.559106 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:07.577866 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:07.590541 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c4217-e8c3-4382-98ff-b8c515826215 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:07.592176 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c4217-e8c3-4382-98ff-b8c515826215 service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:07.598992 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88d3f1-3068-45f5-b01e-90f09f2cca29 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:07.602578 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1350/2717] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:23:07.605059 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262a7c5-8bdd-4230-a8dd-d009f471fa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:07.605975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262a7c5-8bdd-4230-a8dd-d009f471fa8e admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:07.606422 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262a7c5-8bdd-4230-a8dd-d009f471fa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:07.606560 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262a7c5-8bdd-4230-a8dd-d009f471fa8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:07.607390 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262a7c5-8bdd-4230-a8dd-d009f471fa8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:07.609517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262a7c5-8bdd-4230-a8dd-d009f471fa8e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:07.645470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1368/2718] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:23:07 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:23:07.649658 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c4217-e8c3-4382-98ff-b8c515826215 service nova] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:07.659209 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c4217-e8c3-4382-98ff-b8c515826215 service nova] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:07.721640 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f402b8b-2442-4a94-9dbc-1758b86f8aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:07.722244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f402b8b-2442-4a94-9dbc-1758b86f8aef admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:07.722523 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f402b8b-2442-4a94-9dbc-1758b86f8aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:07.722797 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f402b8b-2442-4a94-9dbc-1758b86f8aef admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:07.723625 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f402b8b-2442-4a94-9dbc-1758b86f8aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:07.725379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f402b8b-2442-4a94-9dbc-1758b86f8aef admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:07.747296 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1351/2719] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:23:07 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:23:07.751395 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262a7c5-8bdd-4230-a8dd-d009f471fa8e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:07.762222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262a7c5-8bdd-4230-a8dd-d009f471fa8e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:07.766942 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83fa52-ba37-4b2c-aa99-a86acfefc1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:07.767573 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83fa52-ba37-4b2c-aa99-a86acfefc1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:07.767852 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83fa52-ba37-4b2c-aa99-a86acfefc1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:07.768125 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83fa52-ba37-4b2c-aa99-a86acfefc1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:07.768768 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83fa52-ba37-4b2c-aa99-a86acfefc1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:07.770363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83fa52-ba37-4b2c-aa99-a86acfefc1f3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:07.780901 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1369/2720] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:23:07.785179 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f402b8b-2442-4a94-9dbc-1758b86f8aef admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:07.796168 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f402b8b-2442-4a94-9dbc-1758b86f8aef admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:07.800809 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fe489-fd22-4e2c-8f73-32cb47a39996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:07.801455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fe489-fd22-4e2c-8f73-32cb47a39996 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:07.801729 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fe489-fd22-4e2c-8f73-32cb47a39996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:07.802594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fe489-fd22-4e2c-8f73-32cb47a39996 admin admin] PATH_INFO: `/v3/projects/5c8e9241fbf34a4d8a817c77d0b8af7c/users/440e01f0ff5f423d80303ca9511bc85f/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:07.818498 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3fe489-fd22-4e2c-8f73-32cb47a39996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c8e9241fbf34a4d8a817c77d0b8af7c, user_id=440e01f0ff5f423d80303ca9511bc85f, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:07.821423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3fe489-fd22-4e2c-8f73-32cb47a39996 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:07.835102 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1352/2721] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:23:07 2022] PUT /identity/v3/projects/5c8e9241fbf34a4d8a817c77d0b8af7c/users/440e01f0ff5f423d80303ca9511bc85f/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:07.839419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83fa52-ba37-4b2c-aa99-a86acfefc1f3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:07.849505 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83fa52-ba37-4b2c-aa99-a86acfefc1f3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:07.907851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582b730-940c-46da-a73f-96257c907817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:07.908530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582b730-940c-46da-a73f-96257c907817 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:07.908836 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582b730-940c-46da-a73f-96257c907817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:07.909112 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582b730-940c-46da-a73f-96257c907817 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:07.909795 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582b730-940c-46da-a73f-96257c907817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:07.911441 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582b730-940c-46da-a73f-96257c907817 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:07.922726 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1370/2722] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:23:07.929235 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fe489-fd22-4e2c-8f73-32cb47a39996 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:07.939979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fe489-fd22-4e2c-8f73-32cb47a39996 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:07.944593 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfcf13-cfad-45d9-8c82-f526b0edcb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:07.945234 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfcf13-cfad-45d9-8c82-f526b0edcb49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:07.945561 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfcf13-cfad-45d9-8c82-f526b0edcb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:07.945783 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfcf13-cfad-45d9-8c82-f526b0edcb49 admin admin] PATH_INFO: `/v3/projects/5c8e9241fbf34a4d8a817c77d0b8af7c/users/440e01f0ff5f423d80303ca9511bc85f/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:07.947813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfcf13-cfad-45d9-8c82-f526b0edcb49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c8e9241fbf34a4d8a817c77d0b8af7c, user_id=440e01f0ff5f423d80303ca9511bc85f, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:07.950417 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfcf13-cfad-45d9-8c82-f526b0edcb49 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:07.960859 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1353/2723] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:23:07 2022] PUT /identity/v3/projects/5c8e9241fbf34a4d8a817c77d0b8af7c/users/440e01f0ff5f423d80303ca9511bc85f/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:07.972064 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd68083-9fde-40f4-9ab3-08a9981cbe44 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:07.972353 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd68083-9fde-40f4-9ab3-08a9981cbe44 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:07.972630 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd68083-9fde-40f4-9ab3-08a9981cbe44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:08.004818 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8dd68083-9fde-40f4-9ab3-08a9981cbe44 None None] MFA Rules not processed for user `440e01f0ff5f423d80303ca9511bc85f`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:08.005975 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8dd68083-9fde-40f4-9ab3-08a9981cbe44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:08.072833 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1371/2724] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:08.084404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfcf13-cfad-45d9-8c82-f526b0edcb49 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:08.086083 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-6ddfcf13-cfad-45d9-8c82-f526b0edcb49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:08.144131 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfcf13-cfad-45d9-8c82-f526b0edcb49 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:08.147999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3078004-1ed0-4109-a700-248259dc87ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:08.148599 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3078004-1ed0-4109-a700-248259dc87ac service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:08.148883 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3078004-1ed0-4109-a700-248259dc87ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:08.149228 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3078004-1ed0-4109-a700-248259dc87ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:08.158566 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3078004-1ed0-4109-a700-248259dc87ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:08.160037 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3078004-1ed0-4109-a700-248259dc87ac service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:08.169311 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1354/2725] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:23:08.304227 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd68083-9fde-40f4-9ab3-08a9981cbe44 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:08.346534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:08.368236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd68083-9fde-40f4-9ab3-08a9981cbe44 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:08.373234 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9f7f5-d08e-489c-aaa1-8c6dc81a9b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:08.373891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9f7f5-d08e-489c-aaa1-8c6dc81a9b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:08.374172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9f7f5-d08e-489c-aaa1-8c6dc81a9b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:08.374443 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9f7f5-d08e-489c-aaa1-8c6dc81a9b19 admin admin] PATH_INFO: `/v3/users/0b04a5839fe74d5a967e88fbc90f08ab` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:08.375605 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b9f7f5-d08e-489c-aaa1-8c6dc81a9b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b04a5839fe74d5a967e88fbc90f08ab)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:08.377882 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b9f7f5-d08e-489c-aaa1-8c6dc81a9b19 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:08.429787 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-93b9f7f5-d08e-489c-aaa1-8c6dc81a9b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b04a5839fe74d5a967e88fbc90f08ab'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:08.430460 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-93b9f7f5-d08e-489c-aaa1-8c6dc81a9b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b04a5839fe74d5a967e88fbc90f08ab'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:08.439729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-93b9f7f5-d08e-489c-aaa1-8c6dc81a9b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b04a5839fe74d5a967e88fbc90f08ab'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:08.447322 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-93b9f7f5-d08e-489c-aaa1-8c6dc81a9b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b04a5839fe74d5a967e88fbc90f08ab'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:08.459677 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-93b9f7f5-d08e-489c-aaa1-8c6dc81a9b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b04a5839fe74d5a967e88fbc90f08ab'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:08.465805 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1372/2726] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:23:08 2022] DELETE /identity/v3/users/0b04a5839fe74d5a967e88fbc90f08ab => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:08.470133 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a282b5d-3124-4138-8307-b12f50d53481 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:08.470590 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a282b5d-3124-4138-8307-b12f50d53481 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:08.470687 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a282b5d-3124-4138-8307-b12f50d53481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:08.489629 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-8a282b5d-3124-4138-8307-b12f50d53481 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:08.490874 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-8a282b5d-3124-4138-8307-b12f50d53481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:08.516118 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:08.531095 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9f7f5-d08e-489c-aaa1-8c6dc81a9b19 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:08.532507 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-93b9f7f5-d08e-489c-aaa1-8c6dc81a9b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:08.555212 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1355/2727] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:08.565685 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a282b5d-3124-4138-8307-b12f50d53481 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:08.567046 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-8a282b5d-3124-4138-8307-b12f50d53481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:08.597184 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9f7f5-d08e-489c-aaa1-8c6dc81a9b19 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:08.602228 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe466815-f72c-407e-8e85-2ced54f7e913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:08.602861 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe466815-f72c-407e-8e85-2ced54f7e913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:08.603175 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe466815-f72c-407e-8e85-2ced54f7e913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:08.603470 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe466815-f72c-407e-8e85-2ced54f7e913 admin admin] PATH_INFO: `/v3/users/4a80f7737d9c4ff7a444594fff50e4d5` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:08.605144 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe466815-f72c-407e-8e85-2ced54f7e913 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a80f7737d9c4ff7a444594fff50e4d5)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:08.607084 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe466815-f72c-407e-8e85-2ced54f7e913 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:08.624490 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a282b5d-3124-4138-8307-b12f50d53481 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:08.628083 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5face51-096f-4449-9a41-a0a0ca7b6974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:08.628684 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5face51-096f-4449-9a41-a0a0ca7b6974 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:08.628964 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5face51-096f-4449-9a41-a0a0ca7b6974 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:08.629236 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5face51-096f-4449-9a41-a0a0ca7b6974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:08.640202 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5face51-096f-4449-9a41-a0a0ca7b6974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:08.641822 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5face51-096f-4449-9a41-a0a0ca7b6974 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:08.652669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1356/2728] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:23:08.658898 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fe466815-f72c-407e-8e85-2ced54f7e913 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a80f7737d9c4ff7a444594fff50e4d5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:08.659777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fe466815-f72c-407e-8e85-2ced54f7e913 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a80f7737d9c4ff7a444594fff50e4d5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:08.668678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fe466815-f72c-407e-8e85-2ced54f7e913 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a80f7737d9c4ff7a444594fff50e4d5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:08.671097 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5face51-096f-4449-9a41-a0a0ca7b6974 service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:08.672535 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c5face51-096f-4449-9a41-a0a0ca7b6974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:08.673896 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:08.679202 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fe466815-f72c-407e-8e85-2ced54f7e913 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a80f7737d9c4ff7a444594fff50e4d5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:08.685933 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5face51-096f-4449-9a41-a0a0ca7b6974 service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:08.691553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827625b-beb1-4896-8fab-2da81cae9963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:08.692336 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827625b-beb1-4896-8fab-2da81cae9963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:08.692621 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827625b-beb1-4896-8fab-2da81cae9963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:08.692909 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827625b-beb1-4896-8fab-2da81cae9963 admin admin] PATH_INFO: `/v3/users/33300f966cdd49b882f3e71c235f3ad4` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:08.694047 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827625b-beb1-4896-8fab-2da81cae9963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33300f966cdd49b882f3e71c235f3ad4)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:08.695994 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827625b-beb1-4896-8fab-2da81cae9963 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:08.698211 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fe466815-f72c-407e-8e85-2ced54f7e913 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a80f7737d9c4ff7a444594fff50e4d5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:08.707442 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1373/2729] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:23:08 2022] DELETE /identity/v3/users/4a80f7737d9c4ff7a444594fff50e4d5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:08.712180 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d75f24-74af-4ce7-a109-b96daf33f4c5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:08.712495 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d75f24-74af-4ce7-a109-b96daf33f4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:08.712786 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d75f24-74af-4ce7-a109-b96daf33f4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:08.736960 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c8d75f24-74af-4ce7-a109-b96daf33f4c5 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:08.738255 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c8d75f24-74af-4ce7-a109-b96daf33f4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:08.761792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a827625b-beb1-4896-8fab-2da81cae9963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33300f966cdd49b882f3e71c235f3ad4'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:08.763778 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a827625b-beb1-4896-8fab-2da81cae9963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33300f966cdd49b882f3e71c235f3ad4'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:08.773921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a827625b-beb1-4896-8fab-2da81cae9963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33300f966cdd49b882f3e71c235f3ad4'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:08.786238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a827625b-beb1-4896-8fab-2da81cae9963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33300f966cdd49b882f3e71c235f3ad4'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:08.806089 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a827625b-beb1-4896-8fab-2da81cae9963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33300f966cdd49b882f3e71c235f3ad4'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:08.813352 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1374/2730] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:23:08.814114 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1357/2731] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:23:08 2022] DELETE /identity/v3/users/33300f966cdd49b882f3e71c235f3ad4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:23:08.818849 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a41c44-0c06-4ed6-9a00-8dfded54545d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:08.823377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a41c44-0c06-4ed6-9a00-8dfded54545d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:08.823519 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827625b-beb1-4896-8fab-2da81cae9963 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:08.823946 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a41c44-0c06-4ed6-9a00-8dfded54545d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:08.824883 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-a827625b-beb1-4896-8fab-2da81cae9963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:08.846679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b0a41c44-0c06-4ed6-9a00-8dfded54545d None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:08.848146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b0a41c44-0c06-4ed6-9a00-8dfded54545d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:08.903403 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:08.924558 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827625b-beb1-4896-8fab-2da81cae9963 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:08.928857 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d2fa3-8dd7-43de-80b4-4a9bf4f856ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:08.929663 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d2fa3-8dd7-43de-80b4-4a9bf4f856ec service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:08.930006 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d2fa3-8dd7-43de-80b4-4a9bf4f856ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:08.930349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d2fa3-8dd7-43de-80b4-4a9bf4f856ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:08.932674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1375/2732] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:08.942011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d2fa3-8dd7-43de-80b4-4a9bf4f856ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:08.943529 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a41c44-0c06-4ed6-9a00-8dfded54545d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:08.943685 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d2fa3-8dd7-43de-80b4-4a9bf4f856ec service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:08.955967 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a41c44-0c06-4ed6-9a00-8dfded54545d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:08.956656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1358/2733] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:23:08.959894 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9add3f-a8cb-405f-bb09-d726e28a4f51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:08.960498 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9add3f-a8cb-405f-bb09-d726e28a4f51 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:08.960777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9add3f-a8cb-405f-bb09-d726e28a4f51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:08.961118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9add3f-a8cb-405f-bb09-d726e28a4f51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:08.970957 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9add3f-a8cb-405f-bb09-d726e28a4f51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:08.972425 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9add3f-a8cb-405f-bb09-d726e28a4f51 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:08.984106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1376/2734] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:23:09.046949 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d2fa3-8dd7-43de-80b4-4a9bf4f856ec service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:09.048485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c36d2fa3-8dd7-43de-80b4-4a9bf4f856ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:09.062349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d2fa3-8dd7-43de-80b4-4a9bf4f856ec service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:09.067687 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec217a4e-3321-4fd0-af64-591c21f06e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:09.068580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec217a4e-3321-4fd0-af64-591c21f06e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:09.068580 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec217a4e-3321-4fd0-af64-591c21f06e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:09.068840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec217a4e-3321-4fd0-af64-591c21f06e11 admin admin] PATH_INFO: `/v3/projects/e114b4bc85f043e0b833147d4640e1a8` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:09.069996 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec217a4e-3321-4fd0-af64-591c21f06e11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e114b4bc85f043e0b833147d4640e1a8)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:09.072279 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec217a4e-3321-4fd0-af64-591c21f06e11 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:09.130330 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-ec217a4e-3321-4fd0-af64-591c21f06e11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e114b4bc85f043e0b833147d4640e1a8', 'request_id': 'req-ec217a4e-3321-4fd0-af64-591c21f06e11'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.136725 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-ec217a4e-3321-4fd0-af64-591c21f06e11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e114b4bc85f043e0b833147d4640e1a8', 'request_id': 'req-ec217a4e-3321-4fd0-af64-591c21f06e11'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.143833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-ec217a4e-3321-4fd0-af64-591c21f06e11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e114b4bc85f043e0b833147d4640e1a8', 'request_id': 'req-ec217a4e-3321-4fd0-af64-591c21f06e11'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.157162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-ec217a4e-3321-4fd0-af64-591c21f06e11 admin admin] The token cache is being invalidate because project e114b4bc85f043e0b833147d4640e1a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:23:09.157500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-ec217a4e-3321-4fd0-af64-591c21f06e11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.158161 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-ec217a4e-3321-4fd0-af64-591c21f06e11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.159753 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1359/2735] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:23:09 2022] DELETE /identity/v3/projects/e114b4bc85f043e0b833147d4640e1a8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:09.164161 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9add3f-a8cb-405f-bb09-d726e28a4f51 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:09.174662 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9add3f-a8cb-405f-bb09-d726e28a4f51 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:09.242090 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b679f-6a2f-46cd-afbc-e5f87412ba84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:09.242972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b679f-6a2f-46cd-afbc-e5f87412ba84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:09.243284 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b679f-6a2f-46cd-afbc-e5f87412ba84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:09.243557 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b679f-6a2f-46cd-afbc-e5f87412ba84 admin admin] PATH_INFO: `/v3/users/440e01f0ff5f423d80303ca9511bc85f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:09.244717 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b679f-6a2f-46cd-afbc-e5f87412ba84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=440e01f0ff5f423d80303ca9511bc85f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:09.247474 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b679f-6a2f-46cd-afbc-e5f87412ba84 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:09.254826 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:09.316540 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6e3b679f-6a2f-46cd-afbc-e5f87412ba84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '440e01f0ff5f423d80303ca9511bc85f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.317636 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6e3b679f-6a2f-46cd-afbc-e5f87412ba84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '440e01f0ff5f423d80303ca9511bc85f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.331087 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6e3b679f-6a2f-46cd-afbc-e5f87412ba84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '440e01f0ff5f423d80303ca9511bc85f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.341814 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6e3b679f-6a2f-46cd-afbc-e5f87412ba84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '440e01f0ff5f423d80303ca9511bc85f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.358685 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6e3b679f-6a2f-46cd-afbc-e5f87412ba84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '440e01f0ff5f423d80303ca9511bc85f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.369925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1377/2736] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:23:09 2022] DELETE /identity/v3/users/440e01f0ff5f423d80303ca9511bc85f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:09.401268 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec217a4e-3321-4fd0-af64-591c21f06e11 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:09.403813 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-ec217a4e-3321-4fd0-af64-591c21f06e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:09.419374 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec217a4e-3321-4fd0-af64-591c21f06e11 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:09.437831 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b679f-6a2f-46cd-afbc-e5f87412ba84 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:09.439554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6e3b679f-6a2f-46cd-afbc-e5f87412ba84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:09.498726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436e20a-6b8d-4cbe-bd46-d8b85e99e3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:09.499896 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436e20a-6b8d-4cbe-bd46-d8b85e99e3a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:09.500181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436e20a-6b8d-4cbe-bd46-d8b85e99e3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:09.500452 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436e20a-6b8d-4cbe-bd46-d8b85e99e3a6 admin admin] PATH_INFO: `/v3/projects/f947d1c1c6924aa29d03ea4b7a99d660` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:09.501645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436e20a-6b8d-4cbe-bd46-d8b85e99e3a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f947d1c1c6924aa29d03ea4b7a99d660)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:09.503960 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436e20a-6b8d-4cbe-bd46-d8b85e99e3a6 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:09.532076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b679f-6a2f-46cd-afbc-e5f87412ba84 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:09.537902 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99560ce-1745-49bb-add9-10ade72df4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:09.538650 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99560ce-1745-49bb-add9-10ade72df4f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:09.538822 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99560ce-1745-49bb-add9-10ade72df4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:09.539118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99560ce-1745-49bb-add9-10ade72df4f3 admin admin] PATH_INFO: `/v3/projects/f25a217bbfa94630b894737a3538ef4b` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:09.540252 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99560ce-1745-49bb-add9-10ade72df4f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f25a217bbfa94630b894737a3538ef4b)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:09.542229 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99560ce-1745-49bb-add9-10ade72df4f3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:09.566013 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e436e20a-6b8d-4cbe-bd46-d8b85e99e3a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f947d1c1c6924aa29d03ea4b7a99d660', 'request_id': 'req-e436e20a-6b8d-4cbe-bd46-d8b85e99e3a6'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.574151 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e436e20a-6b8d-4cbe-bd46-d8b85e99e3a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f947d1c1c6924aa29d03ea4b7a99d660', 'request_id': 'req-e436e20a-6b8d-4cbe-bd46-d8b85e99e3a6'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.586109 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e436e20a-6b8d-4cbe-bd46-d8b85e99e3a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f947d1c1c6924aa29d03ea4b7a99d660', 'request_id': 'req-e436e20a-6b8d-4cbe-bd46-d8b85e99e3a6'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.596022 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:09.601011 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e436e20a-6b8d-4cbe-bd46-d8b85e99e3a6 admin admin] The token cache is being invalidate because project f947d1c1c6924aa29d03ea4b7a99d660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:23:09.601593 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e436e20a-6b8d-4cbe-bd46-d8b85e99e3a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.603133 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-e436e20a-6b8d-4cbe-bd46-d8b85e99e3a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.604178 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b99560ce-1745-49bb-add9-10ade72df4f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f25a217bbfa94630b894737a3538ef4b', 'request_id': 'req-b99560ce-1745-49bb-add9-10ade72df4f3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.607089 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1360/2737] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:23:09 2022] DELETE /identity/v3/projects/f947d1c1c6924aa29d03ea4b7a99d660 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:09.610510 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffd88f-d086-4de1-b405-ed85361135eb None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:09.612483 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffd88f-d086-4de1-b405-ed85361135eb None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:09.612830 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffd88f-d086-4de1-b405-ed85361135eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:09.615444 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b99560ce-1745-49bb-add9-10ade72df4f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f25a217bbfa94630b894737a3538ef4b', 'request_id': 'req-b99560ce-1745-49bb-add9-10ade72df4f3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.622931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b99560ce-1745-49bb-add9-10ade72df4f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f25a217bbfa94630b894737a3538ef4b', 'request_id': 'req-b99560ce-1745-49bb-add9-10ade72df4f3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.635561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b99560ce-1745-49bb-add9-10ade72df4f3 admin admin] The token cache is being invalidate because project f25a217bbfa94630b894737a3538ef4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:23:09.636545 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b99560ce-1745-49bb-add9-10ade72df4f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.637351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b99560ce-1745-49bb-add9-10ade72df4f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.638908 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1378/2738] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:23:09 2022] DELETE /identity/v3/projects/f25a217bbfa94630b894737a3538ef4b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:23:09.642901 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-10ffd88f-d086-4de1-b405-ed85361135eb None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:09.643649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1189a9-975d-4de9-b8b7-51dbd5c8faa3 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:09.643952 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1189a9-975d-4de9-b8b7-51dbd5c8faa3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:09.644181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-10ffd88f-d086-4de1-b405-ed85361135eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:09.644301 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1189a9-975d-4de9-b8b7-51dbd5c8faa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:09.665719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5c1189a9-975d-4de9-b8b7-51dbd5c8faa3 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:09.666984 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5c1189a9-975d-4de9-b8b7-51dbd5c8faa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:09.677807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:09.716441 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1361/2739] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:09.717156 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffd88f-d086-4de1-b405-ed85361135eb None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:09.718430 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-10ffd88f-d086-4de1-b405-ed85361135eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:09.734540 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffd88f-d086-4de1-b405-ed85361135eb None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:09.739677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6429460-7bdf-4f7f-8194-d964bca69426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:09.740354 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6429460-7bdf-4f7f-8194-d964bca69426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:09.740649 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6429460-7bdf-4f7f-8194-d964bca69426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:09.741012 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6429460-7bdf-4f7f-8194-d964bca69426 admin admin] PATH_INFO: `/v3/projects/5c8e9241fbf34a4d8a817c77d0b8af7c` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:09.742458 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6429460-7bdf-4f7f-8194-d964bca69426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c8e9241fbf34a4d8a817c77d0b8af7c)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:09.745083 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6429460-7bdf-4f7f-8194-d964bca69426 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:09.745246 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1379/2740] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:23:09.749144 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189384c-7bf8-4a8d-9807-8acc9b501011 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:09.749432 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189384c-7bf8-4a8d-9807-8acc9b501011 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:09.749700 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189384c-7bf8-4a8d-9807-8acc9b501011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:09.775484 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c189384c-7bf8-4a8d-9807-8acc9b501011 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:09.777235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c189384c-7bf8-4a8d-9807-8acc9b501011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:09.786133 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1380/2741] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:09.787409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687b5f1-dd02-4530-ac12-45b178cad4fd None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:09.787687 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687b5f1-dd02-4530-ac12-45b178cad4fd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:09.787953 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687b5f1-dd02-4530-ac12-45b178cad4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:09.812216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5687b5f1-dd02-4530-ac12-45b178cad4fd None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:09.812525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c6429460-7bdf-4f7f-8194-d964bca69426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c8e9241fbf34a4d8a817c77d0b8af7c', 'request_id': 'req-c6429460-7bdf-4f7f-8194-d964bca69426'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.813366 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5687b5f1-dd02-4530-ac12-45b178cad4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:09.819283 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c6429460-7bdf-4f7f-8194-d964bca69426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c8e9241fbf34a4d8a817c77d0b8af7c', 'request_id': 'req-c6429460-7bdf-4f7f-8194-d964bca69426'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.828931 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c6429460-7bdf-4f7f-8194-d964bca69426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c8e9241fbf34a4d8a817c77d0b8af7c', 'request_id': 'req-c6429460-7bdf-4f7f-8194-d964bca69426'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.843876 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c6429460-7bdf-4f7f-8194-d964bca69426 admin admin] The token cache is being invalidate because project 5c8e9241fbf34a4d8a817c77d0b8af7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:23:09.844636 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c6429460-7bdf-4f7f-8194-d964bca69426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.845503 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c6429460-7bdf-4f7f-8194-d964bca69426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:09.847863 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1362/2742] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:23:09 2022] DELETE /identity/v3/projects/5c8e9241fbf34a4d8a817c77d0b8af7c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:09.848924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6429460-7bdf-4f7f-8194-d964bca69426 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:09.850577 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c6429460-7bdf-4f7f-8194-d964bca69426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:09.882019 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1381/2743] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:09.884223 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757cf56-a8be-4bf1-98e4-62df94ae9e31 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:09.884502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757cf56-a8be-4bf1-98e4-62df94ae9e31 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:09.884770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757cf56-a8be-4bf1-98e4-62df94ae9e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:09.905058 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b757cf56-a8be-4bf1-98e4-62df94ae9e31 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:09.906459 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b757cf56-a8be-4bf1-98e4-62df94ae9e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:09.915057 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1382/2744] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:09.923477 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757cf56-a8be-4bf1-98e4-62df94ae9e31 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:09.925645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6429460-7bdf-4f7f-8194-d964bca69426 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:09.926357 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757cf56-a8be-4bf1-98e4-62df94ae9e31 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:09.930408 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966e486-e5bf-4be8-9056-3a217d9619f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:09.931047 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966e486-e5bf-4be8-9056-3a217d9619f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:09.931183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43248e49-b65c-4c71-afa4-551fdeb76b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:09.931319 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966e486-e5bf-4be8-9056-3a217d9619f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:09.931590 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966e486-e5bf-4be8-9056-3a217d9619f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:09.931925 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43248e49-b65c-4c71-afa4-551fdeb76b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:09.932197 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43248e49-b65c-4c71-afa4-551fdeb76b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:09.932464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966e486-e5bf-4be8-9056-3a217d9619f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:23:09.933127 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43248e49-b65c-4c71-afa4-551fdeb76b9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:09.933420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966e486-e5bf-4be8-9056-3a217d9619f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:09.933685 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43248e49-b65c-4c71-afa4-551fdeb76b9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:23:09.933993 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43248e49-b65c-4c71-afa4-551fdeb76b9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:09.935095 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966e486-e5bf-4be8-9056-3a217d9619f2 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:09.935612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43248e49-b65c-4c71-afa4-551fdeb76b9c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:09.948882 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1383/2745] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:23:09.950216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f2df2-a1aa-4f1a-bca7-dbba5ab364cb None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:09.950504 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f2df2-a1aa-4f1a-bca7-dbba5ab364cb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:09.950816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f2df2-a1aa-4f1a-bca7-dbba5ab364cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:09.951452 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1363/2746] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:23:09.954288 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966e486-e5bf-4be8-9056-3a217d9619f2 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:09.966204 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966e486-e5bf-4be8-9056-3a217d9619f2 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:09.971033 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f8e54-e3b9-479d-9f90-568698bd4dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:09.971645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f8e54-e3b9-479d-9f90-568698bd4dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:09.971931 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f8e54-e3b9-479d-9f90-568698bd4dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:09.972198 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f8e54-e3b9-479d-9f90-568698bd4dd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:09.972827 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f8e54-e3b9-479d-9f90-568698bd4dd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:09.974296 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-316f2df2-a1aa-4f1a-bca7-dbba5ab364cb None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:09.974719 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f8e54-e3b9-479d-9f90-568698bd4dd8 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:09.975533 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-316f2df2-a1aa-4f1a-bca7-dbba5ab364cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:09.994431 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1384/2747] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:09.996091 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:09.997084 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f2df2-a1aa-4f1a-bca7-dbba5ab364cb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:10.008696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f2df2-a1aa-4f1a-bca7-dbba5ab364cb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:10.015292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1364/2748] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:23:09 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:23:10.015292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f8e54-e3b9-479d-9f90-568698bd4dd8 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:10.016372 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56942886-059d-4bb5-9a7d-0d279aab4359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:10.016988 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56942886-059d-4bb5-9a7d-0d279aab4359 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:10.017299 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56942886-059d-4bb5-9a7d-0d279aab4359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:10.017629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56942886-059d-4bb5-9a7d-0d279aab4359 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:10.018292 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56942886-059d-4bb5-9a7d-0d279aab4359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:10.020317 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56942886-059d-4bb5-9a7d-0d279aab4359 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:10.051055 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1385/2749] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:23:09 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:23:10.051055 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56942886-059d-4bb5-9a7d-0d279aab4359 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:10.076802 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f8e54-e3b9-479d-9f90-568698bd4dd8 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:10.110760 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56942886-059d-4bb5-9a7d-0d279aab4359 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:10.115588 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a14ca-5849-4d93-b7c9-155208b34f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:10.116197 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a14ca-5849-4d93-b7c9-155208b34f2a admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:10.116479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a14ca-5849-4d93-b7c9-155208b34f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:10.116807 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a14ca-5849-4d93-b7c9-155208b34f2a admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:10.117439 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a14ca-5849-4d93-b7c9-155208b34f2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:10.119383 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a14ca-5849-4d93-b7c9-155208b34f2a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:10.128927 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:10.133835 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bd7aa-3e36-44ff-945e-fbe7b26f0a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:10.134603 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bd7aa-3e36-44ff-945e-fbe7b26f0a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:10.134882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bd7aa-3e36-44ff-945e-fbe7b26f0a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:10.135185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bd7aa-3e36-44ff-945e-fbe7b26f0a5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:10.135986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bd7aa-3e36-44ff-945e-fbe7b26f0a5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:23:10.136401 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bd7aa-3e36-44ff-945e-fbe7b26f0a5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:10.138058 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bd7aa-3e36-44ff-945e-fbe7b26f0a5a admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:10.142976 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1386/2750] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:23:10 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:23:10.143872 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a14ca-5849-4d93-b7c9-155208b34f2a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:10.149875 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1365/2751] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:23:10.150675 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bd7aa-3e36-44ff-945e-fbe7b26f0a5a admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:10.157337 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a14ca-5849-4d93-b7c9-155208b34f2a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:10.160014 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bd7aa-3e36-44ff-945e-fbe7b26f0a5a admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:10.162135 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a9e24-3e73-4551-887d-44909166b489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:10.162730 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a9e24-3e73-4551-887d-44909166b489 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:10.163025 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a9e24-3e73-4551-887d-44909166b489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:10.163316 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a9e24-3e73-4551-887d-44909166b489 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:10.163931 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a9e24-3e73-4551-887d-44909166b489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:10.164485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5360b-63ca-4d0b-99d9-cce42a9b3505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:10.165061 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5360b-63ca-4d0b-99d9-cce42a9b3505 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:10.165334 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5360b-63ca-4d0b-99d9-cce42a9b3505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:10.165602 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5360b-63ca-4d0b-99d9-cce42a9b3505 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:10.165826 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a9e24-3e73-4551-887d-44909166b489 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:10.166256 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5360b-63ca-4d0b-99d9-cce42a9b3505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:10.168326 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5360b-63ca-4d0b-99d9-cce42a9b3505 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:10.178833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1366/2752] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:23:10.179845 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5360b-63ca-4d0b-99d9-cce42a9b3505 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:10.189819 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1387/2753] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:23:10 2022] POST /identity/v3/users => generated 288 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:23:10.191088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a9e24-3e73-4551-887d-44909166b489 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:10.191669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5360b-63ca-4d0b-99d9-cce42a9b3505 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:10.197317 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30370e62-8321-4b47-8da0-e45e10bb8ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:10.198008 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30370e62-8321-4b47-8da0-e45e10bb8ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:10.198869 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30370e62-8321-4b47-8da0-e45e10bb8ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:10.199182 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30370e62-8321-4b47-8da0-e45e10bb8ea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:10.200169 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30370e62-8321-4b47-8da0-e45e10bb8ea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:10.202019 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30370e62-8321-4b47-8da0-e45e10bb8ea7 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:10.203973 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a9e24-3e73-4551-887d-44909166b489 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:10.209034 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea78aa-c12c-40d9-9cf6-99c07751e194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:10.209832 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea78aa-c12c-40d9-9cf6-99c07751e194 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:10.210180 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea78aa-c12c-40d9-9cf6-99c07751e194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:10.210587 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea78aa-c12c-40d9-9cf6-99c07751e194 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:10.211336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea78aa-c12c-40d9-9cf6-99c07751e194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:10.213294 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea78aa-c12c-40d9-9cf6-99c07751e194 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:10.225371 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1388/2754] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:23:10.226329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea78aa-c12c-40d9-9cf6-99c07751e194 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:10.236218 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1367/2755] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:23:10 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:23:10.238068 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea78aa-c12c-40d9-9cf6-99c07751e194 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:10.240388 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30370e62-8321-4b47-8da0-e45e10bb8ea7 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:10.297799 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031f03f-e711-4fba-81b8-af8fb7cd15e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:10.298410 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031f03f-e711-4fba-81b8-af8fb7cd15e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:10.298688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031f03f-e711-4fba-81b8-af8fb7cd15e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:10.298965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031f03f-e711-4fba-81b8-af8fb7cd15e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:10.299754 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031f03f-e711-4fba-81b8-af8fb7cd15e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:10.301540 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031f03f-e711-4fba-81b8-af8fb7cd15e3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:10.311781 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30370e62-8321-4b47-8da0-e45e10bb8ea7 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:10.313650 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1389/2756] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:23:10.313844 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031f03f-e711-4fba-81b8-af8fb7cd15e3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:10.320662 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445d0db-26d0-4b62-a6c4-df263697dfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:10.321482 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445d0db-26d0-4b62-a6c4-df263697dfc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:10.321935 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445d0db-26d0-4b62-a6c4-df263697dfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:10.322428 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445d0db-26d0-4b62-a6c4-df263697dfc2 admin admin] PATH_INFO: `/v3/projects/573e811db7834cc18ba55d78645341dd/users/7d3de70704534a1abba8dd99a75e392f/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:10.325475 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031f03f-e711-4fba-81b8-af8fb7cd15e3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:10.331063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f5dbb-f2fb-498d-8ecc-140219954d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:10.331696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f5dbb-f2fb-498d-8ecc-140219954d23 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:10.332317 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f5dbb-f2fb-498d-8ecc-140219954d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:10.332661 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f5dbb-f2fb-498d-8ecc-140219954d23 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:10.333365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f5dbb-f2fb-498d-8ecc-140219954d23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:10.333552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:10.335618 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f5dbb-f2fb-498d-8ecc-140219954d23 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:10.343645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445d0db-26d0-4b62-a6c4-df263697dfc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=573e811db7834cc18ba55d78645341dd, user_id=7d3de70704534a1abba8dd99a75e392f, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:10.346613 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445d0db-26d0-4b62-a6c4-df263697dfc2 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:10.361267 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1368/2757] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:23:10 2022] PUT /identity/v3/projects/573e811db7834cc18ba55d78645341dd/users/7d3de70704534a1abba8dd99a75e392f/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:10.362302 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445d0db-26d0-4b62-a6c4-df263697dfc2 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:10.363295 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1390/2758] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:23:10 2022] POST /identity/v3/users => generated 289 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:23:10.367155 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f5dbb-f2fb-498d-8ecc-140219954d23 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:10.378089 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f5dbb-f2fb-498d-8ecc-140219954d23 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:10.453095 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371918fe-1bff-49ca-a719-605a745e950c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:10.453737 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371918fe-1bff-49ca-a719-605a745e950c admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:10.454016 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371918fe-1bff-49ca-a719-605a745e950c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:10.454280 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371918fe-1bff-49ca-a719-605a745e950c admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:10.455039 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371918fe-1bff-49ca-a719-605a745e950c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:10.456539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371918fe-1bff-49ca-a719-605a745e950c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:10.459485 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445d0db-26d0-4b62-a6c4-df263697dfc2 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:10.465776 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b014346-b984-4dde-9381-09098f6dd64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:10.466466 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b014346-b984-4dde-9381-09098f6dd64d admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:10.466741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b014346-b984-4dde-9381-09098f6dd64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:10.467023 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b014346-b984-4dde-9381-09098f6dd64d admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:10.467604 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1391/2759] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:23:10.467791 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b014346-b984-4dde-9381-09098f6dd64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:10.468675 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498e09d-45f4-425b-9c40-3fb4abfc0a2b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:10.468965 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498e09d-45f4-425b-9c40-3fb4abfc0a2b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:10.469246 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498e09d-45f4-425b-9c40-3fb4abfc0a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:10.469428 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b014346-b984-4dde-9381-09098f6dd64d admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:10.482903 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1369/2760] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:23:10.482903 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b014346-b984-4dde-9381-09098f6dd64d admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:10.490799 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b014346-b984-4dde-9381-09098f6dd64d admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:10.496487 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5986624-cbf5-4e07-86d2-537ceec56183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:10.497098 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5986624-cbf5-4e07-86d2-537ceec56183 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:10.497381 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5986624-cbf5-4e07-86d2-537ceec56183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:10.497664 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5986624-cbf5-4e07-86d2-537ceec56183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:10.498327 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5986624-cbf5-4e07-86d2-537ceec56183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:10.499970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5986624-cbf5-4e07-86d2-537ceec56183 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:10.501972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8498e09d-45f4-425b-9c40-3fb4abfc0a2b None None] MFA Rules not processed for user `7d3de70704534a1abba8dd99a75e392f`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:10.503261 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8498e09d-45f4-425b-9c40-3fb4abfc0a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:10.510632 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1370/2761] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:23:10.512170 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5986624-cbf5-4e07-86d2-537ceec56183 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:10.524851 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5986624-cbf5-4e07-86d2-537ceec56183 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:10.531113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351d014-ccac-4516-8d58-4762ac17879d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:10.531896 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351d014-ccac-4516-8d58-4762ac17879d admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:10.532288 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351d014-ccac-4516-8d58-4762ac17879d admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:10.532672 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351d014-ccac-4516-8d58-4762ac17879d admin admin] PATH_INFO: `/v3/projects/63a0bb070fd44eb59d2f10352d41d53b/users/4e52a9f8754b4734a60a8c7a1dd7f152/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:10.535419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:10.553525 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351d014-ccac-4516-8d58-4762ac17879d admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a0bb070fd44eb59d2f10352d41d53b, user_id=4e52a9f8754b4734a60a8c7a1dd7f152, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:10.556212 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351d014-ccac-4516-8d58-4762ac17879d admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:10.569351 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1371/2762] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:23:10 2022] PUT /identity/v3/projects/63a0bb070fd44eb59d2f10352d41d53b/users/4e52a9f8754b4734a60a8c7a1dd7f152/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:10.570140 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351d014-ccac-4516-8d58-4762ac17879d admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:10.576157 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1392/2763] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:10.580484 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db10219-9579-486f-9d2b-4b0f447385db None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:10.580773 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db10219-9579-486f-9d2b-4b0f447385db None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:10.581046 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db10219-9579-486f-9d2b-4b0f447385db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:10.608190 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9db10219-9579-486f-9d2b-4b0f447385db None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:10.608541 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9db10219-9579-486f-9d2b-4b0f447385db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:10.648486 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351d014-ccac-4516-8d58-4762ac17879d admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:10.654397 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e5e73-8d1f-45f0-a1a7-4b047e6b9744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:10.655076 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e5e73-8d1f-45f0-a1a7-4b047e6b9744 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:10.655348 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e5e73-8d1f-45f0-a1a7-4b047e6b9744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:10.655612 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e5e73-8d1f-45f0-a1a7-4b047e6b9744 admin admin] PATH_INFO: `/v3/projects/1a7aa1d327ea44ea99ed3e9efd4a61a2/users/0241d503ecb342e48c98f7686f903ed0/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:10.671525 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1393/2764] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Aug 10 13:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:10.672778 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05521dd8-b9cb-4008-9e5d-5eb9134d44de None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:10.672919 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e5e73-8d1f-45f0-a1a7-4b047e6b9744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a7aa1d327ea44ea99ed3e9efd4a61a2, user_id=0241d503ecb342e48c98f7686f903ed0, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:10.673072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05521dd8-b9cb-4008-9e5d-5eb9134d44de None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:10.673427 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05521dd8-b9cb-4008-9e5d-5eb9134d44de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:10.675683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e5e73-8d1f-45f0-a1a7-4b047e6b9744 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:10.691887 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1372/2765] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:23:10 2022] PUT /identity/v3/projects/1a7aa1d327ea44ea99ed3e9efd4a61a2/users/0241d503ecb342e48c98f7686f903ed0/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:10.692723 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e5e73-8d1f-45f0-a1a7-4b047e6b9744 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:10.694341 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-200e5e73-8d1f-45f0-a1a7-4b047e6b9744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:10.711130 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-05521dd8-b9cb-4008-9e5d-5eb9134d44de None None] MFA Rules not processed for user `4e52a9f8754b4734a60a8c7a1dd7f152`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:10.712448 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-05521dd8-b9cb-4008-9e5d-5eb9134d44de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:10.729543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:10.756683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e5e73-8d1f-45f0-a1a7-4b047e6b9744 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:10.761427 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc992c-15d9-4eea-b3c6-6a2c528daec2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5979be13ad31421b886069faf0dcc915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:10.762135 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc992c-15d9-4eea-b3c6-6a2c528daec2 service glance] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:10.762436 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc992c-15d9-4eea-b3c6-6a2c528daec2 service glance] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:10.762762 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc992c-15d9-4eea-b3c6-6a2c528daec2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:10.783485 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1394/2766] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:10.784152 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05521dd8-b9cb-4008-9e5d-5eb9134d44de None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:10.785448 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-05521dd8-b9cb-4008-9e5d-5eb9134d44de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:10.828775 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc992c-15d9-4eea-b3c6-6a2c528daec2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:10.830220 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc992c-15d9-4eea-b3c6-6a2c528daec2 service glance] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:10.840035 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1373/2767] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:23:10.841275 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e70089-e323-4d03-8895-c06c51ccaba2 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:10.841555 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e70089-e323-4d03-8895-c06c51ccaba2 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:10.841851 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e70089-e323-4d03-8895-c06c51ccaba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:10.847511 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:10.872216 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05521dd8-b9cb-4008-9e5d-5eb9134d44de None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:10.876930 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-e7e70089-e323-4d03-8895-c06c51ccaba2 None None] MFA Rules not processed for user `0241d503ecb342e48c98f7686f903ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:10.878509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4dfc84-4bc3-4598-8280-ee320dc4dab0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:10.878682 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-e7e70089-e323-4d03-8895-c06c51ccaba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:10.879179 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dfc84-4bc3-4598-8280-ee320dc4dab0 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:10.879544 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dfc84-4bc3-4598-8280-ee320dc4dab0 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:10.880503 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dfc84-4bc3-4598-8280-ee320dc4dab0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:10.954495 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1374/2768] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:10.955681 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e70089-e323-4d03-8895-c06c51ccaba2 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:10.957475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-e7e70089-e323-4d03-8895-c06c51ccaba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:10.962358 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4dfc84-4bc3-4598-8280-ee320dc4dab0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:10.964478 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4dfc84-4bc3-4598-8280-ee320dc4dab0 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:10.974934 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1395/2769] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:23:10.975853 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4dfc84-4bc3-4598-8280-ee320dc4dab0 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:10.990059 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4dfc84-4bc3-4598-8280-ee320dc4dab0 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:10.999110 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d1a00-2326-4499-8b10-7f03f043a6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:10.999963 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d1a00-2326-4499-8b10-7f03f043a6c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:11.000413 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d1a00-2326-4499-8b10-7f03f043a6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:11.000777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d1a00-2326-4499-8b10-7f03f043a6c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:11.001534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d1a00-2326-4499-8b10-7f03f043a6c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:11.004151 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d1a00-2326-4499-8b10-7f03f043a6c7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:11.038394 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1396/2770] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:23:10 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:23:11.042860 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d1a00-2326-4499-8b10-7f03f043a6c7 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:11.048847 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e70089-e323-4d03-8895-c06c51ccaba2 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:11.090162 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:11.118889 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4af703-ee60-45a9-b42a-b1548720caa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:11.119834 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4af703-ee60-45a9-b42a-b1548720caa1 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:11.120138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4af703-ee60-45a9-b42a-b1548720caa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:11.120412 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4af703-ee60-45a9-b42a-b1548720caa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:11.142719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d1a00-2326-4499-8b10-7f03f043a6c7 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:11.149139 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfac50c-183a-4925-b179-6c3a05defdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:11.149741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfac50c-183a-4925-b179-6c3a05defdfc admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:11.150021 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfac50c-183a-4925-b179-6c3a05defdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:11.150294 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfac50c-183a-4925-b179-6c3a05defdfc admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:11.150916 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfac50c-183a-4925-b179-6c3a05defdfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:11.153909 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfac50c-183a-4925-b179-6c3a05defdfc admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:11.179132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1397/2771] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:23:11 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:23:11.183777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfac50c-183a-4925-b179-6c3a05defdfc admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:11.196630 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfac50c-183a-4925-b179-6c3a05defdfc admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:11.197420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4af703-ee60-45a9-b42a-b1548720caa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:11.199986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4af703-ee60-45a9-b42a-b1548720caa1 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:11.202956 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18241443-a3ec-4bcd-9377-4c618d210d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:11.203733 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18241443-a3ec-4bcd-9377-4c618d210d8b admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:11.204021 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18241443-a3ec-4bcd-9377-4c618d210d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:11.204483 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18241443-a3ec-4bcd-9377-4c618d210d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:11.205160 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18241443-a3ec-4bcd-9377-4c618d210d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:11.207236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18241443-a3ec-4bcd-9377-4c618d210d8b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:11.214074 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1375/2772] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:23:11.219730 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1398/2773] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:23:11.224277 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4af703-ee60-45a9-b42a-b1548720caa1 service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:11.239077 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4af703-ee60-45a9-b42a-b1548720caa1 service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:11.243815 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdfa75-a25c-43ea-b326-a7979facceb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:11.244423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdfa75-a25c-43ea-b326-a7979facceb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:11.244758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdfa75-a25c-43ea-b326-a7979facceb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:11.245558 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdfa75-a25c-43ea-b326-a7979facceb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:11.246205 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdfa75-a25c-43ea-b326-a7979facceb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:11.248224 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdfa75-a25c-43ea-b326-a7979facceb7 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:11.259679 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1376/2774] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:23:11.264602 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18241443-a3ec-4bcd-9377-4c618d210d8b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:11.280146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18241443-a3ec-4bcd-9377-4c618d210d8b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:11.287034 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf79b6e-dbf8-4594-a61c-9d7b04301640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:11.287552 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf79b6e-dbf8-4594-a61c-9d7b04301640 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:11.288028 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf79b6e-dbf8-4594-a61c-9d7b04301640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:11.288211 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf79b6e-dbf8-4594-a61c-9d7b04301640 admin admin] PATH_INFO: `/v3/projects/47eb7a2ee127465fa7e1fad8387d5c5e/users/d0ad3601b43d4304b2831045daaf8597/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:11.308207 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf79b6e-dbf8-4594-a61c-9d7b04301640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47eb7a2ee127465fa7e1fad8387d5c5e, user_id=d0ad3601b43d4304b2831045daaf8597, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:11.312236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf79b6e-dbf8-4594-a61c-9d7b04301640 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:11.352475 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1399/2775] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:23:11 2022] PUT /identity/v3/projects/47eb7a2ee127465fa7e1fad8387d5c5e/users/d0ad3601b43d4304b2831045daaf8597/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:11.356001 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296fc04-8273-4ec5-b3ce-354526750056 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:11.356539 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296fc04-8273-4ec5-b3ce-354526750056 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:11.357018 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296fc04-8273-4ec5-b3ce-354526750056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:11.405422 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-4296fc04-8273-4ec5-b3ce-354526750056 None None] MFA Rules not processed for user `d0ad3601b43d4304b2831045daaf8597`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:11.406870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-4296fc04-8273-4ec5-b3ce-354526750056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:11.494591 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1377/2776] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:11.499688 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf79b6e-dbf8-4594-a61c-9d7b04301640 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:11.536238 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:11.583728 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf79b6e-dbf8-4594-a61c-9d7b04301640 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:11.594582 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7a5b2-e468-4940-9575-d26a1f6495af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:11.595360 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7a5b2-e468-4940-9575-d26a1f6495af admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:11.595645 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7a5b2-e468-4940-9575-d26a1f6495af admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:11.595920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7a5b2-e468-4940-9575-d26a1f6495af admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:11.596548 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7a5b2-e468-4940-9575-d26a1f6495af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:11.598467 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7a5b2-e468-4940-9575-d26a1f6495af admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:11.630226 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1400/2777] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:23:11 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:23:11.634414 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296fc04-8273-4ec5-b3ce-354526750056 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:11.646833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296fc04-8273-4ec5-b3ce-354526750056 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:11.703668 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1b81b-6999-4846-842e-682209449e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:11.704266 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1b81b-6999-4846-842e-682209449e7c admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:11.704543 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1b81b-6999-4846-842e-682209449e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:11.704812 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1b81b-6999-4846-842e-682209449e7c admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:11.705423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1b81b-6999-4846-842e-682209449e7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:11.707663 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1b81b-6999-4846-842e-682209449e7c admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:11.717993 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:11.730366 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1378/2778] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:23:11 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:23:11.734411 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7a5b2-e468-4940-9575-d26a1f6495af admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:11.744508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7a5b2-e468-4940-9575-d26a1f6495af admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:11.749765 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ce79a-6ee5-4553-87af-19fa6b8b38af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:11.750355 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ce79a-6ee5-4553-87af-19fa6b8b38af admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:11.750657 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ce79a-6ee5-4553-87af-19fa6b8b38af admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:11.750927 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ce79a-6ee5-4553-87af-19fa6b8b38af admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:11.751591 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ce79a-6ee5-4553-87af-19fa6b8b38af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:11.753170 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ce79a-6ee5-4553-87af-19fa6b8b38af admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:11.769358 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1401/2779] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:23:11.772867 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1b81b-6999-4846-842e-682209449e7c admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:11.784923 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1b81b-6999-4846-842e-682209449e7c admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:11.789560 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484426a-61d8-4f9b-ba77-0bf5eb2fc767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:11.790202 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484426a-61d8-4f9b-ba77-0bf5eb2fc767 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:11.790477 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484426a-61d8-4f9b-ba77-0bf5eb2fc767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:11.790743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484426a-61d8-4f9b-ba77-0bf5eb2fc767 admin admin] PATH_INFO: `/v3/projects/d7c6132789424b7a94bd2fbe033b54c3/users/10b1d84450d948ccaf219908093fd9c9/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:11.808066 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484426a-61d8-4f9b-ba77-0bf5eb2fc767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c6132789424b7a94bd2fbe033b54c3, user_id=10b1d84450d948ccaf219908093fd9c9, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:11.810900 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484426a-61d8-4f9b-ba77-0bf5eb2fc767 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:11.823335 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1379/2780] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:23:11 2022] PUT /identity/v3/projects/d7c6132789424b7a94bd2fbe033b54c3/users/10b1d84450d948ccaf219908093fd9c9/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:11.827421 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ce79a-6ee5-4553-87af-19fa6b8b38af admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:11.837970 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ce79a-6ee5-4553-87af-19fa6b8b38af admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:11.897900 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84427a61-d8fd-42d4-b4b7-d87ca2c19e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:11.898519 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84427a61-d8fd-42d4-b4b7-d87ca2c19e77 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:11.898801 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84427a61-d8fd-42d4-b4b7-d87ca2c19e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:11.899101 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84427a61-d8fd-42d4-b4b7-d87ca2c19e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:11.899756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84427a61-d8fd-42d4-b4b7-d87ca2c19e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:11.901927 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84427a61-d8fd-42d4-b4b7-d87ca2c19e77 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:11.912389 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1402/2781] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:23:11.916741 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484426a-61d8-4f9b-ba77-0bf5eb2fc767 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:11.928681 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484426a-61d8-4f9b-ba77-0bf5eb2fc767 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:11.933677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582ce9b-88e3-47a0-8132-8c0ff88b55e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:11.934330 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582ce9b-88e3-47a0-8132-8c0ff88b55e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:11.934601 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582ce9b-88e3-47a0-8132-8c0ff88b55e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:11.934897 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582ce9b-88e3-47a0-8132-8c0ff88b55e0 admin admin] PATH_INFO: `/v3/projects/d7c6132789424b7a94bd2fbe033b54c3/users/10b1d84450d948ccaf219908093fd9c9/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:11.936800 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582ce9b-88e3-47a0-8132-8c0ff88b55e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c6132789424b7a94bd2fbe033b54c3, user_id=10b1d84450d948ccaf219908093fd9c9, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:11.939521 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582ce9b-88e3-47a0-8132-8c0ff88b55e0 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:11.949855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1380/2782] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:23:11 2022] PUT /identity/v3/projects/d7c6132789424b7a94bd2fbe033b54c3/users/10b1d84450d948ccaf219908093fd9c9/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:11.960826 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df5c93-1994-4794-b28b-32daa963699a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:11.961116 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df5c93-1994-4794-b28b-32daa963699a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:11.961393 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df5c93-1994-4794-b28b-32daa963699a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:11.992445 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-61df5c93-1994-4794-b28b-32daa963699a None None] MFA Rules not processed for user `10b1d84450d948ccaf219908093fd9c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:11.993645 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-61df5c93-1994-4794-b28b-32daa963699a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:12.064220 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1403/2783] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:12.077059 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582ce9b-88e3-47a0-8132-8c0ff88b55e0 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:12.132532 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582ce9b-88e3-47a0-8132-8c0ff88b55e0 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:12.136641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea8060-7b13-484d-8411-c959e04927b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:12.137244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea8060-7b13-484d-8411-c959e04927b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:12.137517 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea8060-7b13-484d-8411-c959e04927b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:12.137780 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea8060-7b13-484d-8411-c959e04927b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:12.195115 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea8060-7b13-484d-8411-c959e04927b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:12.196524 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea8060-7b13-484d-8411-c959e04927b1 service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:12.205437 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1381/2784] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:23:13.651857 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803e794-dbf1-45c6-bb17-2227a7a3f483 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:13.652375 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803e794-dbf1-45c6-bb17-2227a7a3f483 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:13.652568 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803e794-dbf1-45c6-bb17-2227a7a3f483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:13.672877 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a803e794-dbf1-45c6-bb17-2227a7a3f483 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:13.674170 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a803e794-dbf1-45c6-bb17-2227a7a3f483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:13.688083 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:13.751242 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1404/2785] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Aug 10 13:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:13.753641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea8060-7b13-484d-8411-c959e04927b1 service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:13.764335 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea8060-7b13-484d-8411-c959e04927b1 service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:13.768437 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb31fd-dcf9-456c-8c6c-804e08d7c49d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:13.769196 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb31fd-dcf9-456c-8c6c-804e08d7c49d service cinder] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:13.769618 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb31fd-dcf9-456c-8c6c-804e08d7c49d service cinder] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:13.769958 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb31fd-dcf9-456c-8c6c-804e08d7c49d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:13.774224 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803e794-dbf1-45c6-bb17-2227a7a3f483 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:13.775756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a803e794-dbf1-45c6-bb17-2227a7a3f483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:13.837857 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb31fd-dcf9-456c-8c6c-804e08d7c49d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:13.839973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb31fd-dcf9-456c-8c6c-804e08d7c49d service cinder] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:13.849566 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1382/2786] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:23:13.852605 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803e794-dbf1-45c6-bb17-2227a7a3f483 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:13.858619 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0728a00-ffc9-4ad3-a47c-786cab01ae90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:13.859468 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0728a00-ffc9-4ad3-a47c-786cab01ae90 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:13.859818 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0728a00-ffc9-4ad3-a47c-786cab01ae90 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:13.860180 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0728a00-ffc9-4ad3-a47c-786cab01ae90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:13.868952 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0728a00-ffc9-4ad3-a47c-786cab01ae90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:13.870654 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0728a00-ffc9-4ad3-a47c-786cab01ae90 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:13.880363 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1405/2787] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:23:14.344430 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb31fd-dcf9-456c-8c6c-804e08d7c49d service cinder] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:14.355418 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb31fd-dcf9-456c-8c6c-804e08d7c49d service cinder] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:14.360403 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c59c67-b940-49c5-87bb-f04f55c9caac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:14.361692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c59c67-b940-49c5-87bb-f04f55c9caac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:14.361976 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c59c67-b940-49c5-87bb-f04f55c9caac admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:14.362320 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c59c67-b940-49c5-87bb-f04f55c9caac admin admin] PATH_INFO: `/v3/users/4e52a9f8754b4734a60a8c7a1dd7f152` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:14.363726 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c59c67-b940-49c5-87bb-f04f55c9caac admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e52a9f8754b4734a60a8c7a1dd7f152)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:14.366094 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c59c67-b940-49c5-87bb-f04f55c9caac admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:14.368811 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:14.419924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-63c59c67-b940-49c5-87bb-f04f55c9caac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e52a9f8754b4734a60a8c7a1dd7f152'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:14.420577 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-63c59c67-b940-49c5-87bb-f04f55c9caac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e52a9f8754b4734a60a8c7a1dd7f152'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:14.422716 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0728a00-ffc9-4ad3-a47c-786cab01ae90 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:14.428731 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-63c59c67-b940-49c5-87bb-f04f55c9caac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e52a9f8754b4734a60a8c7a1dd7f152'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:14.428949 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b0728a00-ffc9-4ad3-a47c-786cab01ae90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:14.437314 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-63c59c67-b940-49c5-87bb-f04f55c9caac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e52a9f8754b4734a60a8c7a1dd7f152'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:14.442361 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0728a00-ffc9-4ad3-a47c-786cab01ae90 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:14.446628 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ecaee-5fb9-4eaf-a1b9-0ed5f845da12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:14.447257 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ecaee-5fb9-4eaf-a1b9-0ed5f845da12 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:14.447538 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ecaee-5fb9-4eaf-a1b9-0ed5f845da12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:14.447811 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ecaee-5fb9-4eaf-a1b9-0ed5f845da12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:14.449634 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fb8ecaee-5fb9-4eaf-a1b9-0ed5f845da12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:14.450356 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-63c59c67-b940-49c5-87bb-f04f55c9caac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e52a9f8754b4734a60a8c7a1dd7f152'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:14.456339 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1383/2788] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:23:14 2022] DELETE /identity/v3/users/4e52a9f8754b4734a60a8c7a1dd7f152 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:14.461346 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a541322-11fe-4903-92d5-0c4bcda32e09 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:14.461633 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a541322-11fe-4903-92d5-0c4bcda32e09 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:14.461909 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a541322-11fe-4903-92d5-0c4bcda32e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:14.462935 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ecaee-5fb9-4eaf-a1b9-0ed5f845da12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:14.464451 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ecaee-5fb9-4eaf-a1b9-0ed5f845da12 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:14.475133 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1406/2789] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:23:14.483990 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-4a541322-11fe-4903-92d5-0c4bcda32e09 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:14.485211 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-4a541322-11fe-4903-92d5-0c4bcda32e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:14.560946 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1384/2790] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:14.568453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ecaee-5fb9-4eaf-a1b9-0ed5f845da12 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:14.573732 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fb8ecaee-5fb9-4eaf-a1b9-0ed5f845da12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:14.640050 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ecaee-5fb9-4eaf-a1b9-0ed5f845da12 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:14.684905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:14.691312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a0401-90f0-42fb-87e9-0d6d7c3c3722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:14.691922 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a0401-90f0-42fb-87e9-0d6d7c3c3722 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:14.692198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a0401-90f0-42fb-87e9-0d6d7c3c3722 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:14.692469 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a0401-90f0-42fb-87e9-0d6d7c3c3722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:14.702099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a0401-90f0-42fb-87e9-0d6d7c3c3722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:14.703836 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a0401-90f0-42fb-87e9-0d6d7c3c3722 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:14.714649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1407/2791] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:23:14.996709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a541322-11fe-4903-92d5-0c4bcda32e09 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:14.998239 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-4a541322-11fe-4903-92d5-0c4bcda32e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:15.010731 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a541322-11fe-4903-92d5-0c4bcda32e09 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:15.016103 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283db15-8f5f-483e-be74-0f5e13790ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:15.016848 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283db15-8f5f-483e-be74-0f5e13790ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:15.017125 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283db15-8f5f-483e-be74-0f5e13790ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:15.017399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283db15-8f5f-483e-be74-0f5e13790ded admin admin] PATH_INFO: `/v3/projects/63a0bb070fd44eb59d2f10352d41d53b` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:15.018568 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283db15-8f5f-483e-be74-0f5e13790ded admin admin] RBAC: Authorizing `identity:delete_project(project_id=63a0bb070fd44eb59d2f10352d41d53b)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:15.020531 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283db15-8f5f-483e-be74-0f5e13790ded admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:15.074197 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-1283db15-8f5f-483e-be74-0f5e13790ded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a0bb070fd44eb59d2f10352d41d53b', 'request_id': 'req-1283db15-8f5f-483e-be74-0f5e13790ded'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:15.079685 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-1283db15-8f5f-483e-be74-0f5e13790ded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a0bb070fd44eb59d2f10352d41d53b', 'request_id': 'req-1283db15-8f5f-483e-be74-0f5e13790ded'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:15.087390 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-1283db15-8f5f-483e-be74-0f5e13790ded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a0bb070fd44eb59d2f10352d41d53b', 'request_id': 'req-1283db15-8f5f-483e-be74-0f5e13790ded'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:15.098795 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-1283db15-8f5f-483e-be74-0f5e13790ded admin admin] The token cache is being invalidate because project 63a0bb070fd44eb59d2f10352d41d53b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:23:15.099117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-1283db15-8f5f-483e-be74-0f5e13790ded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:15.099773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-1283db15-8f5f-483e-be74-0f5e13790ded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:15.101243 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1385/2792] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:23:14 2022] DELETE /identity/v3/projects/63a0bb070fd44eb59d2f10352d41d53b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:16.813148 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde44c33-032b-4e29-a8a2-f9ad0a8476bb None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:16.813721 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde44c33-032b-4e29-a8a2-f9ad0a8476bb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:16.813721 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde44c33-032b-4e29-a8a2-f9ad0a8476bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:16.834801 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-bde44c33-032b-4e29-a8a2-f9ad0a8476bb None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:16.836048 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bde44c33-032b-4e29-a8a2-f9ad0a8476bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:16.896976 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1408/2793] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Aug 10 13:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:16.925235 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283db15-8f5f-483e-be74-0f5e13790ded admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:16.927066 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-1283db15-8f5f-483e-be74-0f5e13790ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:16.933712 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:17.020343 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283db15-8f5f-483e-be74-0f5e13790ded admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:17.020343 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e475f52-edfa-45a0-b808-68da07b6b101 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:17.020343 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e475f52-edfa-45a0-b808-68da07b6b101 service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:17.020692 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e475f52-edfa-45a0-b808-68da07b6b101 service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:17.020934 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e475f52-edfa-45a0-b808-68da07b6b101 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:17.036004 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e475f52-edfa-45a0-b808-68da07b6b101 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:17.037638 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e475f52-edfa-45a0-b808-68da07b6b101 service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:17.048912 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1386/2794] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:23:18.402059 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde44c33-032b-4e29-a8a2-f9ad0a8476bb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:18.403520 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bde44c33-032b-4e29-a8a2-f9ad0a8476bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:18.415297 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde44c33-032b-4e29-a8a2-f9ad0a8476bb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:18.420817 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ecf62-ad5d-455a-94e8-b5111dfae00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:18.421434 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ecf62-ad5d-455a-94e8-b5111dfae00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:18.421711 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ecf62-ad5d-455a-94e8-b5111dfae00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:18.421978 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ecf62-ad5d-455a-94e8-b5111dfae00c admin admin] PATH_INFO: `/v3/users/0241d503ecb342e48c98f7686f903ed0` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:18.423117 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ecf62-ad5d-455a-94e8-b5111dfae00c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0241d503ecb342e48c98f7686f903ed0)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:18.425127 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ecf62-ad5d-455a-94e8-b5111dfae00c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:18.478756 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-298ecf62-ad5d-455a-94e8-b5111dfae00c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0241d503ecb342e48c98f7686f903ed0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:18.479959 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-298ecf62-ad5d-455a-94e8-b5111dfae00c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0241d503ecb342e48c98f7686f903ed0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:18.486770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-298ecf62-ad5d-455a-94e8-b5111dfae00c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0241d503ecb342e48c98f7686f903ed0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:18.494146 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-298ecf62-ad5d-455a-94e8-b5111dfae00c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0241d503ecb342e48c98f7686f903ed0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:18.507203 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-298ecf62-ad5d-455a-94e8-b5111dfae00c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0241d503ecb342e48c98f7686f903ed0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:18.517480 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1409/2795] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:23:18 2022] DELETE /identity/v3/users/0241d503ecb342e48c98f7686f903ed0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:18.519545 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea0733-5270-4005-bc41-a2a99d9f8a03 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:18.520007 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea0733-5270-4005-bc41-a2a99d9f8a03 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:18.520181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea0733-5270-4005-bc41-a2a99d9f8a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:18.540819 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-31ea0733-5270-4005-bc41-a2a99d9f8a03 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:18.542750 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-31ea0733-5270-4005-bc41-a2a99d9f8a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:18.601401 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1387/2796] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:18.611649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ecf62-ad5d-455a-94e8-b5111dfae00c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:18.613112 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-298ecf62-ad5d-455a-94e8-b5111dfae00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:18.675642 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ecf62-ad5d-455a-94e8-b5111dfae00c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:18.679408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a8142-f1d2-40e1-ae80-cabc334563ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:18.680048 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a8142-f1d2-40e1-ae80-cabc334563ec service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:18.680328 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a8142-f1d2-40e1-ae80-cabc334563ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:18.680600 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a8142-f1d2-40e1-ae80-cabc334563ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:18.690076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a8142-f1d2-40e1-ae80-cabc334563ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:18.691558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a8142-f1d2-40e1-ae80-cabc334563ec service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:18.702553 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1410/2797] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:23:18.987547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea0733-5270-4005-bc41-a2a99d9f8a03 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:18.989149 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-31ea0733-5270-4005-bc41-a2a99d9f8a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:19.009958 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea0733-5270-4005-bc41-a2a99d9f8a03 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:19.015504 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ea738-3052-4b31-bc0f-afd8b446c18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:19.016369 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ea738-3052-4b31-bc0f-afd8b446c18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:19.016654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ea738-3052-4b31-bc0f-afd8b446c18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:19.016927 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ea738-3052-4b31-bc0f-afd8b446c18c admin admin] PATH_INFO: `/v3/projects/1a7aa1d327ea44ea99ed3e9efd4a61a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:19.018141 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ea738-3052-4b31-bc0f-afd8b446c18c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a7aa1d327ea44ea99ed3e9efd4a61a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:19.020010 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ea738-3052-4b31-bc0f-afd8b446c18c admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:19.070747 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a80ea738-3052-4b31-bc0f-afd8b446c18c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a7aa1d327ea44ea99ed3e9efd4a61a2', 'request_id': 'req-a80ea738-3052-4b31-bc0f-afd8b446c18c'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:19.077253 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a80ea738-3052-4b31-bc0f-afd8b446c18c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a7aa1d327ea44ea99ed3e9efd4a61a2', 'request_id': 'req-a80ea738-3052-4b31-bc0f-afd8b446c18c'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:19.085090 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a80ea738-3052-4b31-bc0f-afd8b446c18c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a7aa1d327ea44ea99ed3e9efd4a61a2', 'request_id': 'req-a80ea738-3052-4b31-bc0f-afd8b446c18c'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:19.096683 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a80ea738-3052-4b31-bc0f-afd8b446c18c admin admin] The token cache is being invalidate because project 1a7aa1d327ea44ea99ed3e9efd4a61a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:23:19.096971 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a80ea738-3052-4b31-bc0f-afd8b446c18c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:19.097605 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-a80ea738-3052-4b31-bc0f-afd8b446c18c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:19.099101 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1388/2798] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:23:18 2022] DELETE /identity/v3/projects/1a7aa1d327ea44ea99ed3e9efd4a61a2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:19.103193 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a8142-f1d2-40e1-ae80-cabc334563ec service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:19.109375 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:19.113296 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a8142-f1d2-40e1-ae80-cabc334563ec service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:19.171154 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d369c0-4608-4691-bf64-062a1591a3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:19.171789 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d369c0-4608-4691-bf64-062a1591a3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:19.172065 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d369c0-4608-4691-bf64-062a1591a3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:19.172338 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d369c0-4608-4691-bf64-062a1591a3b7 admin admin] PATH_INFO: `/v3/users/d0ad3601b43d4304b2831045daaf8597` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:19.173455 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d369c0-4608-4691-bf64-062a1591a3b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ad3601b43d4304b2831045daaf8597)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:19.175441 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d369c0-4608-4691-bf64-062a1591a3b7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:19.221742 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-06d369c0-4608-4691-bf64-062a1591a3b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ad3601b43d4304b2831045daaf8597'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:19.222377 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-06d369c0-4608-4691-bf64-062a1591a3b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ad3601b43d4304b2831045daaf8597'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:19.229481 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-06d369c0-4608-4691-bf64-062a1591a3b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ad3601b43d4304b2831045daaf8597'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:19.236954 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-06d369c0-4608-4691-bf64-062a1591a3b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ad3601b43d4304b2831045daaf8597'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:19.248937 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-06d369c0-4608-4691-bf64-062a1591a3b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ad3601b43d4304b2831045daaf8597'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:19.254825 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1411/2799] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:23:19 2022] DELETE /identity/v3/users/d0ad3601b43d4304b2831045daaf8597 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:19.536003 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ea738-3052-4b31-bc0f-afd8b446c18c admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:19.538986 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-a80ea738-3052-4b31-bc0f-afd8b446c18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:19.555217 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ea738-3052-4b31-bc0f-afd8b446c18c admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:19.568736 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:19.621181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c15f49-d904-4d15-a53d-6685d3bfe24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:19.621736 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c15f49-d904-4d15-a53d-6685d3bfe24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:19.622096 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c15f49-d904-4d15-a53d-6685d3bfe24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:19.622448 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c15f49-d904-4d15-a53d-6685d3bfe24e admin admin] PATH_INFO: `/v3/projects/47eb7a2ee127465fa7e1fad8387d5c5e` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:19.623632 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c15f49-d904-4d15-a53d-6685d3bfe24e admin admin] RBAC: Authorizing `identity:delete_project(project_id=47eb7a2ee127465fa7e1fad8387d5c5e)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:19.625576 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c15f49-d904-4d15-a53d-6685d3bfe24e admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:19.675428 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c6c15f49-d904-4d15-a53d-6685d3bfe24e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47eb7a2ee127465fa7e1fad8387d5c5e', 'request_id': 'req-c6c15f49-d904-4d15-a53d-6685d3bfe24e'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:19.681089 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c6c15f49-d904-4d15-a53d-6685d3bfe24e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47eb7a2ee127465fa7e1fad8387d5c5e', 'request_id': 'req-c6c15f49-d904-4d15-a53d-6685d3bfe24e'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:19.688579 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c6c15f49-d904-4d15-a53d-6685d3bfe24e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47eb7a2ee127465fa7e1fad8387d5c5e', 'request_id': 'req-c6c15f49-d904-4d15-a53d-6685d3bfe24e'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:19.702437 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c6c15f49-d904-4d15-a53d-6685d3bfe24e admin admin] The token cache is being invalidate because project 47eb7a2ee127465fa7e1fad8387d5c5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:23:19.702721 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c6c15f49-d904-4d15-a53d-6685d3bfe24e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:19.703395 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-c6c15f49-d904-4d15-a53d-6685d3bfe24e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:19.704855 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1389/2800] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:23:19 2022] DELETE /identity/v3/projects/47eb7a2ee127465fa7e1fad8387d5c5e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:19.709132 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d369c0-4608-4691-bf64-062a1591a3b7 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:19.710585 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-06d369c0-4608-4691-bf64-062a1591a3b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:19.723791 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d369c0-4608-4691-bf64-062a1591a3b7 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:19.781478 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a580d9-b63a-410d-84e8-aefd66ff5bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:19.782110 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a580d9-b63a-410d-84e8-aefd66ff5bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:19.782391 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a580d9-b63a-410d-84e8-aefd66ff5bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:19.782664 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a580d9-b63a-410d-84e8-aefd66ff5bb1 admin admin] PATH_INFO: `/v3/users/10b1d84450d948ccaf219908093fd9c9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:19.783844 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a580d9-b63a-410d-84e8-aefd66ff5bb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b1d84450d948ccaf219908093fd9c9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:19.785769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a580d9-b63a-410d-84e8-aefd66ff5bb1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:19.814896 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:19.841210 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-55a580d9-b63a-410d-84e8-aefd66ff5bb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b1d84450d948ccaf219908093fd9c9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:19.841899 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-55a580d9-b63a-410d-84e8-aefd66ff5bb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b1d84450d948ccaf219908093fd9c9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:19.849000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-55a580d9-b63a-410d-84e8-aefd66ff5bb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b1d84450d948ccaf219908093fd9c9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:19.864629 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-55a580d9-b63a-410d-84e8-aefd66ff5bb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b1d84450d948ccaf219908093fd9c9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:19.872396 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-55a580d9-b63a-410d-84e8-aefd66ff5bb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b1d84450d948ccaf219908093fd9c9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:19.878802 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1412/2801] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:23:19 2022] DELETE /identity/v3/users/10b1d84450d948ccaf219908093fd9c9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:20.012584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1b545-296e-48c9-8665-e8e06bc60ed5 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:20.012976 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1b545-296e-48c9-8665-e8e06bc60ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:20.013258 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1b545-296e-48c9-8665-e8e06bc60ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:20.034264 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-7ef1b545-296e-48c9-8665-e8e06bc60ed5 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:20.035657 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7ef1b545-296e-48c9-8665-e8e06bc60ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:20.106038 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1390/2802] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Aug 10 13:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:23:20.133064 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a580d9-b63a-410d-84e8-aefd66ff5bb1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:20.134716 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-55a580d9-b63a-410d-84e8-aefd66ff5bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:20.177538 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1b545-296e-48c9-8665-e8e06bc60ed5 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:20.179226 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7ef1b545-296e-48c9-8665-e8e06bc60ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:20.192826 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1b545-296e-48c9-8665-e8e06bc60ed5 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:20.198778 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97c16e-751f-4311-9676-ef7557246f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:20.199546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97c16e-751f-4311-9676-ef7557246f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:20.199825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97c16e-751f-4311-9676-ef7557246f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:20.200099 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97c16e-751f-4311-9676-ef7557246f46 admin admin] PATH_INFO: `/v3/projects/d7c6132789424b7a94bd2fbe033b54c3` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:20.201803 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97c16e-751f-4311-9676-ef7557246f46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c6132789424b7a94bd2fbe033b54c3)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:20.203367 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97c16e-751f-4311-9676-ef7557246f46 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:20.225799 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a580d9-b63a-410d-84e8-aefd66ff5bb1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:20.233070 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f255a-0763-4ced-95b1-d19002639b55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:20.233883 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f255a-0763-4ced-95b1-d19002639b55 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:20.234248 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f255a-0763-4ced-95b1-d19002639b55 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:20.234556 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f255a-0763-4ced-95b1-d19002639b55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:20.243707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f255a-0763-4ced-95b1-d19002639b55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:20.245818 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f255a-0763-4ced-95b1-d19002639b55 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:20.249775 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:20.255472 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1413/2803] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:23:20.258546 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-1f97c16e-751f-4311-9676-ef7557246f46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c6132789424b7a94bd2fbe033b54c3', 'request_id': 'req-1f97c16e-751f-4311-9676-ef7557246f46'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:20.265759 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-1f97c16e-751f-4311-9676-ef7557246f46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c6132789424b7a94bd2fbe033b54c3', 'request_id': 'req-1f97c16e-751f-4311-9676-ef7557246f46'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:20.273438 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-1f97c16e-751f-4311-9676-ef7557246f46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c6132789424b7a94bd2fbe033b54c3', 'request_id': 'req-1f97c16e-751f-4311-9676-ef7557246f46'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:20.289479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-1f97c16e-751f-4311-9676-ef7557246f46 admin admin] The token cache is being invalidate because project d7c6132789424b7a94bd2fbe033b54c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:23:20.289711 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-1f97c16e-751f-4311-9676-ef7557246f46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:20.290460 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-1f97c16e-751f-4311-9676-ef7557246f46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:20.292030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1391/2804] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:23:20 2022] DELETE /identity/v3/projects/d7c6132789424b7a94bd2fbe033b54c3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:20.296818 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24544ec-70aa-4e05-87e0-f2ef106ba4ca None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:20.297103 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24544ec-70aa-4e05-87e0-f2ef106ba4ca None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:20.297361 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24544ec-70aa-4e05-87e0-f2ef106ba4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:20.317311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d24544ec-70aa-4e05-87e0-f2ef106ba4ca None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:20.318554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d24544ec-70aa-4e05-87e0-f2ef106ba4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:20.380892 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1414/2805] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:20.446145 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f90d9-bfc4-44e5-9f51-e00974abcff7 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:20.446457 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f90d9-bfc4-44e5-9f51-e00974abcff7 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:20.446730 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f90d9-bfc4-44e5-9f51-e00974abcff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:20.469404 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-807f90d9-bfc4-44e5-9f51-e00974abcff7 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:20.470614 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-807f90d9-bfc4-44e5-9f51-e00974abcff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:20.478445 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1392/2806] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:20.483397 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24544ec-70aa-4e05-87e0-f2ef106ba4ca None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:20.493106 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24544ec-70aa-4e05-87e0-f2ef106ba4ca None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:20.498671 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db946eb1-9467-4442-9858-2490a1318235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:20.499355 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db946eb1-9467-4442-9858-2490a1318235 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:20.499635 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db946eb1-9467-4442-9858-2490a1318235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:20.499905 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db946eb1-9467-4442-9858-2490a1318235 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:20.500621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db946eb1-9467-4442-9858-2490a1318235 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:23:20.500920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db946eb1-9467-4442-9858-2490a1318235 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:20.502526 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db946eb1-9467-4442-9858-2490a1318235 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:20.516046 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1415/2807] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:23:20.520495 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f90d9-bfc4-44e5-9f51-e00974abcff7 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:20.529968 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f90d9-bfc4-44e5-9f51-e00974abcff7 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:20.534584 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14ca58-e74e-4f71-b2fb-408b29976a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:20.535205 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14ca58-e74e-4f71-b2fb-408b29976a75 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:20.535482 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14ca58-e74e-4f71-b2fb-408b29976a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:20.535787 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14ca58-e74e-4f71-b2fb-408b29976a75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:20.536379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14ca58-e74e-4f71-b2fb-408b29976a75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:20.538246 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14ca58-e74e-4f71-b2fb-408b29976a75 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:20.567049 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1393/2808] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:23:20 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 13:23:20.571696 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db946eb1-9467-4442-9858-2490a1318235 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:20.582201 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db946eb1-9467-4442-9858-2490a1318235 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:20.593724 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:20.642943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4aa2db-224a-43b9-a27f-fb7db1119887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:20.643492 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4aa2db-224a-43b9-a27f-fb7db1119887 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:20.643774 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4aa2db-224a-43b9-a27f-fb7db1119887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:20.644046 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4aa2db-224a-43b9-a27f-fb7db1119887 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:20.644667 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4aa2db-224a-43b9-a27f-fb7db1119887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:20.646573 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4aa2db-224a-43b9-a27f-fb7db1119887 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:20.668796 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1416/2809] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:23:20 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:23:20.673116 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14ca58-e74e-4f71-b2fb-408b29976a75 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:20.688050 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14ca58-e74e-4f71-b2fb-408b29976a75 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:20.692736 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127019a-a063-490c-a442-99a4bb264df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:20.693343 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127019a-a063-490c-a442-99a4bb264df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:20.693623 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127019a-a063-490c-a442-99a4bb264df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:20.693897 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127019a-a063-490c-a442-99a4bb264df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:20.694535 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127019a-a063-490c-a442-99a4bb264df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:20.696160 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127019a-a063-490c-a442-99a4bb264df2 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:20.707689 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1394/2810] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:23:20.712738 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4aa2db-224a-43b9-a27f-fb7db1119887 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:20.723843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4aa2db-224a-43b9-a27f-fb7db1119887 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:20.728510 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162233d-ebe5-41e5-afe0-67ad09d210fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:20.729248 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162233d-ebe5-41e5-afe0-67ad09d210fc admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:20.729534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162233d-ebe5-41e5-afe0-67ad09d210fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:20.729808 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162233d-ebe5-41e5-afe0-67ad09d210fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:20.730455 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162233d-ebe5-41e5-afe0-67ad09d210fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:20.732080 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162233d-ebe5-41e5-afe0-67ad09d210fc admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:20.745018 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1417/2811] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:23:20.749238 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127019a-a063-490c-a442-99a4bb264df2 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:20.759389 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127019a-a063-490c-a442-99a4bb264df2 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:20.765531 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6807c-1281-40ed-a6ae-638fdc852c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:20.766210 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6807c-1281-40ed-a6ae-638fdc852c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:20.766487 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6807c-1281-40ed-a6ae-638fdc852c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:20.766760 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6807c-1281-40ed-a6ae-638fdc852c0d admin admin] PATH_INFO: `/v3/projects/5427ae0e1803405994478571caea43b3/users/5ab99ccb51b24bd8864cd352f783a3c4/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:20.783022 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6807c-1281-40ed-a6ae-638fdc852c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5427ae0e1803405994478571caea43b3, user_id=5ab99ccb51b24bd8864cd352f783a3c4, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:20.785667 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6807c-1281-40ed-a6ae-638fdc852c0d admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:20.798506 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1395/2812] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:23:20 2022] PUT /identity/v3/projects/5427ae0e1803405994478571caea43b3/users/5ab99ccb51b24bd8864cd352f783a3c4/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:20.803760 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d2275-1de7-47d0-b17e-673a637743e4 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:20.804043 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d2275-1de7-47d0-b17e-673a637743e4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:20.804315 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d2275-1de7-47d0-b17e-673a637743e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:20.827272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fa1d2275-1de7-47d0-b17e-673a637743e4 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:20.828498 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fa1d2275-1de7-47d0-b17e-673a637743e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:20.892206 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1418/2813] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:20.902943 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6807c-1281-40ed-a6ae-638fdc852c0d admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:20.904780 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-f1c6807c-1281-40ed-a6ae-638fdc852c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:20.968463 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6807c-1281-40ed-a6ae-638fdc852c0d admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:20.972055 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa5fd7-074b-4d56-85f2-03d246f0c73f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:20.972650 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa5fd7-074b-4d56-85f2-03d246f0c73f service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:20.972961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa5fd7-074b-4d56-85f2-03d246f0c73f service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:20.973231 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa5fd7-074b-4d56-85f2-03d246f0c73f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:20.982627 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa5fd7-074b-4d56-85f2-03d246f0c73f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:20.984133 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa5fd7-074b-4d56-85f2-03d246f0c73f service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:21.000593 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1396/2814] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:23:25.350135 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a6254-d726-4fbf-8fdc-e5ac596dc324 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:25.350612 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a6254-d726-4fbf-8fdc-e5ac596dc324 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:25.350701 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a6254-d726-4fbf-8fdc-e5ac596dc324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:25.382340 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6f3a6254-d726-4fbf-8fdc-e5ac596dc324 None None] MFA Rules not processed for user `5ab99ccb51b24bd8864cd352f783a3c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:25.383621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6f3a6254-d726-4fbf-8fdc-e5ac596dc324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:25.472197 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1419/2815] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:25.477841 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa5fd7-074b-4d56-85f2-03d246f0c73f service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:25.497478 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa5fd7-074b-4d56-85f2-03d246f0c73f service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:25.503803 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a17774-fb18-4cd3-a09e-1b4f92fdf505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:25.504420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a17774-fb18-4cd3-a09e-1b4f92fdf505 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:25.504702 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a17774-fb18-4cd3-a09e-1b4f92fdf505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:25.504975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a17774-fb18-4cd3-a09e-1b4f92fdf505 admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:25.505603 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a17774-fb18-4cd3-a09e-1b4f92fdf505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:25.507551 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a17774-fb18-4cd3-a09e-1b4f92fdf505 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:25.540173 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1397/2816] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:23:25 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:23:25.544924 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a6254-d726-4fbf-8fdc-e5ac596dc324 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:25.556099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a6254-d726-4fbf-8fdc-e5ac596dc324 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:25.577634 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:25.619765 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0420f-43a8-4b31-bce1-85f1846cf622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:25.620502 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0420f-43a8-4b31-bce1-85f1846cf622 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:25.620856 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0420f-43a8-4b31-bce1-85f1846cf622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:25.621198 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0420f-43a8-4b31-bce1-85f1846cf622 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:25.621903 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0420f-43a8-4b31-bce1-85f1846cf622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:25.623980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0420f-43a8-4b31-bce1-85f1846cf622 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:25.648797 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1420/2817] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:23:25 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:23:25.653421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a17774-fb18-4cd3-a09e-1b4f92fdf505 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:25.664656 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a17774-fb18-4cd3-a09e-1b4f92fdf505 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:25.670391 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d68ae5-5484-4b2e-bcb9-61e13b126eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:25.670772 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d68ae5-5484-4b2e-bcb9-61e13b126eef admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:25.671089 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d68ae5-5484-4b2e-bcb9-61e13b126eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:25.671416 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d68ae5-5484-4b2e-bcb9-61e13b126eef admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:25.672014 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d68ae5-5484-4b2e-bcb9-61e13b126eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:25.673614 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d68ae5-5484-4b2e-bcb9-61e13b126eef admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:25.685912 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1398/2818] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:23:25.690233 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0420f-43a8-4b31-bce1-85f1846cf622 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:25.701169 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0420f-43a8-4b31-bce1-85f1846cf622 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:25.705983 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eafa46-0998-4b37-9494-1711d6b27fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:25.706889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eafa46-0998-4b37-9494-1711d6b27fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:25.707206 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eafa46-0998-4b37-9494-1711d6b27fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:25.707485 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eafa46-0998-4b37-9494-1711d6b27fa3 admin admin] PATH_INFO: `/v3/projects/0a9625b02e1e4aaeac2de08168e21004/users/22d75e475c874c9eb0aa9a0dc2d6cdb8/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:25.724987 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eafa46-0998-4b37-9494-1711d6b27fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a9625b02e1e4aaeac2de08168e21004, user_id=22d75e475c874c9eb0aa9a0dc2d6cdb8, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:25.727934 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eafa46-0998-4b37-9494-1711d6b27fa3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:25.744007 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1421/2819] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:23:25 2022] PUT /identity/v3/projects/0a9625b02e1e4aaeac2de08168e21004/users/22d75e475c874c9eb0aa9a0dc2d6cdb8/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:25.749654 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d68ae5-5484-4b2e-bcb9-61e13b126eef admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:25.764967 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d68ae5-5484-4b2e-bcb9-61e13b126eef admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:25.810861 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:25.840933 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e7f4b-72f3-4fde-8711-63e7cc37db59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:25.841547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e7f4b-72f3-4fde-8711-63e7cc37db59 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:25.842489 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e7f4b-72f3-4fde-8711-63e7cc37db59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:25.842769 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e7f4b-72f3-4fde-8711-63e7cc37db59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:25.843445 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e7f4b-72f3-4fde-8711-63e7cc37db59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:25.845051 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e7f4b-72f3-4fde-8711-63e7cc37db59 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:25.856150 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1399/2820] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:23:25.860622 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eafa46-0998-4b37-9494-1711d6b27fa3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:25.872983 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eafa46-0998-4b37-9494-1711d6b27fa3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:25.877860 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0529f2e-d64b-4c97-aab5-b94a3ae8000c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:25.878548 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0529f2e-d64b-4c97-aab5-b94a3ae8000c admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:25.878831 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0529f2e-d64b-4c97-aab5-b94a3ae8000c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:25.879141 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0529f2e-d64b-4c97-aab5-b94a3ae8000c admin admin] PATH_INFO: `/v3/projects/0a9625b02e1e4aaeac2de08168e21004/users/22d75e475c874c9eb0aa9a0dc2d6cdb8/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:25.881100 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0529f2e-d64b-4c97-aab5-b94a3ae8000c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a9625b02e1e4aaeac2de08168e21004, user_id=22d75e475c874c9eb0aa9a0dc2d6cdb8, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:25.883797 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0529f2e-d64b-4c97-aab5-b94a3ae8000c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:25.897826 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1422/2821] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:23:25 2022] PUT /identity/v3/projects/0a9625b02e1e4aaeac2de08168e21004/users/22d75e475c874c9eb0aa9a0dc2d6cdb8/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:32.039380 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535a1f3-9abd-4104-8a04-83a310c2abee None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:32.040283 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535a1f3-9abd-4104-8a04-83a310c2abee None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:32.040911 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535a1f3-9abd-4104-8a04-83a310c2abee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:32.105695 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-8535a1f3-9abd-4104-8a04-83a310c2abee None None] MFA Rules not processed for user `22d75e475c874c9eb0aa9a0dc2d6cdb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:32.107181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-8535a1f3-9abd-4104-8a04-83a310c2abee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:32.281528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1400/2822] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:32.290371 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0529f2e-d64b-4c97-aab5-b94a3ae8000c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:32.293234 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e0529f2e-d64b-4c97-aab5-b94a3ae8000c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:32.404200 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0529f2e-d64b-4c97-aab5-b94a3ae8000c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:32.410972 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3d812-42f1-41fd-8e0b-2acc2735e070 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5979be13ad31421b886069faf0dcc915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:32.412384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3d812-42f1-41fd-8e0b-2acc2735e070 service glance] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:32.413101 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3d812-42f1-41fd-8e0b-2acc2735e070 service glance] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:32.413763 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3d812-42f1-41fd-8e0b-2acc2735e070 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:32.510775 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3d812-42f1-41fd-8e0b-2acc2735e070 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:32.513492 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3d812-42f1-41fd-8e0b-2acc2735e070 service glance] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:32.531291 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1423/2823] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:23:32.727085 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d55bb-93f8-488c-bd7c-187143183783 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:32.727376 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d55bb-93f8-488c-bd7c-187143183783 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:32.727720 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d55bb-93f8-488c-bd7c-187143183783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:32.756235 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-535d55bb-93f8-488c-bd7c-187143183783 None None] MFA Rules not processed for user `182eec86daa44cd48d6ef1c38f58e89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:32.759033 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-535d55bb-93f8-488c-bd7c-187143183783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:32.847414 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1401/2824] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 10 13:23:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:32.933327 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3d812-42f1-41fd-8e0b-2acc2735e070 service glance] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:32.938604 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a1a3d812-42f1-41fd-8e0b-2acc2735e070 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:33.000527 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:33.048427 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3d812-42f1-41fd-8e0b-2acc2735e070 service glance] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:33.054455 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22c425-2574-4b60-9ae3-726e0b97b748 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c86ef66c9564e0395c325a84ca9c4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:33.055125 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22c425-2574-4b60-9ae3-726e0b97b748 service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:33.055414 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22c425-2574-4b60-9ae3-726e0b97b748 service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:33.055760 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22c425-2574-4b60-9ae3-726e0b97b748 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:33.066893 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22c425-2574-4b60-9ae3-726e0b97b748 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:33.068795 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22c425-2574-4b60-9ae3-726e0b97b748 service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:33.085099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1424/2825] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 10 13:23:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 13:23:36.960517 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d55bb-93f8-488c-bd7c-187143183783 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:36.961869 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-535d55bb-93f8-488c-bd7c-187143183783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:37.130034 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d55bb-93f8-488c-bd7c-187143183783 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:37.145441 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551493bf-6ed0-4f18-98b1-8d385f01fc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:37.146171 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551493bf-6ed0-4f18-98b1-8d385f01fc7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:37.146449 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551493bf-6ed0-4f18-98b1-8d385f01fc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:37.146738 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551493bf-6ed0-4f18-98b1-8d385f01fc7e admin admin] PATH_INFO: `/v3/users/7d3de70704534a1abba8dd99a75e392f` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:37.150200 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551493bf-6ed0-4f18-98b1-8d385f01fc7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d3de70704534a1abba8dd99a75e392f)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:37.152098 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551493bf-6ed0-4f18-98b1-8d385f01fc7e admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:37.154014 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:37.251099 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-551493bf-6ed0-4f18-98b1-8d385f01fc7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d3de70704534a1abba8dd99a75e392f'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:37.252224 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-551493bf-6ed0-4f18-98b1-8d385f01fc7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d3de70704534a1abba8dd99a75e392f'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:37.263890 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-551493bf-6ed0-4f18-98b1-8d385f01fc7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d3de70704534a1abba8dd99a75e392f'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:37.279476 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-551493bf-6ed0-4f18-98b1-8d385f01fc7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d3de70704534a1abba8dd99a75e392f'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:37.301829 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-551493bf-6ed0-4f18-98b1-8d385f01fc7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d3de70704534a1abba8dd99a75e392f'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:37.317679 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0be78-70a1-45a8-a050-cd9afadd9ad0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:37.318783 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0be78-70a1-45a8-a050-cd9afadd9ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:37.319518 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0be78-70a1-45a8-a050-cd9afadd9ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:37.324416 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1402/2826] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:23:36 2022] DELETE /identity/v3/users/7d3de70704534a1abba8dd99a75e392f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:37.357923 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-63a0be78-70a1-45a8-a050-cd9afadd9ad0 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:37.359264 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-63a0be78-70a1-45a8-a050-cd9afadd9ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:37.473786 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1425/2827] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:37.486642 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551493bf-6ed0-4f18-98b1-8d385f01fc7e admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:37.489186 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-551493bf-6ed0-4f18-98b1-8d385f01fc7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:37.601533 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551493bf-6ed0-4f18-98b1-8d385f01fc7e admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:37.605712 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287e98d-f554-42c0-8bbd-8a7c81729e76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:37.609403 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287e98d-f554-42c0-8bbd-8a7c81729e76 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:37.609403 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287e98d-f554-42c0-8bbd-8a7c81729e76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:37.609403 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287e98d-f554-42c0-8bbd-8a7c81729e76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:37.619304 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287e98d-f554-42c0-8bbd-8a7c81729e76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:37.620966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287e98d-f554-42c0-8bbd-8a7c81729e76 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:37.639198 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1403/2828] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:23:38.014135 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0be78-70a1-45a8-a050-cd9afadd9ad0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:38.015558 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-63a0be78-70a1-45a8-a050-cd9afadd9ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:38.038487 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0be78-70a1-45a8-a050-cd9afadd9ad0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:38.048108 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d58911-ef81-471b-a4d6-24e07aebec2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:38.049428 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d58911-ef81-471b-a4d6-24e07aebec2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:38.049549 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d58911-ef81-471b-a4d6-24e07aebec2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:38.049954 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d58911-ef81-471b-a4d6-24e07aebec2d admin admin] PATH_INFO: `/v3/projects/573e811db7834cc18ba55d78645341dd` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:38.052179 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d58911-ef81-471b-a4d6-24e07aebec2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=573e811db7834cc18ba55d78645341dd)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:38.059352 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d58911-ef81-471b-a4d6-24e07aebec2d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:38.146295 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f7d58911-ef81-471b-a4d6-24e07aebec2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '573e811db7834cc18ba55d78645341dd', 'request_id': 'req-f7d58911-ef81-471b-a4d6-24e07aebec2d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:38.158851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f7d58911-ef81-471b-a4d6-24e07aebec2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '573e811db7834cc18ba55d78645341dd', 'request_id': 'req-f7d58911-ef81-471b-a4d6-24e07aebec2d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:38.168593 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f7d58911-ef81-471b-a4d6-24e07aebec2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '573e811db7834cc18ba55d78645341dd', 'request_id': 'req-f7d58911-ef81-471b-a4d6-24e07aebec2d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:38.184729 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f7d58911-ef81-471b-a4d6-24e07aebec2d admin admin] The token cache is being invalidate because project 573e811db7834cc18ba55d78645341dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:23:38.184966 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f7d58911-ef81-471b-a4d6-24e07aebec2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:38.185620 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f7d58911-ef81-471b-a4d6-24e07aebec2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:38.187227 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1426/2829] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:23:38 2022] DELETE /identity/v3/projects/573e811db7834cc18ba55d78645341dd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:38.194310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c20fb9-1408-4b8a-b279-5974ac06427c None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:38.194885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c20fb9-1408-4b8a-b279-5974ac06427c None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:38.194885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c20fb9-1408-4b8a-b279-5974ac06427c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:38.221510 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-49c20fb9-1408-4b8a-b279-5974ac06427c None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:38.222753 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-49c20fb9-1408-4b8a-b279-5974ac06427c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:38.319850 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1404/2830] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:38.324962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a82014-3033-4be3-86c1-53415f3690d5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:38.325537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a82014-3033-4be3-86c1-53415f3690d5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:38.325537 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a82014-3033-4be3-86c1-53415f3690d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:38.350427 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-26a82014-3033-4be3-86c1-53415f3690d5 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:38.351888 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-26a82014-3033-4be3-86c1-53415f3690d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:38.365138 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1427/2831] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:38.370639 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c20fb9-1408-4b8a-b279-5974ac06427c None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:38.385924 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c20fb9-1408-4b8a-b279-5974ac06427c None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:38.401831 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ede9a-7908-4e8d-98aa-a012f90569bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:38.402434 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ede9a-7908-4e8d-98aa-a012f90569bb admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:38.402688 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ede9a-7908-4e8d-98aa-a012f90569bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:38.402958 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ede9a-7908-4e8d-98aa-a012f90569bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:38.403645 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ede9a-7908-4e8d-98aa-a012f90569bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:23:38.403945 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ede9a-7908-4e8d-98aa-a012f90569bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:38.405545 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ede9a-7908-4e8d-98aa-a012f90569bb admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:38.423068 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1405/2832] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:23:38.428468 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a82014-3033-4be3-86c1-53415f3690d5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:38.441866 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a82014-3033-4be3-86c1-53415f3690d5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:38.464707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444d008-6858-4f11-aaea-cb2fd9a3f043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:38.465329 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444d008-6858-4f11-aaea-cb2fd9a3f043 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:38.465614 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444d008-6858-4f11-aaea-cb2fd9a3f043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:38.465868 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444d008-6858-4f11-aaea-cb2fd9a3f043 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:38.466509 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444d008-6858-4f11-aaea-cb2fd9a3f043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:38.471218 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444d008-6858-4f11-aaea-cb2fd9a3f043 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:38.523834 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1428/2833] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:23:38 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:23:38.532493 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ede9a-7908-4e8d-98aa-a012f90569bb admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:38.550790 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ede9a-7908-4e8d-98aa-a012f90569bb admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:38.560687 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:38.688882 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc3691-3e2e-4992-9be7-da731f7abfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:38.690189 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc3691-3e2e-4992-9be7-da731f7abfae admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:38.690651 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc3691-3e2e-4992-9be7-da731f7abfae admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:38.690953 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc3691-3e2e-4992-9be7-da731f7abfae admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:38.692349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc3691-3e2e-4992-9be7-da731f7abfae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:38.696232 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc3691-3e2e-4992-9be7-da731f7abfae admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:38.735928 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1406/2834] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:23:38 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:23:38.737256 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444d008-6858-4f11-aaea-cb2fd9a3f043 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:38.749059 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444d008-6858-4f11-aaea-cb2fd9a3f043 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:38.753943 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ac779-d0a1-4ad1-bbed-119630222d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:38.754606 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ac779-d0a1-4ad1-bbed-119630222d93 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:38.754886 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ac779-d0a1-4ad1-bbed-119630222d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:38.755183 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ac779-d0a1-4ad1-bbed-119630222d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:38.755827 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ac779-d0a1-4ad1-bbed-119630222d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:38.757454 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ac779-d0a1-4ad1-bbed-119630222d93 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:38.777226 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1429/2835] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:23:38.778781 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc3691-3e2e-4992-9be7-da731f7abfae admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:38.790039 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc3691-3e2e-4992-9be7-da731f7abfae admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:38.798365 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01109d5f-3df7-49af-ae6c-def04b433375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:38.799349 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01109d5f-3df7-49af-ae6c-def04b433375 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:38.799511 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01109d5f-3df7-49af-ae6c-def04b433375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:38.799722 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01109d5f-3df7-49af-ae6c-def04b433375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:38.800464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01109d5f-3df7-49af-ae6c-def04b433375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:38.802144 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01109d5f-3df7-49af-ae6c-def04b433375 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:38.818213 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1407/2836] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:23:38.823954 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ac779-d0a1-4ad1-bbed-119630222d93 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:38.831719 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:38.836710 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ac779-d0a1-4ad1-bbed-119630222d93 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:38.844790 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35868e7a-c706-48e9-94a2-6e831044a154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:38.845651 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35868e7a-c706-48e9-94a2-6e831044a154 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:38.846000 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35868e7a-c706-48e9-94a2-6e831044a154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:38.846430 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35868e7a-c706-48e9-94a2-6e831044a154 admin admin] PATH_INFO: `/v3/projects/ca4ea6a142274db787122223aa21d8e0/users/261de2f358df4198aded3529b5f63211/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:38.866848 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35868e7a-c706-48e9-94a2-6e831044a154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4ea6a142274db787122223aa21d8e0, user_id=261de2f358df4198aded3529b5f63211, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:38.872971 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35868e7a-c706-48e9-94a2-6e831044a154 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:38.895562 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1430/2837] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:23:38 2022] PUT /identity/v3/projects/ca4ea6a142274db787122223aa21d8e0/users/261de2f358df4198aded3529b5f63211/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:38.901733 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d5515-3cbe-4b0e-ad86-d87a5e00f79d None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:38.902116 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d5515-3cbe-4b0e-ad86-d87a5e00f79d None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:38.902594 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d5515-3cbe-4b0e-ad86-d87a5e00f79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:38.946382 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-e93d5515-3cbe-4b0e-ad86-d87a5e00f79d None None] MFA Rules not processed for user `261de2f358df4198aded3529b5f63211`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:38.948372 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-e93d5515-3cbe-4b0e-ad86-d87a5e00f79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:39.079051 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1408/2838] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:39.091570 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35868e7a-c706-48e9-94a2-6e831044a154 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:39.093437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-35868e7a-c706-48e9-94a2-6e831044a154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:39.176186 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35868e7a-c706-48e9-94a2-6e831044a154 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:39.182699 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53148a-1289-4cb5-99c9-3698cc95f44d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:39.183457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53148a-1289-4cb5-99c9-3698cc95f44d service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:39.183757 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53148a-1289-4cb5-99c9-3698cc95f44d service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:39.183994 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53148a-1289-4cb5-99c9-3698cc95f44d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:39.195186 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53148a-1289-4cb5-99c9-3698cc95f44d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:39.196713 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53148a-1289-4cb5-99c9-3698cc95f44d service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:39.217384 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1431/2839] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:23:39.256221 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d5515-3cbe-4b0e-ad86-d87a5e00f79d None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:39.337921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d5515-3cbe-4b0e-ad86-d87a5e00f79d None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:39.346064 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d26d97-0383-4d2f-b119-5f01e98dd734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:39.346064 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d26d97-0383-4d2f-b119-5f01e98dd734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:39.346064 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d26d97-0383-4d2f-b119-5f01e98dd734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:39.346064 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d26d97-0383-4d2f-b119-5f01e98dd734 admin admin] PATH_INFO: `/v3/users/261de2f358df4198aded3529b5f63211` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:39.347100 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d26d97-0383-4d2f-b119-5f01e98dd734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=261de2f358df4198aded3529b5f63211)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:39.349421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d26d97-0383-4d2f-b119-5f01e98dd734 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:39.378693 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:39.416721 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-11d26d97-0383-4d2f-b119-5f01e98dd734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '261de2f358df4198aded3529b5f63211'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:39.417564 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-11d26d97-0383-4d2f-b119-5f01e98dd734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '261de2f358df4198aded3529b5f63211'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:39.425705 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-11d26d97-0383-4d2f-b119-5f01e98dd734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '261de2f358df4198aded3529b5f63211'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:39.434336 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-11d26d97-0383-4d2f-b119-5f01e98dd734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '261de2f358df4198aded3529b5f63211'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:39.461885 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-11d26d97-0383-4d2f-b119-5f01e98dd734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '261de2f358df4198aded3529b5f63211'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:39.477256 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1409/2840] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:23:39 2022] DELETE /identity/v3/users/261de2f358df4198aded3529b5f63211 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:39.480764 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d7d93-4336-4f45-a513-e1cb0651d201 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:39.481300 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d7d93-4336-4f45-a513-e1cb0651d201 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:39.481769 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d7d93-4336-4f45-a513-e1cb0651d201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:39.504520 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3f0d7d93-4336-4f45-a513-e1cb0651d201 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:39.505734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3f0d7d93-4336-4f45-a513-e1cb0651d201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:39.578194 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1432/2841] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:39.589806 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d26d97-0383-4d2f-b119-5f01e98dd734 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:39.591363 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-11d26d97-0383-4d2f-b119-5f01e98dd734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:39.678931 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d26d97-0383-4d2f-b119-5f01e98dd734 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:39.684894 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cec05-14e8-45a4-a7f2-feee208f37e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:39.685677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cec05-14e8-45a4-a7f2-feee208f37e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:39.685970 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cec05-14e8-45a4-a7f2-feee208f37e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:39.686244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cec05-14e8-45a4-a7f2-feee208f37e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:39.697993 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68cec05-14e8-45a4-a7f2-feee208f37e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:39.699669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68cec05-14e8-45a4-a7f2-feee208f37e1 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:39.713699 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1410/2842] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:23:40.160025 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d7d93-4336-4f45-a513-e1cb0651d201 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:40.161550 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3f0d7d93-4336-4f45-a513-e1cb0651d201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:40.175306 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d7d93-4336-4f45-a513-e1cb0651d201 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:40.182322 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c9aba-e157-4523-9671-84f967718b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:40.182979 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c9aba-e157-4523-9671-84f967718b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:40.183290 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c9aba-e157-4523-9671-84f967718b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:40.183567 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c9aba-e157-4523-9671-84f967718b22 admin admin] PATH_INFO: `/v3/projects/ca4ea6a142274db787122223aa21d8e0` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:40.185370 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c9aba-e157-4523-9671-84f967718b22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca4ea6a142274db787122223aa21d8e0)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:40.187347 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c9aba-e157-4523-9671-84f967718b22 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:40.265816 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d28c9aba-e157-4523-9671-84f967718b22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca4ea6a142274db787122223aa21d8e0', 'request_id': 'req-d28c9aba-e157-4523-9671-84f967718b22'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:40.277865 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d28c9aba-e157-4523-9671-84f967718b22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca4ea6a142274db787122223aa21d8e0', 'request_id': 'req-d28c9aba-e157-4523-9671-84f967718b22'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:40.288023 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d28c9aba-e157-4523-9671-84f967718b22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca4ea6a142274db787122223aa21d8e0', 'request_id': 'req-d28c9aba-e157-4523-9671-84f967718b22'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:40.302321 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d28c9aba-e157-4523-9671-84f967718b22 admin admin] The token cache is being invalidate because project ca4ea6a142274db787122223aa21d8e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:23:40.302643 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d28c9aba-e157-4523-9671-84f967718b22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:40.303351 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d28c9aba-e157-4523-9671-84f967718b22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:40.308234 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1433/2843] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:23:40 2022] DELETE /identity/v3/projects/ca4ea6a142274db787122223aa21d8e0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:40.310381 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e590ee-ebc9-4cc9-85d9-e9763c5eeec4 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:40.311418 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e590ee-ebc9-4cc9-85d9-e9763c5eeec4 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:40.311725 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e590ee-ebc9-4cc9-85d9-e9763c5eeec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:40.341328 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-f5e590ee-ebc9-4cc9-85d9-e9763c5eeec4 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:40.343175 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-f5e590ee-ebc9-4cc9-85d9-e9763c5eeec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:40.444408 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1411/2844] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:40.518133 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e2b82-42ef-4c0e-a029-a05b901055f7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:40.518681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e2b82-42ef-4c0e-a029-a05b901055f7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:40.518681 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e2b82-42ef-4c0e-a029-a05b901055f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:40.533845 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:40.540029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d61e2b82-42ef-4c0e-a029-a05b901055f7 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:40.542404 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d61e2b82-42ef-4c0e-a029-a05b901055f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:40.555858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1434/2845] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:40.557750 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e590ee-ebc9-4cc9-85d9-e9763c5eeec4 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:40.568308 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e590ee-ebc9-4cc9-85d9-e9763c5eeec4 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:40.573997 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344ed74-948f-403b-8904-9a5f604e49d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:40.574628 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344ed74-948f-403b-8904-9a5f604e49d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:40.574913 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344ed74-948f-403b-8904-9a5f604e49d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:40.575224 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344ed74-948f-403b-8904-9a5f604e49d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:40.575898 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344ed74-948f-403b-8904-9a5f604e49d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:23:40.576204 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344ed74-948f-403b-8904-9a5f604e49d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:40.577877 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344ed74-948f-403b-8904-9a5f604e49d1 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:40.592517 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1412/2846] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 13:23:40.597063 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e2b82-42ef-4c0e-a029-a05b901055f7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:40.607673 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e2b82-42ef-4c0e-a029-a05b901055f7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:40.613423 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae3d7d-cb10-4734-a6a2-d330500d48a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:40.614118 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae3d7d-cb10-4734-a6a2-d330500d48a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:40.614391 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae3d7d-cb10-4734-a6a2-d330500d48a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:40.614889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae3d7d-cb10-4734-a6a2-d330500d48a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:40.616023 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae3d7d-cb10-4734-a6a2-d330500d48a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:40.618313 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae3d7d-cb10-4734-a6a2-d330500d48a8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:40.656497 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1435/2847] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:23:40 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:23:40.658939 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344ed74-948f-403b-8904-9a5f604e49d1 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:40.671457 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344ed74-948f-403b-8904-9a5f604e49d1 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:40.717891 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:40.757678 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf4df1-aac3-41e8-ab37-119800730867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:40.758307 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf4df1-aac3-41e8-ab37-119800730867 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:40.758588 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf4df1-aac3-41e8-ab37-119800730867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:40.758864 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf4df1-aac3-41e8-ab37-119800730867 admin admin] PATH_INFO: `/v3/users` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:40.759552 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf4df1-aac3-41e8-ab37-119800730867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:40.762285 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf4df1-aac3-41e8-ab37-119800730867 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:40.799615 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1413/2848] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:23:40 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:23:40.801295 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae3d7d-cb10-4734-a6a2-d330500d48a8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:40.813465 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae3d7d-cb10-4734-a6a2-d330500d48a8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:40.818489 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb6698-a9df-403b-a985-e13f7934fde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:40.819528 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb6698-a9df-403b-a985-e13f7934fde4 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:40.819991 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb6698-a9df-403b-a985-e13f7934fde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:40.820536 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb6698-a9df-403b-a985-e13f7934fde4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:40.821222 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb6698-a9df-403b-a985-e13f7934fde4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:40.823623 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb6698-a9df-403b-a985-e13f7934fde4 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:40.837373 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1436/2849] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:23:40.842080 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf4df1-aac3-41e8-ab37-119800730867 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:40.855675 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf4df1-aac3-41e8-ab37-119800730867 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:40.861709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7a190-563b-4050-8cb0-f616d8bd9ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:40.862500 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7a190-563b-4050-8cb0-f616d8bd9ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:40.862837 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7a190-563b-4050-8cb0-f616d8bd9ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:40.863205 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7a190-563b-4050-8cb0-f616d8bd9ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:40.863927 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7a190-563b-4050-8cb0-f616d8bd9ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:40.865640 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7a190-563b-4050-8cb0-f616d8bd9ad5 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:40.879961 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1414/2850] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:23:40.884299 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb6698-a9df-403b-a985-e13f7934fde4 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:40.897189 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb6698-a9df-403b-a985-e13f7934fde4 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:40.902311 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11e562-2af3-4fd9-9dc7-e51e65c519cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:40.903052 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11e562-2af3-4fd9-9dc7-e51e65c519cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:40.903336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11e562-2af3-4fd9-9dc7-e51e65c519cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:40.903652 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11e562-2af3-4fd9-9dc7-e51e65c519cf admin admin] PATH_INFO: `/v3/projects/83676452cb324dcb9daea09b8a6d64c0/users/0bffe8ff82124755821113223fd6acf6/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:40.927303 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11e562-2af3-4fd9-9dc7-e51e65c519cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=83676452cb324dcb9daea09b8a6d64c0, user_id=0bffe8ff82124755821113223fd6acf6, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:40.931876 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11e562-2af3-4fd9-9dc7-e51e65c519cf admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:40.959556 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1437/2851] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:23:40 2022] PUT /identity/v3/projects/83676452cb324dcb9daea09b8a6d64c0/users/0bffe8ff82124755821113223fd6acf6/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:40.962019 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf95b8-fb77-45aa-afc7-74af82b1319a None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:40.962378 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf95b8-fb77-45aa-afc7-74af82b1319a None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:40.963213 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf95b8-fb77-45aa-afc7-74af82b1319a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:41.000931 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-5daf95b8-fb77-45aa-afc7-74af82b1319a None None] MFA Rules not processed for user `0bffe8ff82124755821113223fd6acf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:41.002260 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-5daf95b8-fb77-45aa-afc7-74af82b1319a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:41.093884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1415/2852] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:41.106107 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11e562-2af3-4fd9-9dc7-e51e65c519cf admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:41.108440 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9f11e562-2af3-4fd9-9dc7-e51e65c519cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:41.200639 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11e562-2af3-4fd9-9dc7-e51e65c519cf admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:41.209243 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd32bc-f7b9-41c8-8684-7bfeffe7c72a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:41.210712 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd32bc-f7b9-41c8-8684-7bfeffe7c72a service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:41.211539 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd32bc-f7b9-41c8-8684-7bfeffe7c72a service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:41.215137 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd32bc-f7b9-41c8-8684-7bfeffe7c72a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:41.236656 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd32bc-f7b9-41c8-8684-7bfeffe7c72a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:41.242021 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd32bc-f7b9-41c8-8684-7bfeffe7c72a service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:41.267535 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1438/2853] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:23:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:23:43.022825 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49d493-4401-405d-9486-36985d080298 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:43.023700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49d493-4401-405d-9486-36985d080298 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:43.023700 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49d493-4401-405d-9486-36985d080298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:43.044274 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-eb49d493-4401-405d-9486-36985d080298 None None] MFA Rules not processed for user `0bffe8ff82124755821113223fd6acf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:43.045526 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-eb49d493-4401-405d-9486-36985d080298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:43.053904 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1416/2854] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 13:23:43.173795 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f760062-f8b4-4216-9867-afe06b8bbf93 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:43.174400 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f760062-f8b4-4216-9867-afe06b8bbf93 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:43.174400 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f760062-f8b4-4216-9867-afe06b8bbf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:43.200010 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6f760062-f8b4-4216-9867-afe06b8bbf93 None None] MFA Rules not processed for user `5ab99ccb51b24bd8864cd352f783a3c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:43.201359 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6f760062-f8b4-4216-9867-afe06b8bbf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:43.291461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1439/2855] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:23:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:45.710507 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2af84-7415-450f-9a7e-6156f4a6e075 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:45.711242 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2af84-7415-450f-9a7e-6156f4a6e075 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:45.715696 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2af84-7415-450f-9a7e-6156f4a6e075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:45.771375 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-07c2af84-7415-450f-9a7e-6156f4a6e075 None None] MFA Rules not processed for user `182eec86daa44cd48d6ef1c38f58e89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:23:45.773635 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-07c2af84-7415-450f-9a7e-6156f4a6e075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:45.850978 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1417/2856] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 10 13:23:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:23:45.864016 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f760062-f8b4-4216-9867-afe06b8bbf93 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:45.865578 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6f760062-f8b4-4216-9867-afe06b8bbf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:45.928813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:45.956872 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f760062-f8b4-4216-9867-afe06b8bbf93 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:45.965322 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d6254-c505-4a86-a284-6f76898d8ec8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c86ef66c9564e0395c325a84ca9c4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:45.966294 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d6254-c505-4a86-a284-6f76898d8ec8 service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:45.966425 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d6254-c505-4a86-a284-6f76898d8ec8 service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:45.966853 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d6254-c505-4a86-a284-6f76898d8ec8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:45.979714 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d6254-c505-4a86-a284-6f76898d8ec8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:45.987419 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d6254-c505-4a86-a284-6f76898d8ec8 service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:45.993318 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1440/2857] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 10 13:23:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 13:23:52.219592 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2af84-7415-450f-9a7e-6156f4a6e075 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:52.223743 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-07c2af84-7415-450f-9a7e-6156f4a6e075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:23:52.297840 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:23:52.373386 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2af84-7415-450f-9a7e-6156f4a6e075 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:52.381652 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8c666-e7bc-444a-b417-18808a0cdc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:52.382233 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8c666-e7bc-444a-b417-18808a0cdc84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:52.382526 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8c666-e7bc-444a-b417-18808a0cdc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:52.382802 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8c666-e7bc-444a-b417-18808a0cdc84 admin admin] PATH_INFO: `/v3/users/1d0c375aeddb41c5bb7a8174b6efcc4f` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:52.384766 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8c666-e7bc-444a-b417-18808a0cdc84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d0c375aeddb41c5bb7a8174b6efcc4f)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:52.386993 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8c666-e7bc-444a-b417-18808a0cdc84 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:52.472491 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-63b8c666-e7bc-444a-b417-18808a0cdc84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d0c375aeddb41c5bb7a8174b6efcc4f'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:52.473281 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-63b8c666-e7bc-444a-b417-18808a0cdc84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d0c375aeddb41c5bb7a8174b6efcc4f'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:52.483365 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-63b8c666-e7bc-444a-b417-18808a0cdc84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d0c375aeddb41c5bb7a8174b6efcc4f'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:52.492833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-63b8c666-e7bc-444a-b417-18808a0cdc84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d0c375aeddb41c5bb7a8174b6efcc4f'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:52.513423 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-63b8c666-e7bc-444a-b417-18808a0cdc84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d0c375aeddb41c5bb7a8174b6efcc4f'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:52.525740 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1418/2858] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:23:52 2022] DELETE /identity/v3/users/1d0c375aeddb41c5bb7a8174b6efcc4f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:23:52.741517 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d6254-c505-4a86-a284-6f76898d8ec8 service swift] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:23:52.755941 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d6254-c505-4a86-a284-6f76898d8ec8 service swift] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:23:52.860415 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8882f7d-abe9-480c-9d68-a21ec97dfa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:23:52.861038 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8882f7d-abe9-480c-9d68-a21ec97dfa61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:23:52.861338 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8882f7d-abe9-480c-9d68-a21ec97dfa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:23:52.861591 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8882f7d-abe9-480c-9d68-a21ec97dfa61 admin admin] PATH_INFO: `/v3/projects/91f0de74bdef440cbbcf6c932687aeba` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:23:52.862708 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8882f7d-abe9-480c-9d68-a21ec97dfa61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91f0de74bdef440cbbcf6c932687aeba)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:23:52.864668 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8882f7d-abe9-480c-9d68-a21ec97dfa61 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:23:52.915400 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f8882f7d-abe9-480c-9d68-a21ec97dfa61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91f0de74bdef440cbbcf6c932687aeba', 'request_id': 'req-f8882f7d-abe9-480c-9d68-a21ec97dfa61'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:52.924853 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f8882f7d-abe9-480c-9d68-a21ec97dfa61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91f0de74bdef440cbbcf6c932687aeba', 'request_id': 'req-f8882f7d-abe9-480c-9d68-a21ec97dfa61'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:52.932282 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f8882f7d-abe9-480c-9d68-a21ec97dfa61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91f0de74bdef440cbbcf6c932687aeba', 'request_id': 'req-f8882f7d-abe9-480c-9d68-a21ec97dfa61'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:52.945254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f8882f7d-abe9-480c-9d68-a21ec97dfa61 admin admin] The token cache is being invalidate because project 91f0de74bdef440cbbcf6c932687aeba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:23:52.949849 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f8882f7d-abe9-480c-9d68-a21ec97dfa61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:52.950930 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f8882f7d-abe9-480c-9d68-a21ec97dfa61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:23:52.952534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1441/2859] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:23:52 2022] DELETE /identity/v3/projects/91f0de74bdef440cbbcf6c932687aeba => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:24:02.516016 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=38,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:24:02.941293 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:24:07.685028 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8c666-e7bc-444a-b417-18808a0cdc84 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:24:07.686437 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-63b8c666-e7bc-444a-b417-18808a0cdc84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:24:07.774528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8c666-e7bc-444a-b417-18808a0cdc84 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:24:07.828102 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a44618-54fa-468d-92d9-1af4a31be23d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:24:07.828901 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a44618-54fa-468d-92d9-1af4a31be23d service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:24:07.829185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a44618-54fa-468d-92d9-1af4a31be23d service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:24:07.829606 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a44618-54fa-468d-92d9-1af4a31be23d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:24:07.831844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-b6a44618-54fa-468d-92d9-1af4a31be23d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:24:07.940414 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a44618-54fa-468d-92d9-1af4a31be23d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:24:07.941982 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a44618-54fa-468d-92d9-1af4a31be23d service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:24:07.954332 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1419/2860] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:24:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:24:08.429236 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5b02b-353c-493d-955f-1e0fbdd73364 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:24:08.429787 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5b02b-353c-493d-955f-1e0fbdd73364 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:24:08.430430 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5b02b-353c-493d-955f-1e0fbdd73364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:24:08.462237 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0da5b02b-353c-493d-955f-1e0fbdd73364 None None] MFA Rules not processed for user `182eec86daa44cd48d6ef1c38f58e89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:24:08.463674 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0da5b02b-353c-493d-955f-1e0fbdd73364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:24:08.536794 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1442/2861] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 10 13:24:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:24:08.550330 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a44618-54fa-468d-92d9-1af4a31be23d service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:24:08.551940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-b6a44618-54fa-468d-92d9-1af4a31be23d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:24:08.575296 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=100 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:24:08.627706 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a44618-54fa-468d-92d9-1af4a31be23d service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:24:08.633549 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e0c1f-9130-4634-b59f-03797d26fe3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c86ef66c9564e0395c325a84ca9c4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:24:08.634170 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e0c1f-9130-4634-b59f-03797d26fe3c service swift] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:24:08.634450 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e0c1f-9130-4634-b59f-03797d26fe3c service swift] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:24:08.634752 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e0c1f-9130-4634-b59f-03797d26fe3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:24:08.651097 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e0c1f-9130-4634-b59f-03797d26fe3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:24:08.652677 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e0c1f-9130-4634-b59f-03797d26fe3c service swift] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:24:08.661756 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1420/2862] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 10 13:24:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 13:24:09.270564 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3d4ed-939e-4e7f-b2c3-4aecf1b4a514 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:24:09.270858 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3d4ed-939e-4e7f-b2c3-4aecf1b4a514 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:24:09.271168 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3d4ed-939e-4e7f-b2c3-4aecf1b4a514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:24:09.292410 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2de3d4ed-939e-4e7f-b2c3-4aecf1b4a514 None None] MFA Rules not processed for user `182eec86daa44cd48d6ef1c38f58e89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:24:09.293636 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2de3d4ed-939e-4e7f-b2c3-4aecf1b4a514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:24:09.301036 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1443/2863] 10.222.0.46 () {58 vars in 967 bytes} [Wed Aug 10 13:24:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:24:09.314269 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e0c1f-9130-4634-b59f-03797d26fe3c service swift] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:24:09.325159 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e0c1f-9130-4634-b59f-03797d26fe3c service swift] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:24:09.330619 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2d3aa-676d-4e4f-9905-4fe9c5906dd0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c86ef66c9564e0395c325a84ca9c4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:24:09.331514 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2d3aa-676d-4e4f-9905-4fe9c5906dd0 service swift] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:24:09.331793 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2d3aa-676d-4e4f-9905-4fe9c5906dd0 service swift] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:24:09.332063 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2d3aa-676d-4e4f-9905-4fe9c5906dd0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:24:09.344937 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2d3aa-676d-4e4f-9905-4fe9c5906dd0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:24:09.347529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2d3aa-676d-4e4f-9905-4fe9c5906dd0 service swift] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:24:09.358138 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1421/2864] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 10 13:24:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 13:24:09.592602 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c214f-98c7-41e8-ac69-f78d2d413957 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:24:09.593136 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c214f-98c7-41e8-ac69-f78d2d413957 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:24:09.593352 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c214f-98c7-41e8-ac69-f78d2d413957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:24:09.613451 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-430c214f-98c7-41e8-ac69-f78d2d413957 None None] MFA Rules not processed for user `182eec86daa44cd48d6ef1c38f58e89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:24:09.614805 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-430c214f-98c7-41e8-ac69-f78d2d413957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:24:09.623240 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1444/2865] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 10 13:24:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:24:09.636863 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2d3aa-676d-4e4f-9905-4fe9c5906dd0 service swift] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:24:09.652192 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2d3aa-676d-4e4f-9905-4fe9c5906dd0 service swift] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:24:09.660979 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443dac13-c23d-4b28-927c-b591ad078360 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c86ef66c9564e0395c325a84ca9c4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:24:09.661740 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443dac13-c23d-4b28-927c-b591ad078360 service swift] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:24:09.662039 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443dac13-c23d-4b28-927c-b591ad078360 service swift] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:24:09.662433 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443dac13-c23d-4b28-927c-b591ad078360 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:24:09.674094 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443dac13-c23d-4b28-927c-b591ad078360 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:24:09.675267 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443dac13-c23d-4b28-927c-b591ad078360 service swift] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:24:09.686273 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1422/2866] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 10 13:24:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 13:24:10.111072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac768d-5eb5-47ba-ba51-4d627b21aa94 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:24:10.111535 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac768d-5eb5-47ba-ba51-4d627b21aa94 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:24:10.112042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac768d-5eb5-47ba-ba51-4d627b21aa94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:24:10.132563 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-24ac768d-5eb5-47ba-ba51-4d627b21aa94 None None] MFA Rules not processed for user `182eec86daa44cd48d6ef1c38f58e89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:24:10.133962 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-24ac768d-5eb5-47ba-ba51-4d627b21aa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:24:10.141871 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1445/2867] 10.222.0.46 () {58 vars in 967 bytes} [Wed Aug 10 13:24:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:24:10.156573 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443dac13-c23d-4b28-927c-b591ad078360 service swift] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:24:10.168782 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443dac13-c23d-4b28-927c-b591ad078360 service swift] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:24:10.174717 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a4b00-ca80-4b83-9306-721937fba80c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c86ef66c9564e0395c325a84ca9c4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:24:10.175358 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a4b00-ca80-4b83-9306-721937fba80c service swift] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:24:10.175811 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a4b00-ca80-4b83-9306-721937fba80c service swift] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:24:10.176250 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a4b00-ca80-4b83-9306-721937fba80c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:24:10.185244 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a4b00-ca80-4b83-9306-721937fba80c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:24:10.186844 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a4b00-ca80-4b83-9306-721937fba80c service swift] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:24:10.196094 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1423/2868] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 10 13:24:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 13:24:12.585157 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac768d-5eb5-47ba-ba51-4d627b21aa94 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:24:12.588166 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-24ac768d-5eb5-47ba-ba51-4d627b21aa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:24:12.723048 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac768d-5eb5-47ba-ba51-4d627b21aa94 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:24:12.732029 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3248f-9458-44ce-a608-d742a2054cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:24:12.732750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3248f-9458-44ce-a608-d742a2054cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:24:12.733334 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3248f-9458-44ce-a608-d742a2054cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:24:12.733621 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3248f-9458-44ce-a608-d742a2054cc8 admin admin] PATH_INFO: `/v3/users/0bffe8ff82124755821113223fd6acf6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:24:12.735168 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3248f-9458-44ce-a608-d742a2054cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bffe8ff82124755821113223fd6acf6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:24:12.737835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3248f-9458-44ce-a608-d742a2054cc8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:24:12.812851 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:24:12.818642 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-32f3248f-9458-44ce-a608-d742a2054cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bffe8ff82124755821113223fd6acf6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:24:12.819707 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-32f3248f-9458-44ce-a608-d742a2054cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bffe8ff82124755821113223fd6acf6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:24:12.832254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-32f3248f-9458-44ce-a608-d742a2054cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bffe8ff82124755821113223fd6acf6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:24:12.844842 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-32f3248f-9458-44ce-a608-d742a2054cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bffe8ff82124755821113223fd6acf6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:24:12.871917 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-32f3248f-9458-44ce-a608-d742a2054cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bffe8ff82124755821113223fd6acf6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:24:12.887243 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1446/2869] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:24:12 2022] DELETE /identity/v3/users/0bffe8ff82124755821113223fd6acf6 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:24:12.891617 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395a813-9185-417c-abfd-b3fb98f6acef None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:24:12.892631 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395a813-9185-417c-abfd-b3fb98f6acef None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:24:12.892912 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395a813-9185-417c-abfd-b3fb98f6acef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:24:12.937316 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-7395a813-9185-417c-abfd-b3fb98f6acef None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:24:12.939051 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7395a813-9185-417c-abfd-b3fb98f6acef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:24:13.011528 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1424/2870] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:24:13.022826 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3248f-9458-44ce-a608-d742a2054cc8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:24:13.024360 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-32f3248f-9458-44ce-a608-d742a2054cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:24:13.092128 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3248f-9458-44ce-a608-d742a2054cc8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:24:13.095762 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cbb15-bf18-4a46-aed0-214d7a73863f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:24:13.096376 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cbb15-bf18-4a46-aed0-214d7a73863f service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:24:13.096649 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cbb15-bf18-4a46-aed0-214d7a73863f service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:24:13.096920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cbb15-bf18-4a46-aed0-214d7a73863f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:24:13.113049 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cbb15-bf18-4a46-aed0-214d7a73863f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:24:13.115940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cbb15-bf18-4a46-aed0-214d7a73863f service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:24:13.130296 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1447/2871] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:24:13.315808 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395a813-9185-417c-abfd-b3fb98f6acef None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:24:13.317545 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7395a813-9185-417c-abfd-b3fb98f6acef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:24:13.330968 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395a813-9185-417c-abfd-b3fb98f6acef None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:24:13.336254 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5783394-c3e3-45b2-970a-59e6c9c9fe3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:24:13.336897 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5783394-c3e3-45b2-970a-59e6c9c9fe3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:24:13.337178 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5783394-c3e3-45b2-970a-59e6c9c9fe3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:24:13.337444 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5783394-c3e3-45b2-970a-59e6c9c9fe3b admin admin] PATH_INFO: `/v3/projects/83676452cb324dcb9daea09b8a6d64c0` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:24:13.338603 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5783394-c3e3-45b2-970a-59e6c9c9fe3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=83676452cb324dcb9daea09b8a6d64c0)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:24:13.340547 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5783394-c3e3-45b2-970a-59e6c9c9fe3b admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:24:13.387717 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f5783394-c3e3-45b2-970a-59e6c9c9fe3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83676452cb324dcb9daea09b8a6d64c0', 'request_id': 'req-f5783394-c3e3-45b2-970a-59e6c9c9fe3b'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:24:13.392259 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:24:13.393576 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f5783394-c3e3-45b2-970a-59e6c9c9fe3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83676452cb324dcb9daea09b8a6d64c0', 'request_id': 'req-f5783394-c3e3-45b2-970a-59e6c9c9fe3b'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:24:13.401612 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f5783394-c3e3-45b2-970a-59e6c9c9fe3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83676452cb324dcb9daea09b8a6d64c0', 'request_id': 'req-f5783394-c3e3-45b2-970a-59e6c9c9fe3b'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:24:13.412689 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f5783394-c3e3-45b2-970a-59e6c9c9fe3b admin admin] The token cache is being invalidate because project 83676452cb324dcb9daea09b8a6d64c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:24:13.412973 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f5783394-c3e3-45b2-970a-59e6c9c9fe3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:24:13.413623 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-f5783394-c3e3-45b2-970a-59e6c9c9fe3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:24:13.415706 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1425/2872] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:24:13 2022] DELETE /identity/v3/projects/83676452cb324dcb9daea09b8a6d64c0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:24:23.125765 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=4,keystone:SELECT=39,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:24:23.409647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=5,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:05.550172 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cbb15-bf18-4a46-aed0-214d7a73863f service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:25:05.552099 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f02cbb15-bf18-4a46-aed0-214d7a73863f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:25:05.642601 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cbb15-bf18-4a46-aed0-214d7a73863f service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:25:05.701468 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9287a9-fe8d-4b66-9e5e-16e0c8d4e0e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15780b69faa745e9b99f1fffb6abe231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:25:05.702075 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9287a9-fe8d-4b66-9e5e-16e0c8d4e0e1 service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:05.702357 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9287a9-fe8d-4b66-9e5e-16e0c8d4e0e1 service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:05.702630 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9287a9-fe8d-4b66-9e5e-16e0c8d4e0e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:05.704412 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fa9287a9-fe8d-4b66-9e5e-16e0c8d4e0e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:25:05.716561 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9287a9-fe8d-4b66-9e5e-16e0c8d4e0e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:25:05.718164 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9287a9-fe8d-4b66-9e5e-16e0c8d4e0e1 service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:25:05.728592 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1448/2873] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:25:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:25:15.723872 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=67 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:29.908341 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7ab72-32e9-4353-8a92-fdf54fe98e21 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:29.909083 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7ab72-32e9-4353-8a92-fdf54fe98e21 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:29.909083 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7ab72-32e9-4353-8a92-fdf54fe98e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:29.929777 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-c6e7ab72-32e9-4353-8a92-fdf54fe98e21 None None] MFA Rules not processed for user `182eec86daa44cd48d6ef1c38f58e89d`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:25:29.931628 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c6e7ab72-32e9-4353-8a92-fdf54fe98e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:25:30.014794 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1426/2874] 10.222.0.46 () {58 vars in 967 bytes} [Wed Aug 10 13:25:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:25:30.070560 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9287a9-fe8d-4b66-9e5e-16e0c8d4e0e1 service placement] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:25:30.072812 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fa9287a9-fe8d-4b66-9e5e-16e0c8d4e0e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:25:30.146866 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9287a9-fe8d-4b66-9e5e-16e0c8d4e0e1 service placement] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:25:30.152042 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266ab31-f064-462b-95f5-0e5d5958f57b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c86ef66c9564e0395c325a84ca9c4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:25:30.152647 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266ab31-f064-462b-95f5-0e5d5958f57b service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:30.152920 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266ab31-f064-462b-95f5-0e5d5958f57b service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:30.153252 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266ab31-f064-462b-95f5-0e5d5958f57b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:30.162070 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266ab31-f064-462b-95f5-0e5d5958f57b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:25:30.163745 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266ab31-f064-462b-95f5-0e5d5958f57b service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:25:30.173480 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1449/2875] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 10 13:25:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 13:25:37.287508 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7ab72-32e9-4353-8a92-fdf54fe98e21 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:25:37.290009 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-c6e7ab72-32e9-4353-8a92-fdf54fe98e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:25:37.320165 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7ab72-32e9-4353-8a92-fdf54fe98e21 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:25:37.326069 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b9221-fa8b-468b-8dc4-a757c54b2dbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15780b69faa745e9b99f1fffb6abe231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:25:37.326876 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b9221-fa8b-468b-8dc4-a757c54b2dbf service placement] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:37.327185 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b9221-fa8b-468b-8dc4-a757c54b2dbf service placement] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:37.327457 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b9221-fa8b-468b-8dc4-a757c54b2dbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:37.329183 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-f14b9221-fa8b-468b-8dc4-a757c54b2dbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:25:37.342043 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b9221-fa8b-468b-8dc4-a757c54b2dbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:25:37.343966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b9221-fa8b-468b-8dc4-a757c54b2dbf service placement] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:25:37.357882 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266ab31-f064-462b-95f5-0e5d5958f57b service swift] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:25:37.359433 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d266ab31-f064-462b-95f5-0e5d5958f57b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:25:37.361377 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1427/2876] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:25:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:25:37.432770 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266ab31-f064-462b-95f5-0e5d5958f57b service swift] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:25:37.437508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a6086-9a9f-4b9e-a79d-5a0eba4540db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:25:37.438221 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a6086-9a9f-4b9e-a79d-5a0eba4540db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:37.438569 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a6086-9a9f-4b9e-a79d-5a0eba4540db admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:37.438889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a6086-9a9f-4b9e-a79d-5a0eba4540db admin admin] PATH_INFO: `/v3/users/5ab99ccb51b24bd8864cd352f783a3c4` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:37.440084 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a6086-9a9f-4b9e-a79d-5a0eba4540db admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab99ccb51b24bd8864cd352f783a3c4)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:25:37.441990 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a6086-9a9f-4b9e-a79d-5a0eba4540db admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:25:37.491178 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-730a6086-9a9f-4b9e-a79d-5a0eba4540db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab99ccb51b24bd8864cd352f783a3c4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:25:37.491833 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-730a6086-9a9f-4b9e-a79d-5a0eba4540db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab99ccb51b24bd8864cd352f783a3c4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:25:37.499640 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-730a6086-9a9f-4b9e-a79d-5a0eba4540db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab99ccb51b24bd8864cd352f783a3c4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:25:37.507051 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-730a6086-9a9f-4b9e-a79d-5a0eba4540db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab99ccb51b24bd8864cd352f783a3c4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:25:37.519096 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-730a6086-9a9f-4b9e-a79d-5a0eba4540db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab99ccb51b24bd8864cd352f783a3c4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:25:37.525186 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1450/2877] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:25:37 2022] DELETE /identity/v3/users/5ab99ccb51b24bd8864cd352f783a3c4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:25:37.712871 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b9221-fa8b-468b-8dc4-a757c54b2dbf service placement] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:25:37.728283 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b9221-fa8b-468b-8dc4-a757c54b2dbf service placement] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:25:37.792222 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75247ec-ad52-4fcc-b886-b2ef7e148913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:25:37.792940 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75247ec-ad52-4fcc-b886-b2ef7e148913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:37.793127 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75247ec-ad52-4fcc-b886-b2ef7e148913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:37.793398 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75247ec-ad52-4fcc-b886-b2ef7e148913 admin admin] PATH_INFO: `/v3/projects/5427ae0e1803405994478571caea43b3` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:37.794526 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75247ec-ad52-4fcc-b886-b2ef7e148913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5427ae0e1803405994478571caea43b3)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:25:37.796526 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75247ec-ad52-4fcc-b886-b2ef7e148913 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:25:37.844051 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b75247ec-ad52-4fcc-b886-b2ef7e148913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5427ae0e1803405994478571caea43b3', 'request_id': 'req-b75247ec-ad52-4fcc-b886-b2ef7e148913'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:25:37.849342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b75247ec-ad52-4fcc-b886-b2ef7e148913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5427ae0e1803405994478571caea43b3', 'request_id': 'req-b75247ec-ad52-4fcc-b886-b2ef7e148913'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:25:37.857015 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b75247ec-ad52-4fcc-b886-b2ef7e148913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5427ae0e1803405994478571caea43b3', 'request_id': 'req-b75247ec-ad52-4fcc-b886-b2ef7e148913'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:25:37.868248 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b75247ec-ad52-4fcc-b886-b2ef7e148913 admin admin] The token cache is being invalidate because project 5427ae0e1803405994478571caea43b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:25:37.868531 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b75247ec-ad52-4fcc-b886-b2ef7e148913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:25:37.869180 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-b75247ec-ad52-4fcc-b886-b2ef7e148913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:25:37.870846 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1428/2878] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:25:37 2022] DELETE /identity/v3/projects/5427ae0e1803405994478571caea43b3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:25:37.874647 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a6086-9a9f-4b9e-a79d-5a0eba4540db admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:25:37.876066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-730a6086-9a9f-4b9e-a79d-5a0eba4540db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:25:37.888911 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a6086-9a9f-4b9e-a79d-5a0eba4540db admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:25:37.893479 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:37.946019 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82418a-7cd2-45a0-940b-214f291653af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:25:37.946658 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82418a-7cd2-45a0-940b-214f291653af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:37.946935 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82418a-7cd2-45a0-940b-214f291653af admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:37.947231 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82418a-7cd2-45a0-940b-214f291653af admin admin] PATH_INFO: `/v3/users/22d75e475c874c9eb0aa9a0dc2d6cdb8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:37.948342 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82418a-7cd2-45a0-940b-214f291653af admin admin] RBAC: Authorizing `identity:delete_user(user_id=22d75e475c874c9eb0aa9a0dc2d6cdb8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:25:37.950238 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82418a-7cd2-45a0-940b-214f291653af admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:25:37.998604 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4e82418a-7cd2-45a0-940b-214f291653af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22d75e475c874c9eb0aa9a0dc2d6cdb8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:25:37.999296 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4e82418a-7cd2-45a0-940b-214f291653af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22d75e475c874c9eb0aa9a0dc2d6cdb8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:25:38.006579 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4e82418a-7cd2-45a0-940b-214f291653af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22d75e475c874c9eb0aa9a0dc2d6cdb8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:25:38.014420 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4e82418a-7cd2-45a0-940b-214f291653af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22d75e475c874c9eb0aa9a0dc2d6cdb8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:25:38.026948 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4e82418a-7cd2-45a0-940b-214f291653af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22d75e475c874c9eb0aa9a0dc2d6cdb8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:25:38.033308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1451/2879] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:25:37 2022] DELETE /identity/v3/users/22d75e475c874c9eb0aa9a0dc2d6cdb8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:25:38.213674 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75247ec-ad52-4fcc-b886-b2ef7e148913 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:25:38.215486 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-b75247ec-ad52-4fcc-b886-b2ef7e148913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:25:38.231275 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75247ec-ad52-4fcc-b886-b2ef7e148913 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:25:38.253475 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:38.302173 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd30e0-3dfe-43b6-a519-ad57944ed63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:25:38.302933 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd30e0-3dfe-43b6-a519-ad57944ed63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:38.303094 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd30e0-3dfe-43b6-a519-ad57944ed63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:38.303358 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd30e0-3dfe-43b6-a519-ad57944ed63d admin admin] PATH_INFO: `/v3/projects/0a9625b02e1e4aaeac2de08168e21004` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:38.304510 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd30e0-3dfe-43b6-a519-ad57944ed63d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a9625b02e1e4aaeac2de08168e21004)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:25:38.307181 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd30e0-3dfe-43b6-a519-ad57944ed63d admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:25:38.356310 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3acd30e0-3dfe-43b6-a519-ad57944ed63d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a9625b02e1e4aaeac2de08168e21004', 'request_id': 'req-3acd30e0-3dfe-43b6-a519-ad57944ed63d'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:25:38.362622 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3acd30e0-3dfe-43b6-a519-ad57944ed63d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a9625b02e1e4aaeac2de08168e21004', 'request_id': 'req-3acd30e0-3dfe-43b6-a519-ad57944ed63d'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:25:38.371352 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3acd30e0-3dfe-43b6-a519-ad57944ed63d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a9625b02e1e4aaeac2de08168e21004', 'request_id': 'req-3acd30e0-3dfe-43b6-a519-ad57944ed63d'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:25:38.383697 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3acd30e0-3dfe-43b6-a519-ad57944ed63d admin admin] The token cache is being invalidate because project 0a9625b02e1e4aaeac2de08168e21004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:25:38.384057 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3acd30e0-3dfe-43b6-a519-ad57944ed63d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:25:38.384823 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-3acd30e0-3dfe-43b6-a519-ad57944ed63d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:25:38.386254 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1429/2880] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:25:38 2022] DELETE /identity/v3/projects/0a9625b02e1e4aaeac2de08168e21004 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:25:38.391365 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a828ff6-4aed-4729-b9b9-3dcd9f851f13 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:38.391886 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a828ff6-4aed-4729-b9b9-3dcd9f851f13 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:38.392206 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a828ff6-4aed-4729-b9b9-3dcd9f851f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:38.442233 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8a828ff6-4aed-4729-b9b9-3dcd9f851f13 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:25:38.443486 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8a828ff6-4aed-4729-b9b9-3dcd9f851f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:25:38.506966 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1452/2881] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:25:38.515373 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ac1fe-16bd-4d6d-a5cb-71f10319b83b None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:38.515661 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ac1fe-16bd-4d6d-a5cb-71f10319b83b None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:38.515935 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ac1fe-16bd-4d6d-a5cb-71f10319b83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:38.536014 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-7d4ac1fe-16bd-4d6d-a5cb-71f10319b83b None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:25:38.537217 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-7d4ac1fe-16bd-4d6d-a5cb-71f10319b83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:25:38.547152 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1430/2882] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:25:38.551456 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a828ff6-4aed-4729-b9b9-3dcd9f851f13 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:25:38.558047 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:38.561929 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a828ff6-4aed-4729-b9b9-3dcd9f851f13 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:25:38.568004 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0b959-8a5b-4c4b-bf58-ec8ddf224f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:25:38.568789 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0b959-8a5b-4c4b-bf58-ec8ddf224f9a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:38.569224 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0b959-8a5b-4c4b-bf58-ec8ddf224f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:38.569664 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0b959-8a5b-4c4b-bf58-ec8ddf224f9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:38.570312 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0b959-8a5b-4c4b-bf58-ec8ddf224f9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 13:25:38.570613 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0b959-8a5b-4c4b-bf58-ec8ddf224f9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:25:38.572818 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0b959-8a5b-4c4b-bf58-ec8ddf224f9a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:25:38.584569 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1453/2883] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 10 13:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 13:25:38.589098 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ac1fe-16bd-4d6d-a5cb-71f10319b83b None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:25:38.598329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ac1fe-16bd-4d6d-a5cb-71f10319b83b None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:25:38.602938 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31eeaf2-03fb-4283-b658-0c2478e3f812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:25:38.603570 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31eeaf2-03fb-4283-b658-0c2478e3f812 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:38.603847 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31eeaf2-03fb-4283-b658-0c2478e3f812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:38.604117 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31eeaf2-03fb-4283-b658-0c2478e3f812 admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:38.604750 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31eeaf2-03fb-4283-b658-0c2478e3f812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:25:38.606668 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31eeaf2-03fb-4283-b658-0c2478e3f812 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:25:38.635239 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1431/2884] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:25:38 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:25:38.639379 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0b959-8a5b-4c4b-bf58-ec8ddf224f9a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:25:38.649578 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0b959-8a5b-4c4b-bf58-ec8ddf224f9a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:25:38.703904 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e79c65-c7b9-461d-b79b-20bd658a1542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:25:38.704503 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e79c65-c7b9-461d-b79b-20bd658a1542 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:38.705088 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e79c65-c7b9-461d-b79b-20bd658a1542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:38.705368 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e79c65-c7b9-461d-b79b-20bd658a1542 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:38.705980 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e79c65-c7b9-461d-b79b-20bd658a1542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:25:38.707940 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e79c65-c7b9-461d-b79b-20bd658a1542 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:25:38.728409 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1454/2885] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:25:38 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:25:38.732786 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31eeaf2-03fb-4283-b658-0c2478e3f812 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:25:38.745342 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31eeaf2-03fb-4283-b658-0c2478e3f812 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:25:38.750379 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61440b2-2d70-41aa-9ef4-20a0d770cd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:25:38.751045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61440b2-2d70-41aa-9ef4-20a0d770cd28 admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:38.751323 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61440b2-2d70-41aa-9ef4-20a0d770cd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:38.751595 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61440b2-2d70-41aa-9ef4-20a0d770cd28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:38.752243 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61440b2-2d70-41aa-9ef4-20a0d770cd28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:25:38.753898 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61440b2-2d70-41aa-9ef4-20a0d770cd28 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:25:38.765232 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1432/2886] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:25:38.769245 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e79c65-c7b9-461d-b79b-20bd658a1542 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:25:38.779752 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e79c65-c7b9-461d-b79b-20bd658a1542 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:25:38.784984 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b39fd8-c438-4eb8-b853-8cae5dac04dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:25:38.785597 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b39fd8-c438-4eb8-b853-8cae5dac04dd admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:38.785889 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b39fd8-c438-4eb8-b853-8cae5dac04dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:38.786156 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b39fd8-c438-4eb8-b853-8cae5dac04dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:38.786801 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b39fd8-c438-4eb8-b853-8cae5dac04dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:25:38.788450 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b39fd8-c438-4eb8-b853-8cae5dac04dd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:25:38.811031 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1455/2887] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:25:38.817495 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61440b2-2d70-41aa-9ef4-20a0d770cd28 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:25:38.832002 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61440b2-2d70-41aa-9ef4-20a0d770cd28 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:25:38.837195 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fb579-d84d-423f-8565-eeaf058c64a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:25:38.837865 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fb579-d84d-423f-8565-eeaf058c64a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:38.838140 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fb579-d84d-423f-8565-eeaf058c64a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:38.838410 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fb579-d84d-423f-8565-eeaf058c64a3 admin admin] PATH_INFO: `/v3/projects/ecf7a41897494ba6b3e0007a59707e67/users/4b3b109457964a7cb1cd599cf95464e0/roles/2223c0caa0c948abbe85384d16a465a2` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:38.856812 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fb579-d84d-423f-8565-eeaf058c64a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf7a41897494ba6b3e0007a59707e67, user_id=4b3b109457964a7cb1cd599cf95464e0, role_id=2223c0caa0c948abbe85384d16a465a2)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:25:38.860892 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fb579-d84d-423f-8565-eeaf058c64a3 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:25:38.876821 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1433/2888] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:25:38 2022] PUT /identity/v3/projects/ecf7a41897494ba6b3e0007a59707e67/users/4b3b109457964a7cb1cd599cf95464e0/roles/2223c0caa0c948abbe85384d16a465a2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:25:38.882281 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524676e7-c247-461b-8aa0-f489053ca2c2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:38.882590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524676e7-c247-461b-8aa0-f489053ca2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:38.882865 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524676e7-c247-461b-8aa0-f489053ca2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:38.902041 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-524676e7-c247-461b-8aa0-f489053ca2c2 None None] MFA Rules not processed for user `1ade4cba44f6449e9916b370e369e98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:25:38.903229 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-524676e7-c247-461b-8aa0-f489053ca2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:25:38.962475 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1456/2889] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:25:38.972013 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fb579-d84d-423f-8565-eeaf058c64a3 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:25:38.973724 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-b71fb579-d84d-423f-8565-eeaf058c64a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:25:39.032603 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:39.059723 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fb579-d84d-423f-8565-eeaf058c64a3 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:25:39.063399 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd23c30-709c-43d2-b0b4-3fbeecb691a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:25:39.063992 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd23c30-709c-43d2-b0b4-3fbeecb691a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:39.064269 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd23c30-709c-43d2-b0b4-3fbeecb691a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:39.064537 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd23c30-709c-43d2-b0b4-3fbeecb691a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:39.073647 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd23c30-709c-43d2-b0b4-3fbeecb691a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:25:39.075560 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd23c30-709c-43d2-b0b4-3fbeecb691a1 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:25:39.086898 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1434/2890] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:25:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:25:43.314399 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f70e96-d712-408e-8e18-7fe5f2527181 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:43.314947 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f70e96-d712-408e-8e18-7fe5f2527181 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:43.314947 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f70e96-d712-408e-8e18-7fe5f2527181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:43.348147 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f0f70e96-d712-408e-8e18-7fe5f2527181 None None] MFA Rules not processed for user `4b3b109457964a7cb1cd599cf95464e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:25:43.349646 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f0f70e96-d712-408e-8e18-7fe5f2527181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:25:43.426031 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:43.430750 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1457/2891] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:25:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:25:43.435331 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd23c30-709c-43d2-b0b4-3fbeecb691a1 service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:25:43.445478 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd23c30-709c-43d2-b0b4-3fbeecb691a1 service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:25:43.450966 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d618e38-ec56-4877-bdd3-674daa5f06f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:25:43.451612 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d618e38-ec56-4877-bdd3-674daa5f06f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:43.451894 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d618e38-ec56-4877-bdd3-674daa5f06f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:43.452166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d618e38-ec56-4877-bdd3-674daa5f06f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:43.452942 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d618e38-ec56-4877-bdd3-674daa5f06f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:25:43.454709 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d618e38-ec56-4877-bdd3-674daa5f06f9 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:25:43.489870 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1435/2892] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 10 13:25:43 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:25:43.494025 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f70e96-d712-408e-8e18-7fe5f2527181 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:25:43.505678 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f70e96-d712-408e-8e18-7fe5f2527181 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:25:43.575534 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62077d-9fa4-4c16-a1a3-17a5e3383839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:25:43.576150 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62077d-9fa4-4c16-a1a3-17a5e3383839 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:43.576453 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62077d-9fa4-4c16-a1a3-17a5e3383839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:43.576725 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62077d-9fa4-4c16-a1a3-17a5e3383839 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:43.577375 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62077d-9fa4-4c16-a1a3-17a5e3383839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:25:43.579364 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62077d-9fa4-4c16-a1a3-17a5e3383839 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:25:43.602680 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1458/2893] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 10 13:25:43 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 13:25:43.607074 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d618e38-ec56-4877-bdd3-674daa5f06f9 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:25:43.617816 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d618e38-ec56-4877-bdd3-674daa5f06f9 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:25:43.622713 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00384daf-1a47-445a-8ddf-5ed49bb27e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:25:43.623420 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00384daf-1a47-445a-8ddf-5ed49bb27e8f admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:43.623701 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00384daf-1a47-445a-8ddf-5ed49bb27e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:43.623975 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00384daf-1a47-445a-8ddf-5ed49bb27e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:43.624632 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00384daf-1a47-445a-8ddf-5ed49bb27e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:25:43.626258 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00384daf-1a47-445a-8ddf-5ed49bb27e8f admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:25:43.638567 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1436/2894] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 13:25:43.642777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62077d-9fa4-4c16-a1a3-17a5e3383839 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:25:43.653949 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62077d-9fa4-4c16-a1a3-17a5e3383839 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:25:43.658748 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e12fde-1c07-47f2-96d5-b5115fcbf78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:25:43.659471 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e12fde-1c07-47f2-96d5-b5115fcbf78c admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:43.659752 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e12fde-1c07-47f2-96d5-b5115fcbf78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:43.660025 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e12fde-1c07-47f2-96d5-b5115fcbf78c admin admin] PATH_INFO: `/v3/projects/85f2f022dd194968ac40c7313c50d2a8/users/5433c6b214c94a07b406ab1a5c28a9be/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:43.675158 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e12fde-1c07-47f2-96d5-b5115fcbf78c admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f2f022dd194968ac40c7313c50d2a8, user_id=5433c6b214c94a07b406ab1a5c28a9be, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:25:43.678030 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e12fde-1c07-47f2-96d5-b5115fcbf78c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:25:43.693053 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1459/2895] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:25:43 2022] PUT /identity/v3/projects/85f2f022dd194968ac40c7313c50d2a8/users/5433c6b214c94a07b406ab1a5c28a9be/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:25:43.697553 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00384daf-1a47-445a-8ddf-5ed49bb27e8f admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:25:43.709082 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00384daf-1a47-445a-8ddf-5ed49bb27e8f admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:25:43.767989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadce712-0a13-4079-a7ea-7e84fd20f73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:25:43.768589 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadce712-0a13-4079-a7ea-7e84fd20f73e admin admin] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:43.768868 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadce712-0a13-4079-a7ea-7e84fd20f73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:43.769134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadce712-0a13-4079-a7ea-7e84fd20f73e admin admin] PATH_INFO: `/v3/roles` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:43.769758 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadce712-0a13-4079-a7ea-7e84fd20f73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:25:43.771372 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadce712-0a13-4079-a7ea-7e84fd20f73e admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:25:43.781631 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1437/2896] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 10 13:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 13:25:43.785928 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e12fde-1c07-47f2-96d5-b5115fcbf78c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:25:43.796013 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e12fde-1c07-47f2-96d5-b5115fcbf78c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:25:43.800835 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041e281-483e-48b3-8af7-7f5a6d1ea7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:25:43.801508 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041e281-483e-48b3-8af7-7f5a6d1ea7bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:43.801793 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041e281-483e-48b3-8af7-7f5a6d1ea7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:43.802066 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041e281-483e-48b3-8af7-7f5a6d1ea7bd admin admin] PATH_INFO: `/v3/projects/85f2f022dd194968ac40c7313c50d2a8/users/5433c6b214c94a07b406ab1a5c28a9be/roles/d9c9200468cb4f7ab6a23882bfb1f062` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:43.804008 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041e281-483e-48b3-8af7-7f5a6d1ea7bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f2f022dd194968ac40c7313c50d2a8, user_id=5433c6b214c94a07b406ab1a5c28a9be, role_id=d9c9200468cb4f7ab6a23882bfb1f062)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:25:43.807374 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041e281-483e-48b3-8af7-7f5a6d1ea7bd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:25:43.817461 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1460/2897] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 10 13:25:43 2022] PUT /identity/v3/projects/85f2f022dd194968ac40c7313c50d2a8/users/5433c6b214c94a07b406ab1a5c28a9be/roles/d9c9200468cb4f7ab6a23882bfb1f062 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:25:48.300346 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c4ebe-4ea4-467b-959e-bba5b15abda8 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:48.300877 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c4ebe-4ea4-467b-959e-bba5b15abda8 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:48.301173 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c4ebe-4ea4-467b-959e-bba5b15abda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:48.355682 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-a13c4ebe-4ea4-467b-959e-bba5b15abda8 None None] MFA Rules not processed for user `5433c6b214c94a07b406ab1a5c28a9be`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:25:48.357010 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-a13c4ebe-4ea4-467b-959e-bba5b15abda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:25:48.462501 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1438/2898] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:25:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:25:48.479742 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041e281-483e-48b3-8af7-7f5a6d1ea7bd admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:25:48.481776 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8041e281-483e-48b3-8af7-7f5a6d1ea7bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:25:48.608050 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041e281-483e-48b3-8af7-7f5a6d1ea7bd admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:25:48.612690 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db5f6b-07d4-43eb-8d88-e90e12483be6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:25:48.613315 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db5f6b-07d4-43eb-8d88-e90e12483be6 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:48.613590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db5f6b-07d4-43eb-8d88-e90e12483be6 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:48.613853 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db5f6b-07d4-43eb-8d88-e90e12483be6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:48.648777 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:25:48.687896 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db5f6b-07d4-43eb-8d88-e90e12483be6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:25:48.689520 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db5f6b-07d4-43eb-8d88-e90e12483be6 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:25:48.700053 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1461/2899] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:25:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:25:50.745884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310c09b-4c73-4e54-b4be-da6ccc028c61 None None] REQUEST_METHOD: `POST` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:25:50.746421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310c09b-4c73-4e54-b4be-da6ccc028c61 None None] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:25:50.746421 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310c09b-4c73-4e54-b4be-da6ccc028c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:25:50.768425 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.auth.core [None req-1310c09b-4c73-4e54-b4be-da6ccc028c61 None None] MFA Rules not processed for user `4b3b109457964a7cb1cd599cf95464e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 13:25:50.769792 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-1310c09b-4c73-4e54-b4be-da6ccc028c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:25:50.777128 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1439/2900] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 10 13:25:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 13:25:58.695254 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=14 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:00.762669 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:03.952064 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db5f6b-07d4-43eb-8d88-e90e12483be6 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:26:03.953572 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e6db5f6b-07d4-43eb-8d88-e90e12483be6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:26:04.043741 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db5f6b-07d4-43eb-8d88-e90e12483be6 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:26:04.047846 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62f047-1dea-4509-803e-c5aba037aa5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad44decbbaee4d11ac076220bb9c7f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:26:04.048457 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62f047-1dea-4509-803e-c5aba037aa5c service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:26:04.048737 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62f047-1dea-4509-803e-c5aba037aa5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:26:04.049006 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62f047-1dea-4509-803e-c5aba037aa5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:26:04.050734 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dc62f047-1dea-4509-803e-c5aba037aa5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:26:04.064639 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc62f047-1dea-4509-803e-c5aba037aa5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:26:04.066076 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc62f047-1dea-4509-803e-c5aba037aa5c service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:26:04.077429 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1462/2901] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:26:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:26:04.847261 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310c09b-4c73-4e54-b4be-da6ccc028c61 None None] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:26:04.849292 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-1310c09b-4c73-4e54-b4be-da6ccc028c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:26:04.925722 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310c09b-4c73-4e54-b4be-da6ccc028c61 None None] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:26:04.929467 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170526c-3570-47c4-9f54-c5f16a4e7daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:26:04.930267 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170526c-3570-47c4-9f54-c5f16a4e7daf service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:26:04.930550 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170526c-3570-47c4-9f54-c5f16a4e7daf service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:26:04.930881 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170526c-3570-47c4-9f54-c5f16a4e7daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:26:04.932862 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-f170526c-3570-47c4-9f54-c5f16a4e7daf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:26:04.948680 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170526c-3570-47c4-9f54-c5f16a4e7daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:26:04.950123 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170526c-3570-47c4-9f54-c5f16a4e7daf service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:26:04.962365 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1440/2902] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:26:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:26:14.072052 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=35 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:14.635867 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62f047-1dea-4509-803e-c5aba037aa5c service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:26:14.647554 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62f047-1dea-4509-803e-c5aba037aa5c service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:26:14.651046 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d547f-d08e-4000-bef9-84c850ce77b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:26:14.651640 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d547f-d08e-4000-bef9-84c850ce77b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:26:14.651913 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d547f-d08e-4000-bef9-84c850ce77b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:26:14.652175 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d547f-d08e-4000-bef9-84c850ce77b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:26:14.660786 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d547f-d08e-4000-bef9-84c850ce77b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:26:14.662205 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d547f-d08e-4000-bef9-84c850ce77b0 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:26:14.671523 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1463/2903] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:26:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:26:14.956733 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=26 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:24.667308 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=6 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:27:07.241133 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170526c-3570-47c4-9f54-c5f16a4e7daf service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:27:07.251920 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170526c-3570-47c4-9f54-c5f16a4e7daf service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:27:07.256517 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0cf84-4fe9-494e-ab04-23bd41b938c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:27:07.257113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0cf84-4fe9-494e-ab04-23bd41b938c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:27:07.257387 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0cf84-4fe9-494e-ab04-23bd41b938c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:27:07.257655 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0cf84-4fe9-494e-ab04-23bd41b938c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:27:07.259425 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-07a0cf84-4fe9-494e-ab04-23bd41b938c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:27:07.269730 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0cf84-4fe9-494e-ab04-23bd41b938c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:27:07.271155 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0cf84-4fe9-494e-ab04-23bd41b938c8 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:27:07.279060 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1441/2904] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:27:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:27:17.275479 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=6 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:28:23.855141 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d547f-d08e-4000-bef9-84c850ce77b0 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:28:23.872603 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d547f-d08e-4000-bef9-84c850ce77b0 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:28:23.877287 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9453e3c-0cb8-4498-b9a4-8079ca60a37c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:28:23.877897 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9453e3c-0cb8-4498-b9a4-8079ca60a37c service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:28:23.878260 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9453e3c-0cb8-4498-b9a4-8079ca60a37c service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:28:23.878530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9453e3c-0cb8-4498-b9a4-8079ca60a37c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:28:23.880296 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a9453e3c-0cb8-4498-b9a4-8079ca60a37c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:28:23.893590 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9453e3c-0cb8-4498-b9a4-8079ca60a37c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:28:23.895057 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9453e3c-0cb8-4498-b9a4-8079ca60a37c service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:28:23.905843 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1464/2905] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:28:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:28:23.984284 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0cf84-4fe9-494e-ab04-23bd41b938c8 service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:28:23.996400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0cf84-4fe9-494e-ab04-23bd41b938c8 service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:28:24.000134 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee8c8c-7dfc-4f2f-90c9-9f7bc7a7a804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49b69dad00934ce78cbede99f976439f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:28:24.000760 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee8c8c-7dfc-4f2f-90c9-9f7bc7a7a804 service neutron] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:28:24.001578 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee8c8c-7dfc-4f2f-90c9-9f7bc7a7a804 service neutron] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:28:24.001850 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee8c8c-7dfc-4f2f-90c9-9f7bc7a7a804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:28:24.003631 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-58ee8c8c-7dfc-4f2f-90c9-9f7bc7a7a804 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:28:24.017748 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee8c8c-7dfc-4f2f-90c9-9f7bc7a7a804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:28:24.019184 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee8c8c-7dfc-4f2f-90c9-9f7bc7a7a804 service neutron] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:28:24.030765 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1442/2906] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:28:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:28:24.094657 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9453e3c-0cb8-4498-b9a4-8079ca60a37c service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:28:24.096400 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a9453e3c-0cb8-4498-b9a4-8079ca60a37c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:28:24.164838 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9453e3c-0cb8-4498-b9a4-8079ca60a37c service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:28:24.169806 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9a928-247b-43d4-baf1-50d6cc1182f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15780b69faa745e9b99f1fffb6abe231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:28:24.170408 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9a928-247b-43d4-baf1-50d6cc1182f4 service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:28:24.170687 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9a928-247b-43d4-baf1-50d6cc1182f4 service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:28:24.170958 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9a928-247b-43d4-baf1-50d6cc1182f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:28:24.172701 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-afb9a928-247b-43d4-baf1-50d6cc1182f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:28:24.184272 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9a928-247b-43d4-baf1-50d6cc1182f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:28:24.185874 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9a928-247b-43d4-baf1-50d6cc1182f4 service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:28:24.197122 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1465/2907] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:28:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:28:25.270717 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee8c8c-7dfc-4f2f-90c9-9f7bc7a7a804 service neutron] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:28:25.273593 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-58ee8c8c-7dfc-4f2f-90c9-9f7bc7a7a804 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:28:25.295463 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee8c8c-7dfc-4f2f-90c9-9f7bc7a7a804 service neutron] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:28:25.301329 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb6432-1b2f-4e0d-a3ae-98710239626a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:28:25.301935 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb6432-1b2f-4e0d-a3ae-98710239626a service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:28:25.302203 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb6432-1b2f-4e0d-a3ae-98710239626a service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:28:25.303437 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb6432-1b2f-4e0d-a3ae-98710239626a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:28:25.304263 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-afdb6432-1b2f-4e0d-a3ae-98710239626a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:28:25.319740 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb6432-1b2f-4e0d-a3ae-98710239626a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:28:25.321334 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb6432-1b2f-4e0d-a3ae-98710239626a service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:28:25.333672 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1443/2908] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:28:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:28:34.192633 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=38 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:28:35.327969 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=12 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:41.574090 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9a928-247b-43d4-baf1-50d6cc1182f4 service placement] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:29:41.592921 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9a928-247b-43d4-baf1-50d6cc1182f4 service placement] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:29:41.599235 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71208b-485b-4a20-919f-28e8f3825cf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:29:41.599951 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71208b-485b-4a20-919f-28e8f3825cf9 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:29:41.600225 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71208b-485b-4a20-919f-28e8f3825cf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:29:41.600513 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71208b-485b-4a20-919f-28e8f3825cf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:29:41.602711 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6c71208b-485b-4a20-919f-28e8f3825cf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:29:41.616953 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71208b-485b-4a20-919f-28e8f3825cf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:29:41.618923 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71208b-485b-4a20-919f-28e8f3825cf9 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:29:41.635366 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1466/2909] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:29:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:29:43.842208 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb6432-1b2f-4e0d-a3ae-98710239626a service nova] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:29:43.856249 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb6432-1b2f-4e0d-a3ae-98710239626a service nova] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:29:43.863527 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008f9d7-e9e2-4981-8729-18b4ff99f46a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fd0f76f24ea481191dfd65fff2376af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:29:43.864400 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008f9d7-e9e2-4981-8729-18b4ff99f46a service nova] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:29:43.864682 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008f9d7-e9e2-4981-8729-18b4ff99f46a service nova] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:29:43.864999 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008f9d7-e9e2-4981-8729-18b4ff99f46a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:29:43.867030 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-e008f9d7-e9e2-4981-8729-18b4ff99f46a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:29:43.880522 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008f9d7-e9e2-4981-8729-18b4ff99f46a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:29:43.882455 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008f9d7-e9e2-4981-8729-18b4ff99f46a service nova] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:29:43.894704 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1444/2910] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:29:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 13:29:48.476783 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71208b-485b-4a20-919f-28e8f3825cf9 service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:29:48.495620 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71208b-485b-4a20-919f-28e8f3825cf9 service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:29:48.505194 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8de26e-5e1f-4edc-aae3-de1c0e5c771c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15780b69faa745e9b99f1fffb6abe231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:29:48.505813 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8de26e-5e1f-4edc-aae3-de1c0e5c771c service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:29:48.506095 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8de26e-5e1f-4edc-aae3-de1c0e5c771c service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:29:48.506369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8de26e-5e1f-4edc-aae3-de1c0e5c771c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:29:48.508936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9a8de26e-5e1f-4edc-aae3-de1c0e5c771c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:29:48.522650 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8de26e-5e1f-4edc-aae3-de1c0e5c771c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:29:48.524610 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8de26e-5e1f-4edc-aae3-de1c0e5c771c service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:29:48.536326 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1467/2911] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:29:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:29:52.207921 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008f9d7-e9e2-4981-8729-18b4ff99f46a service nova] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:29:52.274477 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008f9d7-e9e2-4981-8729-18b4ff99f46a service nova] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:29:52.279259 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e911635-e5bc-4edc-9262-d6c43c4b8bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:29:52.279883 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e911635-e5bc-4edc-9262-d6c43c4b8bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:29:52.280157 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e911635-e5bc-4edc-9262-d6c43c4b8bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:29:52.280426 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e911635-e5bc-4edc-9262-d6c43c4b8bd6 admin admin] PATH_INFO: `/v3/users/4b3b109457964a7cb1cd599cf95464e0` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:29:52.281641 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e911635-e5bc-4edc-9262-d6c43c4b8bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b3b109457964a7cb1cd599cf95464e0)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:29:52.284081 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e911635-e5bc-4edc-9262-d6c43c4b8bd6 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:29:52.331294 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-2e911635-e5bc-4edc-9262-d6c43c4b8bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b3b109457964a7cb1cd599cf95464e0'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:29:52.331884 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-2e911635-e5bc-4edc-9262-d6c43c4b8bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b3b109457964a7cb1cd599cf95464e0'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:29:52.340446 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-2e911635-e5bc-4edc-9262-d6c43c4b8bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b3b109457964a7cb1cd599cf95464e0'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:29:52.348816 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-2e911635-e5bc-4edc-9262-d6c43c4b8bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b3b109457964a7cb1cd599cf95464e0'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:29:52.360878 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-2e911635-e5bc-4edc-9262-d6c43c4b8bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b3b109457964a7cb1cd599cf95464e0'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:29:52.367464 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1445/2912] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:29:52 2022] DELETE /identity/v3/users/4b3b109457964a7cb1cd599cf95464e0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:29:52.549520 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8de26e-5e1f-4edc-aae3-de1c0e5c771c service placement] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:29:52.562182 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8de26e-5e1f-4edc-aae3-de1c0e5c771c service placement] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:29:52.622072 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5726ff7-185a-4c95-9deb-162bafea094a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:29:52.622618 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5726ff7-185a-4c95-9deb-162bafea094a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:29:52.622898 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5726ff7-185a-4c95-9deb-162bafea094a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:29:52.623211 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5726ff7-185a-4c95-9deb-162bafea094a admin admin] PATH_INFO: `/v3/projects/ecf7a41897494ba6b3e0007a59707e67` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:29:52.624366 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5726ff7-185a-4c95-9deb-162bafea094a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecf7a41897494ba6b3e0007a59707e67)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:29:52.626271 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5726ff7-185a-4c95-9deb-162bafea094a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:29:52.674672 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c5726ff7-185a-4c95-9deb-162bafea094a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecf7a41897494ba6b3e0007a59707e67', 'request_id': 'req-c5726ff7-185a-4c95-9deb-162bafea094a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:29:52.682499 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c5726ff7-185a-4c95-9deb-162bafea094a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecf7a41897494ba6b3e0007a59707e67', 'request_id': 'req-c5726ff7-185a-4c95-9deb-162bafea094a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:29:52.688936 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c5726ff7-185a-4c95-9deb-162bafea094a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecf7a41897494ba6b3e0007a59707e67', 'request_id': 'req-c5726ff7-185a-4c95-9deb-162bafea094a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:29:52.700336 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c5726ff7-185a-4c95-9deb-162bafea094a admin admin] The token cache is being invalidate because project ecf7a41897494ba6b3e0007a59707e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:29:52.700622 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c5726ff7-185a-4c95-9deb-162bafea094a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:29:52.701369 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c5726ff7-185a-4c95-9deb-162bafea094a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:29:52.702861 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1468/2913] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:29:52 2022] DELETE /identity/v3/projects/ecf7a41897494ba6b3e0007a59707e67 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:29:52.707705 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e911635-e5bc-4edc-9262-d6c43c4b8bd6 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:29:52.709118 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-2e911635-e5bc-4edc-9262-d6c43c4b8bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:29:52.722874 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e911635-e5bc-4edc-9262-d6c43c4b8bd6 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:29:52.779941 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a0cd7-5dd7-4954-92b6-f871c4a40245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:29:52.780601 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a0cd7-5dd7-4954-92b6-f871c4a40245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:29:52.780894 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a0cd7-5dd7-4954-92b6-f871c4a40245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:29:52.781166 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a0cd7-5dd7-4954-92b6-f871c4a40245 admin admin] PATH_INFO: `/v3/users/5433c6b214c94a07b406ab1a5c28a9be` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:29:52.782336 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a0cd7-5dd7-4954-92b6-f871c4a40245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5433c6b214c94a07b406ab1a5c28a9be)` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:29:52.784853 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a0cd7-5dd7-4954-92b6-f871c4a40245 admin admin] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:29:52.790529 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:52.839334 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-455a0cd7-5dd7-4954-92b6-f871c4a40245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5433c6b214c94a07b406ab1a5c28a9be'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:29:52.839989 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-455a0cd7-5dd7-4954-92b6-f871c4a40245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5433c6b214c94a07b406ab1a5c28a9be'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:29:52.847636 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-455a0cd7-5dd7-4954-92b6-f871c4a40245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5433c6b214c94a07b406ab1a5c28a9be'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:29:52.854890 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-455a0cd7-5dd7-4954-92b6-f871c4a40245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5433c6b214c94a07b406ab1a5c28a9be'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:29:52.866734 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.notifications [None req-455a0cd7-5dd7-4954-92b6-f871c4a40245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5433c6b214c94a07b406ab1a5c28a9be'} {{(pid=80297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:29:52.872820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1446/2914] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 10 13:29:52 2022] DELETE /identity/v3/users/5433c6b214c94a07b406ab1a5c28a9be => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 13:29:53.049613 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5726ff7-185a-4c95-9deb-162bafea094a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:29:53.051112 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c5726ff7-185a-4c95-9deb-162bafea094a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:29:53.066025 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5726ff7-185a-4c95-9deb-162bafea094a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:29:53.128891 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd41af-4a07-4fec-9fbc-baa7730dccc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ade4cba44f6449e9916b370e369e98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5ada6b0d15453089d18d03b8cafc46', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:29:53.129437 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd41af-4a07-4fec-9fbc-baa7730dccc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:29:53.129718 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd41af-4a07-4fec-9fbc-baa7730dccc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:29:53.129989 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd41af-4a07-4fec-9fbc-baa7730dccc9 admin admin] PATH_INFO: `/v3/projects/85f2f022dd194968ac40c7313c50d2a8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:29:53.131187 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd41af-4a07-4fec-9fbc-baa7730dccc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85f2f022dd194968ac40c7313c50d2a8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:29:53.133128 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd41af-4a07-4fec-9fbc-baa7730dccc9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:29:53.140058 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:29:53.194105 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7cdd41af-4a07-4fec-9fbc-baa7730dccc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85f2f022dd194968ac40c7313c50d2a8', 'request_id': 'req-7cdd41af-4a07-4fec-9fbc-baa7730dccc9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:29:53.203441 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7cdd41af-4a07-4fec-9fbc-baa7730dccc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85f2f022dd194968ac40c7313c50d2a8', 'request_id': 'req-7cdd41af-4a07-4fec-9fbc-baa7730dccc9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:29:53.211143 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7cdd41af-4a07-4fec-9fbc-baa7730dccc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85f2f022dd194968ac40c7313c50d2a8', 'request_id': 'req-7cdd41af-4a07-4fec-9fbc-baa7730dccc9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:29:53.221530 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7cdd41af-4a07-4fec-9fbc-baa7730dccc9 admin admin] The token cache is being invalidate because project 85f2f022dd194968ac40c7313c50d2a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 13:29:53.221801 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7cdd41af-4a07-4fec-9fbc-baa7730dccc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:29:53.222446 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7cdd41af-4a07-4fec-9fbc-baa7730dccc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 13:29:53.223945 dv-cinder-836027-5-smb devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1469/2915] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 10 13:29:53 2022] DELETE /identity/v3/projects/85f2f022dd194968ac40c7313c50d2a8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 13:30:02.869283 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:03.218325 dv-cinder-836027-5-smb devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:09.578364 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a0cd7-5dd7-4954-92b6-f871c4a40245 admin admin] Authenticating user token {{(pid=80297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 13:30:09.579820 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-455a0cd7-5dd7-4954-92b6-f871c4a40245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:30:09.649505 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a0cd7-5dd7-4954-92b6-f871c4a40245 admin admin] Validating token access rules against request {{(pid=80297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 13:30:09.710857 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6e3fa-7328-4308-8e3f-7ab859577d0d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15780b69faa745e9b99f1fffb6abe231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aa2ccddadb54dd9b88ccc6cec98ae37', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 13:30:09.711492 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6e3fa-7328-4308-8e3f-7ab859577d0d service placement] REQUEST_METHOD: `GET` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 13:30:09.711773 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6e3fa-7328-4308-8e3f-7ab859577d0d service placement] SCRIPT_NAME: `/identity` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 13:30:09.712045 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6e3fa-7328-4308-8e3f-7ab859577d0d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 13:30:09.713804 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.fernet_utils [None req-6ce6e3fa-7328-4308-8e3f-7ab859577d0d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 13:30:09.725520 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6e3fa-7328-4308-8e3f-7ab859577d0d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 13:30:09.727113 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6e3fa-7328-4308-8e3f-7ab859577d0d service placement] RBAC: Authorization granted {{(pid=80297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 13:30:09.736833 dv-cinder-836027-5-smb devstack@keystone.service[80297]: [pid: 80297|app: 0|req: 1447/2916] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 10 13:30:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 13:30:19.732663 dv-cinder-836027-5-smb devstack@keystone.service[80297]: DEBUG dbcounter [-] [80297] Writing DB stats keystone:SELECT=58 {{(pid=80297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}